LPAQA: Language model Prompt And Query Archive

This repository contains data and code for the paper How Can We Know What Language Models Know?

Install

Our repository is based on LAMA. Please download our fork from here and follow the instructions to set up the environment and download pre-trained language models.

# clone LPAQA
git clone https://github.com/jzbjyb/LPAQA.git LPAQA
# clone LAMA
git clone https://github.com/jzbjyb/LAMA.git LAMA
pushd LAMA && git reset --hard b6b1885c64de5981f249a8b65de25cb0802b4bd5 && rm -rf .git && popd
mv LAMA/* LPAQA/ && rm -rf LAMA
# follow the instructions to install
cd LPAQA
./setup.sh

Retrieve factual knowledge from LMs

For example, to query the owner of MSN (Microsoft is the answer), you can either use manually created prompts (x is owned by y):

python lama/eval_generation.py --lm bert --t "MSN is owned by [MASK]."

or use LPAQA that ensembles a diversity of prompts:

# mined prompts
python lama/eval_ensemble.py --lm bert --subject MSN --relation P127 --prompts prompt/mine
# paraphrased prompts
python lama/eval_ensemble.py --lm bert --subject MSN --relation P127 --prompts prompt/paraphrase

Language model Prompt And Query Archive

Related tags

Overview

LPAQA: Language model Prompt And Query Archive

Install

Retrieve factual knowledge from LMs

Owner

[CVPR'22] Official PyTorch Implementation of Collaborative Transformers for Grounded Situation Recognition

A python module for scientific analysis of 3D objects based on VTK and Numpy

An Open Source Machine Learning Framework for Everyone

Here is the implementation of our paper S2VC: A Framework for Any-to-Any Voice Conversion with Self-Supervised Pretrained Representations.

HHP-Net: A light Heteroscedastic neural network for Head Pose estimation with uncertainty

This repository contains the entire code for our work "Two-Timescale End-to-End Learning for Channel Acquisition and Hybrid Precoding"

Program your own vulkan.gpuinfo.org query in Python. Used to determine baseline hardware for WebGPU.

Redash reset for python

Official code release for "GRAF: Generative Radiance Fields for 3D-Aware Image Synthesis"

Differentiable Prompt Makes Pre-trained Language Models Better Few-shot Learners

一套完整的微博舆情分析流程代码，包括微博爬虫、LDA主题分析和情感分析。

source code for https://arxiv.org/abs/2005.11248 "Accelerating Antimicrobial Discovery with Controllable Deep Generative Models and Molecular Dynamics"

Lama-cleaner: Image inpainting tool powered by LaMa

TEA: A Sequential Recommendation Framework via Temporally Evolving Aggregations

Finetune the base 64 px GLIDE-text2im model from OpenAI on your own image-text dataset

Unsupervised Foreground Extraction via Deep Region Competition

This is just a funny project that we want to see AutoEncoder (AE) can actually work to enhance the features we want

RMNA: A Neighbor Aggregation-Based Knowledge Graph Representation Learning Model Using Rule Mining

An official PyTorch implementation of the TKDE paper "Self-Supervised Graph Representation Learning via Topology Transformations".

Data Engineering ZoomCamp