LPAQA: Language model Prompt And Query Archive

This repository contains data and code for the paper How Can We Know What Language Models Know?

Install

Our repository is based on LAMA. Please download our fork from here and follow the instructions to set up the environment and download pre-trained language models.

# clone LPAQA
git clone https://github.com/jzbjyb/LPAQA.git LPAQA
# clone LAMA
git clone https://github.com/jzbjyb/LAMA.git LAMA
pushd LAMA && git reset --hard b6b1885c64de5981f249a8b65de25cb0802b4bd5 && rm -rf .git && popd
mv LAMA/* LPAQA/ && rm -rf LAMA
# follow the instructions to install
cd LPAQA
./setup.sh

Retrieve factual knowledge from LMs

For example, to query the owner of MSN (Microsoft is the answer), you can either use manually created prompts (x is owned by y):

python lama/eval_generation.py --lm bert --t "MSN is owned by [MASK]."

or use LPAQA that ensembles a diversity of prompts:

# mined prompts
python lama/eval_ensemble.py --lm bert --subject MSN --relation P127 --prompts prompt/mine
# paraphrased prompts
python lama/eval_ensemble.py --lm bert --subject MSN --relation P127 --prompts prompt/paraphrase

Language model Prompt And Query Archive

Related tags

Overview

LPAQA: Language model Prompt And Query Archive

Install

Retrieve factual knowledge from LMs

Owner

Code to reproduce the results in the paper "Tensor Component Analysis for Interpreting the Latent Space of GANs".

PyTorch implementation of the ideas presented in the paper Interaction Grounded Learning (IGL)

Implementation of the paper Recurrent Glimpse-based Decoder for Detection with Transformer.

Deep learning PyTorch library for time series forecasting, classification, and anomaly detection

D²Conv3D: Dynamic Dilated Convolutions for Object Segmentation in Videos

Fedlearn支持前沿算法研发的Python工具库 | Fedlearn algorithm toolkit for researchers

This is the official PyTorch implementation of the paper "TransFG: A Transformer Architecture for Fine-grained Recognition" (Ju He, Jie-Neng Chen, Shuai Liu, Adam Kortylewski, Cheng Yang, Yutong Bai, Changhu Wang, Alan Yuille).

The repo for reproducing Seed-driven Document Ranking for Systematic Reviews: A Reproducibility Study

Unsupervised CNN for Single View Depth Estimation: Geometry to the Rescue

68 keypoint annotations for COFW test data

An Industrial Grade Federated Learning Framework

🤖 Project template for your next awesome AI project. 🦾

Machine learning, in numpy

Codebase for INVASE: Instance-wise Variable Selection - 2019 ICLR

Deep Networks with Recurrent Layer Aggregation

Head2Toe: Utilizing Intermediate Representations for Better OOD Generalization

Repo for "Benchmarking Robustness of 3D Point Cloud Recognition against Common Corruptions" https://arxiv.org/abs/2201.12296

DrQ-v2: Improved Data-Augmented Reinforcement Learning

Official Implementation of CVPR 2022 paper: "Mimicking the Oracle: An Initial Phase Decorrelation Approach for Class Incremental Learning"

A simple baseline for 3d human pose estimation in PyTorch.