Differentiable Annealed Importance Sampling (DAIS)

This repository contains the code to reproduce the DAIS results from the paper Differentiable Annealed Importance Sampling and the Perils of Gradient Noise.

Bayesian Linear Regression

Please first install JAX (https://github.com/google/jax), then reproduce our results by running the following:

python blr/dais.py --gamma 0.0
python blr/dais.py --gamma 0.9
python blr.dais.py --bsize 100

Variational Autoencoder

Please first install PyTorch (https://pytorch.org/).

For training, one example command for DAIS with $K = 10$ and $S = 5$ (to adapt annealing scheme, add --adapt_beta):

python vae/mnist_train.py --lf_step 10 --n_particles 5 --lf_lrate 0.08

After training, you can find the saved checkpoint and evaluate it (e.g., using AIS):

python vae/mnist_eval.py --ais --n_particles 10 --lf_step 10000 --lf_lrate 0.05 --resume xxx

Also, you can reproduce the evaulation results of AIS/HAIS/DAIS by runing vae/mnist_eval_scaling.py:

python vae/mnist_eval_scaling.py --linear_beta --lf_lrate 0.08 --n_particles 10 --resume xxx

Citation

To cite this work, please use

@inproceedings{
	zhang2021differentiable,
	title={Differentiable Annealed Importance Sampling and the Perils of Gradient Noise},
	author={Guodong Zhang and Kyle Hsu and Jianing Li and Chelsea Finn and Roger Baker Grosse},
	booktitle={Thirty-Fifth Conference on Neural Information Processing Systems},
	year={2021},
	url={https://openreview.net/forum?id=6rqjgrL7Lq}
}

Differentiable Annealed Importance Sampling (DAIS)

Related tags

Overview

Differentiable Annealed Importance Sampling (DAIS)

Bayesian Linear Regression

Variational Autoencoder

Citation

Owner

Guodong Zhang

A Pytorch Implementation of ClariNet

Official PyTorch implementation of Synergies Between Affordance and Geometry: 6-DoF Grasp Detection via Implicit Representations

Official and maintained implementation of the paper "OSS-Net: Memory Efficient High Resolution Semantic Segmentation of 3D Medical Data" [BMVC 2021].

Relative Positional Encoding for Transformers with Linear Complexity

Code to reproduce results from the paper "AmbientGAN: Generative models from lossy measurements"

Pytorch Implementation of Zero-Shot Image-to-Text Generation for Visual-Semantic Arithmetic

Paper: Cross-View Kernel Similarity Metric Learning Using Pairwise Constraints for Person Re-identification

Code for AA-RMVSNet: Adaptive Aggregation Recurrent Multi-view Stereo Network (ICCV 2021).

Capstone-Project-2 - A game program written in the Python language

Boostcamp AI Tech 3rd / Basic Paper reading w.r.t Embedding

A criticism of a recent paper on buggy image downsampling methods in popular image processing and deep learning libraries.

TriMap: Large-scale Dimensionality Reduction Using Triplets

Code for the CIKM 2019 paper "DSANet: Dual Self-Attention Network for Multivariate Time Series Forecasting".

The 3rd place solution for competition

Library for fast text representation and classification.

Styled Augmented Translation

A highly efficient and modular implementation of Gaussian Processes in PyTorch

Machine learning for NeuroImaging in Python

LUKE -- Language Understanding with Knowledge-based Embeddings

Simple (but Strong) Baselines for POMDPs