Adversarially Learned Inference

Last update: Sep 24, 2022

Related tags

Deep Learning ALI

Overview

Adversarially Learned Inference

Code for the Adversarially Learned Inference paper.

Compiling the paper locally

From the repo's root directory,

$ cd papers
$ latexmk --pdf adverarially_learned_inference

Requirements

Blocks, development version
Fuel, development version

Setup

Clone the repository, then install with

$ pip install -e ALI

Downloading and converting the datasets

Set up your ~/.fuelrc file:

$ echo "data_path: \"<MY_DATA_PATH>\"" > ~/.fuelrc

Go to <MY_DATA_PATH>:

$ cd <MY_DATA_PATH>

Download the CIFAR-10 dataset:

$ fuel-download cifar10
$ fuel-convert cifar10
$ fuel-download cifar10 --clear

Download the SVHN format 2 dataset:

$ fuel-download svhn 2
$ fuel-convert svhn 2
$ fuel-download svhn 2 --clear

Download the CelebA dataset:

$ fuel-download celeba 64
$ fuel-convert celeba 64
$ fuel-download celeba 64 --clear

Training the models

Make sure you're in the repo's root directory.

CIFAR-10

$ THEANORC=theanorc python experiments/ali_cifar10.py

SVHN

$ THEANORC=theanorc python experiments/ali_svhn.py

CelebA

$ THEANORC=theanorc python experiments/ali_celeba.py

Toy task

$ THEANORC=theanorc python experiments/ali_mixture.py

$ THEANORC=theanorc python experiments/gan_mixture.py

Evaluating the models

Samples

$ THEANORC=theanorc scripts/sample [main_loop.tar]

e.g.

$ THEANORC=theanorc scripts/sample ali_cifar10.tar

Interpolations

$ THEANORC=theanorc scripts/interpolate [which_dataset] [main_loop.tar]

e.g.

$ THEANORC=theanorc scripts/interpolate celeba ali_celeba.tar

Reconstructions

$ THEANORC=theanorc scripts/reconstruct [which_dataset] [main_loop.tar]

e.g.

$ THEANORC=theanorc scripts/reconstruct cifar10 ali_cifar10.tar

Semi-supervised learning on SVHN

First, preprocess the SVHN dataset with the learned ALI features:

$ THEANORC=theanorc scripts/preprocess_representations [main_loop.tar] [save_path.hdf5]

e.g.

$ THEANORC=theanorc scripts/preprocess_representations ali_svhn.tar ali_svhn_preprocessed.hdf5

Then, launch the semi-supervised script:

$ python experiments/semi_supervised_svhn.py ali_svhn.tar [save_path.hdf5]

e.g.

$ python experiments/semi_supervised_svhn.py ali_svhn_preprocessed.hdf5

[...]
Validation error rate = ... +- ...
Test error rate = ... +- ...

Toy task

$ THEANORC=theanorc scripts/generate_mixture_plots [ali_main_loop.tar] [gan_main_loop.tar]

e.g.

$ THEANORC=theanorc scripts/generate_mixture_plots ali_mixture.tar gan_mixture.tar

Comments

Conditional Generation

I'm interested in getting the update to this codebase that includes the conditional generation, as covered in the more recent version of the paper (related image below). Can you let me know if that will be added to the repo?

opened by dribnet 8
mistake in D(x,z) input size

In table 5 from the paper you state that the input size for D(x,z) is 1024x1x1 which I think it's wrong after looking at the previous output sizes D(x) and D(z). I think that should be 1536x1x1.

Is that assumption correct?

opened by edgarriba 5
deserialization of models hangs

Training goes well for me using the scripts in experiments with the latest version of blocks, but then when I run any subsequent command that uses the generated model like scripts/sample or scripts/reconstruct, the command hangs indefinitely. My guess is that the deserialization is getting jammed up.

I can look into it more - not yet familiar with the new tar format - but curious if this might be a known issue.

opened by dribnet 3
Fuel version problem

I installed the current development version of fuel, but had some issue in fuel downloading.

$ fuel-download celeba 64 $ fuel-convert celeba 64 $ fuel-download celeba 64 --clear

The error message I got is: fuel-download: error: unrecognized arguments: 64 if I remove 64, I got: TypeError: init() got an unexpected keyword argument 'max_value'

Could someone please specify what version or commits of fuel and progressbar should I use? Thanks

opened by hope-yao 1
Where to use the reparametrization trick

In the decoder module. I found that z is sampled from N(0, 1), so where did you use the reparametrization trick described in formual (2) and (3) in the paper

opened by wuhaozhe 0
semi-supervised learning

Hello,I read the paper and the source code.And it mentioned 'The last three hidden layers of the encoder as well as its output are concatenated to form a 8960-dimensional feature vector.' in section 4.3 of the paper.Could you please tell me how to compute the dimension?Thanks very much

opened by C-xiaomeng 1

ImportError: No module named ali.utils

I followed the same steps in the readme file, but when I run this line

$ THEANORC=theanorc python experiments/ali_cifar10.py

I get:

Traceback (most recent call last):
  File "experiments/ali_cifar10.py", line 3, in <module>
    from ali.utils import get_log_odds, conv_brick, conv_transpose_brick, bn_brick
ImportError: No module named ali.utils

opened by xtarx 0

Preprocess_representation has a bug for me

Hi, I was trying to reproduce the representation learning results of paper. Everything works fine except "preprocess_representations" script. It is leading to this error:

File "scripts/preprocess_representations", line 32, in preprocess_svhn bricks=[ali.encoder.layers[-9], ali.encoder.layers[-6], AttributeError: 'GaussianConditional' object has no attribute 'layers'

Any help would be appreciated.

opened by MarziEd 1
Semi-supervised learning

I've been trying to reproduce your figures for semi-supervised learning on CIFAR-10 (19.98% with 1000 labels). This result is based on the technique proposed in Salimans et al. (2016), not SVMs. Is there any way you can include your code, or at least any changes to the hyperparameters in ali_cifar10.py?

Thanks in advance for your help.

opened by christiancosgrove 7

Releases(v1)

v1(Jun 3, 2016)

Source code(tar.gz)
Source code(zip)

Owner

Mohamed Ishmael Belghazi

GitHub Repository

A script depending on VASP output for calculating Fermi-Softness.

Fermi softness calculation for Vienna Ab initio Simulation Package (VASP) Update 1.1.0: Big update: Rewrote the code. Use Bader atomic division instea

11 Nov 08, 2022

Аналитика доходности инвестиционного портфеля в Тинькофф брокере

Аналитика доходности инвестиционного портфеля Тиньков Видео на YouTube Для работы скрипта нужно установить три переменных окружения: export TINKOFF_TO

64 Dec 17, 2022

Arbitrary Distribution Modeling with Censorship in Real Time 59 2 60 3 Bidding Advertising for KDD'21

Arbitrary_Distribution_Modeling This repo implements the Neighborhood Likelihood Loss (NLL) and Arbitrary Distribution Modeling (ADM, with Interacting

7 Jan 03, 2023

This repository contains the entire code for our work "Two-Timescale End-to-End Learning for Channel Acquisition and Hybrid Precoding"

Two-Timescale-DNN Two-Timescale End-to-End Learning for Channel Acquisition and Hybrid Precoding This repository contains the entire code for our work

3 Mar 07, 2022

This is a Deep Leaning API for classifying emotions from human face and human audios.

Emotion AI This is a Deep Leaning API for classifying emotions from human face and human audios. Starting the server To start the server first you nee

5 Oct 02, 2022

3D HourGlass Networks for Human Pose Estimation Through Videos

3D-HourGlass-Network 3D CNN Based Hourglass Network for Human Pose Estimation (3D Human Pose) from videos. This was my summer'18 research project. Dis

51 Jan 02, 2023

How to Train a GAN? Tips and tricks to make GANs work

(this list is no longer maintained, and I am not sure how relevant it is in 2020) How to Train a GAN? Tips and tricks to make GANs work While research

10.8k Dec 31, 2022

Random-Afg - Afghanistan Random Old Idz Cloner Tools

AFGHANISTAN RANDOM OLD IDZ CLONER TOOLS Install $ apt update $ apt upgrade $ apt

5 Jan 26, 2022

Moiré Attack (MA): A New Potential Risk of Screen Photos [NeurIPS 2021]

Moiré Attack (MA): A New Potential Risk of Screen Photos [NeurIPS 2021] This repository is the official implementation of Moiré Attack (MA): A New Pot

22 Dec 24, 2022

Data and Code for ACL 2021 Paper "Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoning"

Introduction Code and data for ACL 2021 Paper "Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoning". We cons

81 Dec 27, 2022

Adversarially Learned Inference

Related tags

Overview

Adversarially Learned Inference

Compiling the paper locally

Requirements

Setup

Downloading and converting the datasets

Training the models

CIFAR-10

SVHN

CelebA

Toy task

Evaluating the models

Samples

Interpolations

Reconstructions

Semi-supervised learning on SVHN

Toy task

Comments

Releases(v1)

v1(Jun 3, 2016)

Owner

Mohamed Ishmael Belghazi

A script depending on VASP output for calculating Fermi-Softness.

Аналитика доходности инвестиционного портфеля в Тинькофф брокере

Arbitrary Distribution Modeling with Censorship in Real Time 59 2 60 3 Bidding Advertising for KDD'21

This repository contains the entire code for our work "Two-Timescale End-to-End Learning for Channel Acquisition and Hybrid Precoding"

This is a Deep Leaning API for classifying emotions from human face and human audios.

3D HourGlass Networks for Human Pose Estimation Through Videos

How to Train a GAN? Tips and tricks to make GANs work

Random-Afg - Afghanistan Random Old Idz Cloner Tools

Moiré Attack (MA): A New Potential Risk of Screen Photos [NeurIPS 2021]

Data and Code for ACL 2021 Paper "Inter-GPS: Interpretable Geometry Problem Solving with Formal Language and Symbolic Reasoning"

Bayesian Optimization using GPflow

Imaging, analysis, and simulation software for radio interferometry

Just playing with getting VQGAN+CLIP running locally, rather than having to use colab.

"Graph Neural Controlled Differential Equations for Traffic Forecasting", AAAI 2022

Multi Agent Reinforcement Learning for ROS in 2D Simulation Environments

COVID-VIT: Classification of Covid-19 from CT chest images based on vision transformer models

The codes and related files to reproduce the results for Image Similarity Challenge Track 2.

Small little script to scrape, parse and check for active tor nodes. Can be used as proxies.

A PyTorch implementation of "ANEMONE: Graph Anomaly Detection with Multi-Scale Contrastive Learning", CIKM-21