Jacobian-Free Backprop

Associated Publication

JFB: Jacobian-Free Backpropagation for Implicit Models (arXiv Link)

@article{WuFung2022JFB,
    title={JFB: Jacobian-Free Backpropagation for Implicit Models},
    author={Fung, Samy Wu and Heaton, Howard and Li, Qiuwei and McKenzie, Daniel and Osher, Stanley and Yin, Wotao},
    journal={Proceedings of the AAAI Conference on Artificial Intelligence},
    year={2022}
}

Set-up

Install all the requirements:

pip install -r requirements.txt

Training

For each dataset, there are three types of training drivers:

FPN with our proposed backprop:

	python train_CIFAR10.py
	python train_CIFAR10_Unaugmented.py
	python train_MNIST.py
	python train_SVHN.py

FPN with Jacobian-based backprop:

	python train_CIFAR10_Jacobian_Based.py
	python train_CIFAR10_Unaugmented_Jacobian_Based.py
	python train_MNIST_Jacobian_Based.py
	python train_SVHN_Jacobian_Based.py

Explicit models.

	python train_CIFAR10_Explicit.py
	python train_CIFAR10_Unaugmented_Explicit.py
	python train_MNIST_Explicit.py
	python train_SVHN_Explicit.py

JFB: Jacobian-Free Backpropagation for Implicit Models

Related tags

Overview

Jacobian-Free Backprop

Associated Publication

Set-up

Training

Owner

Typal Research

Using contrastive learning and OpenAI's CLIP to find good embeddings for images with lossy transformations

공공장소에서 눈만 돌리면 CCTV가 보인다는 말이 과언이 아닐 정도로 CCTV가 우리 생활에 깊숙이 자리 잡았습니다.

Code for Robust Contrastive Learning against Noisy Views

Code of PVTv2 is released! PVTv2 largely improves PVTv1 and works better than Swin Transformer with ImageNet-1K pre-training.

Some experiments with tennis player aging curves using Hilbert space GPs in PyMC. Only experimental for now.

Using pretrained language models for biomedical knowledge graph completion.

Ensembling Off-the-shelf Models for GAN Training

a reimplementation of Optical Flow Estimation using a Spatial Pyramid Network in PyTorch

Pytorch implementation of Value Iteration Networks (NIPS 2016 best paper)

A library for researching neural networks compression and acceleration methods.

Awesome Human Pose Estimation

Code for Emergent Translation in Multi-Agent Communication

Official code for Spoken ObjectNet: A Bias-Controlled Spoken Caption Dataset

Cluttered MNIST Dataset

Segmentation Training Pipeline

Tianshou - An elegant PyTorch deep reinforcement learning library.

Probabilistic Tracklet Scoring and Inpainting for Multiple Object Tracking

Extracting and filtering paraphrases by bridging natural language inference and paraphrasing

Code reproduce for paper "Vehicle Re-identification with Viewpoint-aware Metric Learning"

small collection of functions for neural networks