Jacobian-Free Backprop

Associated Publication

JFB: Jacobian-Free Backpropagation for Implicit Models (arXiv Link)

@article{WuFung2022JFB,
    title={JFB: Jacobian-Free Backpropagation for Implicit Models},
    author={Fung, Samy Wu and Heaton, Howard and Li, Qiuwei and McKenzie, Daniel and Osher, Stanley and Yin, Wotao},
    journal={Proceedings of the AAAI Conference on Artificial Intelligence},
    year={2022}
}

Set-up

Install all the requirements:

pip install -r requirements.txt

Training

For each dataset, there are three types of training drivers:

FPN with our proposed backprop:

	python train_CIFAR10.py
	python train_CIFAR10_Unaugmented.py
	python train_MNIST.py
	python train_SVHN.py

FPN with Jacobian-based backprop:

	python train_CIFAR10_Jacobian_Based.py
	python train_CIFAR10_Unaugmented_Jacobian_Based.py
	python train_MNIST_Jacobian_Based.py
	python train_SVHN_Jacobian_Based.py

Explicit models.

	python train_CIFAR10_Explicit.py
	python train_CIFAR10_Unaugmented_Explicit.py
	python train_MNIST_Explicit.py
	python train_SVHN_Explicit.py

JFB: Jacobian-Free Backpropagation for Implicit Models

Related tags

Overview

Jacobian-Free Backprop

Associated Publication

Set-up

Training

Owner

Typal Research

scikit-learn: machine learning in Python

A collection of IPython notebooks covering various topics.

Pytorch implementation of paper: "NeurMiPs: Neural Mixture of Planar Experts for View Synthesis"

Accurate identification of bacteriophages from metagenomic data using Transformer

Code for project: "Learning to Minimize Remainder in Supervised Learning".

Official Implementation of SWAD (NeurIPS 2021)

Honours project, on creating a depth estimation map from two stereo images of featureless regions

NeuralForecast is a Python library for time series forecasting with deep learning models

In this repo we reproduce and extend results of Learning in High Dimension Always Amounts to Extrapolation by Balestriero et al. 2021

Distributed Asynchronous Hyperparameter Optimization better than HyperOpt.

Automatic Idiomatic Expression Detection

Official code of paper: MovingFashion: a Benchmark for the Video-to-Shop Challenge

scalingscattering

Histocartography is a framework bringing together AI and Digital Pathology

a grammar based feedback fuzzer

Classify the disease status of a plant given an image of a passion fruit

Code for Blind Image Decomposition (BID) and Blind Image Decomposition network (BIDeN).

RLMeta is a light-weight flexible framework for Distributed Reinforcement Learning Research.

Joint-task Self-supervised Learning for Temporal Correspondence (NeurIPS 2019)

Finding all things on-prem Microsoft for password spraying and enumeration.