Official Pytorch implementation of Meta Internal Learning

Last update: Aug 24, 2022

Related tags

Overview

Meta Internal Learning

This repository is the official implementation of Meta Internal Learning by Raphael Bensadoun, Shir Gur, Tomer Galanti, Lior Wolf.

Project | arXiv | Code

Requirements

To install requirements:

pip install -r requirements.txt

Training on a dataset

Create a folder X containing the images. (see structure in data folder)
Determine how many iterations Y to train by scale (depends mostly on the size of the dataset, you may refer to the appendix for reference).
Run

python train.py --image-path X --batch-size 16 --visualize --niter Y --min-size 25 --checkname X_result --SAVE-MODEL --SAVE-IMGS

Generated images, tensorboard logs and trained models are stored in MetaInternalLearning/run/X_result.

The default input format is jpg. Use '--file-suffix png' for .png files.

Examples from paper -

Places-50 -

python train.py --image-path data/places_50 --batch-size 16 --visualize --niter 4000  --min-size 28 --checkname places_50_result --SAVE-MODEL --SAVE-IMGS

LSUN-50

python train.py --image-path data/lsun_50 --batch-size 16 --visualize --niter 5000  --checkname lsun_50_result --SAVE-MODEL --SAVE-IMGS

Valley dataset can be downloaded here - http://places2.csail.mit.edu/download.html (256x256 small images) and can be divided into subsets as mentioned in the paper.

V500 -

python train.py --image-path data/V500 --batch-size 16 --visualize --niter 25000 --min-size 25 --checkname v500_result --ar 1 --SAVE-MODEL

V2500 -

python train_dataset_parallel.py --image-path data/V2500 --batch-size 16 --niter 100000 --rec-weight 50 --min-size 25 --checkname v2500_result --ar 1 --SAVE-MODEL

V5000 -

python train_dataset_parallel.py --image-path data/V5000 --batch-size 16 --niter 150000 --rec-weight 50 --min-size 25 --checkname v5000_result --ar 1 --SAVE-MODEL

Applications

Coming soon!

Official Pytorch implementation of Meta Internal Learning

Related tags

Overview

Meta Internal Learning

Requirements

Training on a dataset

Examples from paper -

Applications

Owner

FedScale: Benchmarking Model and System Performance of Federated Learning

MINIROCKET: A Very Fast (Almost) Deterministic Transform for Time Series Classification

CURL: Contrastive Unsupervised Representations for Reinforcement Learning

The implementation of ICASSP 2020 paper "Pixel-level self-paced learning for super-resolution"

Split Variational AutoEncoder

Code for "PVNet: Pixel-wise Voting Network for 6DoF Pose Estimation" CVPR 2019 oral

A tool to visualise the results of AlphaFold2 and inspect the quality of structural predictions

SUPERVISED-CONTRASTIVE-LEARNING-FOR-PRE-TRAINED-LANGUAGE-MODEL-FINE-TUNING - The Facebook paper about fine tuning RoBERTa with contrastive loss

Official pytorch code for SSC-GAN: Semi-Supervised Single-Stage Controllable GANs for Conditional Fine-Grained Image Generation(ICCV 2021)

LOFO (Leave One Feature Out) Importance calculates the importances of a set of features based on a metric of choice,

Human Pose Detection on EdgeTPU

SmallInitEmb - LayerNorm(SmallInit(Embedding)) in a Transformer to improve convergence

Automatically measure the facial Width-To-Height ratio and get facial analysis results provided by Microsoft Azure

Miscellaneous and lightweight network tools

Tensorflow implementation of "BEGAN: Boundary Equilibrium Generative Adversarial Networks"

OpenDILab RL Kubernetes Custom Resource and Operator Lib

ML From Scratch

Character Grounding and Re-Identification in Story of Videos and Text Descriptions

An open-access benchmark and toolbox for electricity price forecasting

Code for "Learning Structural Edits via Incremental Tree Transformations" (ICLR'21)