Official Pytorch implementation of Meta Internal Learning

Last update: Aug 24, 2022

Related tags

Overview

Meta Internal Learning

This repository is the official implementation of Meta Internal Learning by Raphael Bensadoun, Shir Gur, Tomer Galanti, Lior Wolf.

Project | arXiv | Code

Requirements

To install requirements:

pip install -r requirements.txt

Training on a dataset

Create a folder X containing the images. (see structure in data folder)
Determine how many iterations Y to train by scale (depends mostly on the size of the dataset, you may refer to the appendix for reference).
Run

python train.py --image-path X --batch-size 16 --visualize --niter Y --min-size 25 --checkname X_result --SAVE-MODEL --SAVE-IMGS

Generated images, tensorboard logs and trained models are stored in MetaInternalLearning/run/X_result.

The default input format is jpg. Use '--file-suffix png' for .png files.

Examples from paper -

Places-50 -

python train.py --image-path data/places_50 --batch-size 16 --visualize --niter 4000  --min-size 28 --checkname places_50_result --SAVE-MODEL --SAVE-IMGS

LSUN-50

python train.py --image-path data/lsun_50 --batch-size 16 --visualize --niter 5000  --checkname lsun_50_result --SAVE-MODEL --SAVE-IMGS

Valley dataset can be downloaded here - http://places2.csail.mit.edu/download.html (256x256 small images) and can be divided into subsets as mentioned in the paper.

V500 -

python train.py --image-path data/V500 --batch-size 16 --visualize --niter 25000 --min-size 25 --checkname v500_result --ar 1 --SAVE-MODEL

V2500 -

python train_dataset_parallel.py --image-path data/V2500 --batch-size 16 --niter 100000 --rec-weight 50 --min-size 25 --checkname v2500_result --ar 1 --SAVE-MODEL

V5000 -

python train_dataset_parallel.py --image-path data/V5000 --batch-size 16 --niter 150000 --rec-weight 50 --min-size 25 --checkname v5000_result --ar 1 --SAVE-MODEL

Applications

Coming soon!

Official Pytorch implementation of Meta Internal Learning

Related tags

Overview

Meta Internal Learning

Requirements

Training on a dataset

Examples from paper -

Applications

Owner

Cross-modal Retrieval using Transformer Encoder Reasoning Networks (TERN). With use of Metric Learning and FAISS for fast similarity search on GPU

Magisk module to enable hidden features on Android 12 Developer Preview 1.

Multi-modal Vision Transformers Excel at Class-agnostic Object Detection

Setup freqtrade/freqUI on Heroku

Tech Resources for Academic Communities

Multi-tool reverse engineering collaboration solution.

Detectorch - detectron for PyTorch

ICS 4u HD project, start before-wards. A curtain shooting game using python.

[CVPR 21] Vectorization and Rasterization: Self-Supervised Learning for Sketch and Handwriting, IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), 2021.

An end-to-end machine learning web app to predict rugby scores (Pandas, SQLite, Keras, Flask, Docker)

Optimizing DR with hard negatives and achieving SOTA first-stage retrieval performance on TREC DL Track (SIGIR 2021 Full Paper).

Source code release of the paper: Knowledge-Guided Deep Fractal Neural Networks for Human Pose Estimation.

[NeurIPS 2021] Better Safe Than Sorry: Preventing Delusive Adversaries with Adversarial Training

Materials for upcoming beginner-friendly PyTorch course (work in progress).

Training Certifiably Robust Neural Networks with Efficient Local Lipschitz Bounds (Local-Lip)

IOT: Instance-wise Layer Reordering for Transformer Structures

A Runtime method overload decorator which should behave like a compiled language

Universal Probability Distributions with Optimal Transport and Convex Optimization

Learning Energy-Based Models by Diffusion Recovery Likelihood

This repository includes different versions of the prescribed-time controller as Simulink blocks and MATLAB script codes for engineering applications.