awesome-MIM

Reading list for research topics in Masked Image Modeling(MIM).

We list the most popular methods for MIM, if I missed something, please submit a request. (Note: We show the date of the first version of Arxiv here. But the link of paper may be not the early version.)

Self-supervied Vision Transformers as backbone models.

Date	Method	Conference	Title	Code
2021-06-14	BeiT	ICLR 2022(Oral)	BEiT: BERT Pre-Training of Image Transformers	BeiT
2021-11-11	MAE	Arxiv 2021	Masked Autoencoders Are Scalable Vision Learners	MAE
2021-11-15	iBoT	Arxiv 2021	iBOT: Image BERT Pre-Training with Online Tokenizer	iBoT
2021-11-18	SimMIM	Arxiv 2021	SimMIM: A Simple Framework for Masked Image Modeling	SimMIM
2021-12-16	MaskFeat	Arxiv 2021	Masked Feature Prediction for Self-Supervised Visual Pre-Training	None
2021-12-20	SplitMask	Arxiv 2021	Are Large-scale Datasets Necessary for Self-Supervised Pre-training?	None
2022-01-31	ADIOS	Arxiv 2022	Adversarial Masking for Self-Supervised Learning	None
2022-02-07	CAE	Arxiv 2022	Context Autoencoder for Self-Supervised Representation Learning	None
2022-02-07	CIM	Arxiv 2022	Corrupted Image Modeling for Self-Supervised Visual Pre-Training	None

Reading list for research topics in Masked Image Modeling

Related tags

Overview

awesome-MIM

Self-supervied Vision Transformers as backbone models.

Owner

ligang

Motion planning algorithms commonly used on autonomous vehicles. (path planning + path tracking)

This repository collects 100 papers related to negative sampling methods.

Suite of 500 procedurally-generated NLP tasks to study language model adaptability

load .txt to train YOLOX, same as Yolo others

Contrastive unpaired image-to-image translation, faster and lighter training than cyclegan (ECCV 2020, in PyTorch)

A generalized framework for prototyping full-stack cooperative driving automation applications under CARLA+SUMO.

Dataset used in "PlantDoc: A Dataset for Visual Plant Disease Detection" accepted in CODS-COMAD 2020

Supplementary materials for ISMIR 2021 LBD paper "Evaluation of Latent Space Disentanglement in the Presence of Interdependent Attributes"

Quantify the difference between two arbitrary curves in space

Cerberus Transformer: Joint Semantic, Affordance and Attribute Parsing

Unofficial implementation of MUSIQ (Multi-Scale Image Quality Transformer)

PyTorch Implementation of Daft-Exprt: Robust Prosody Transfer Across Speakers for Expressive Speech Synthesis

Container : Context Aggregation Network

functorch is a prototype of JAX-like composable function transforms for PyTorch.

PyTorch implementation for "Sharpness-aware Quantization for Deep Neural Networks".

Message Passing on Cell Complexes

imbalanced-DL: Deep Imbalanced Learning in Python

an implementation of Revisiting Adaptive Convolutions for Video Frame Interpolation using PyTorch

Python 3 module to print out long strings of text with intervals of time inbetween

This repository contains tutorials for the py4DSTEM Python package