awesome-MIM

Reading list for research topics in Masked Image Modeling(MIM).

We list the most popular methods for MIM, if I missed something, please submit a request. (Note: We show the date of the first version of Arxiv here. But the link of paper may be not the early version.)

Self-supervied Vision Transformers as backbone models.

Date	Method	Conference	Title	Code
2021-06-14	BeiT	ICLR 2022(Oral)	BEiT: BERT Pre-Training of Image Transformers	BeiT
2021-11-11	MAE	Arxiv 2021	Masked Autoencoders Are Scalable Vision Learners	MAE
2021-11-15	iBoT	Arxiv 2021	iBOT: Image BERT Pre-Training with Online Tokenizer	iBoT
2021-11-18	SimMIM	Arxiv 2021	SimMIM: A Simple Framework for Masked Image Modeling	SimMIM
2021-12-16	MaskFeat	Arxiv 2021	Masked Feature Prediction for Self-Supervised Visual Pre-Training	None
2021-12-20	SplitMask	Arxiv 2021	Are Large-scale Datasets Necessary for Self-Supervised Pre-training?	None
2022-01-31	ADIOS	Arxiv 2022	Adversarial Masking for Self-Supervised Learning	None
2022-02-07	CAE	Arxiv 2022	Context Autoencoder for Self-Supervised Representation Learning	None
2022-02-07	CIM	Arxiv 2022	Corrupted Image Modeling for Self-Supervised Visual Pre-Training	None

Reading list for research topics in Masked Image Modeling

Related tags

Overview

awesome-MIM

Self-supervied Vision Transformers as backbone models.

Owner

ligang

EASY - Ensemble Augmented-Shot Y-shaped Learning: State-Of-The-Art Few-Shot Classification with Simple Ingredients.

Implementation of Kalman Filter in Python

Self-Supervised Learning with Data Augmentations Provably Isolates Content from Style

TorchXRayVision: A library of chest X-ray datasets and models.

A package for "Procedural Content Generation via Reinforcement Learning" OpenAI Gym interface.

HGCN: Harmonic Gated Compensation Network For Speech Enhancement

Official implementation of the NeurIPS'21 paper 'Conditional Generation Using Polynomial Expansions'.

Faster RCNN with PyTorch

Weighted QMIX: Expanding Monotonic Value Function Factorisation

95.47% on CIFAR10 with PyTorch

A Deep Learning based project for creating line art portraits.

Code for Referring Image Segmentation via Cross-Modal Progressive Comprehension, CVPR2020.

Performance Analysis of Multi-user NOMA Wireless-Powered mMTC Networks: A Stochastic Geometry Approach

gym-anm is a framework for designing reinforcement learning (RL) environments that model Active Network Management (ANM) tasks in electricity distribution networks.

This repo provides function call to track multi-objects in videos

Prototype-based Incremental Few-Shot Semantic Segmentation

Official implementation of Unfolded Deep Kernel Estimation for Blind Image Super-resolution.

The project is an official implementation of our paper "3D Human Pose Estimation with Spatial and Temporal Transformers".

Dataset Cartography: Mapping and Diagnosing Datasets with Training Dynamics

Official release of MSHT: Multi-stage Hybrid Transformer for the ROSE Image Analysis of Pancreatic Cancer axriv: http://arxiv.org/abs/2112.13513