[CVPR 2022 Oral] Crafting Better Contrastive Views for Siamese Representation Learning

Last update: Dec 28, 2022

Overview

Crafting Better Contrastive Views for Siamese Representation Learning (CVPR 2022 Oral)

2022-03-29: The paper was selected as a CVPR 2022 Oral paper!

2022-03-03: The paper was accepted by CVPR 2022!

This is the official PyTorch implementation of the ContrastiveCrop paper:

@article{peng2022crafting,
  title={Crafting Better Contrastive Views for Siamese Representation Learning},
  author={Peng, Xiangyu and Wang, Kai and Zhu, Zheng and You, Yang},
  journal={arXiv preprint arXiv:2202.03278},
  year={2022}
}

This repo includes PyTorch implementation of SimCLR, MoCo, BYOL and SimSiam, as well as their DDP training code.

Preparation

Create a python enviroment with pytorch >= 1.8.1.
pip install -r requirements.txt
Modify dataset root in the config file.

Pre-train

# MoCo, CIFAR-10, CCrop
python DDP_moco_ccrop.py configs/small/cifar10/moco_ccrop.py

# SimSiam, CIFAR-100, CCrop
python DDP_simsiam_ccrop.py configs/small/cifar100/simsiam_ccrop.py

# MoCo V2, IN-200, CCrop
python DDP_moco_ccrop.py configs/IN200/mocov2_ccrop.py

# MoCo V2, IN-1K, CCrop
python DDP_moco_ccrop.py configs/IN1K/mocov2_ccrop.py

We also recommend trying an even simpler version of ContrastiveCrop, named SimCCrop, that simply fixes a box at the center of the image with half height & width of that image. SimCCrop even does not require localization and thus adds NO extra training overhead. It should work well on almost 'object-centric' datasets.

# MoCo, SimCCrop
python DDP_moco_ccrop.py configs/small/cifar10/moco_simccrop.py
python DDP_moco_ccrop.py configs/small/cifar100/moco_simccrop.py

Linear Evaluation

# CIFAR-10
python DDP_linear.py configs/linear/cifar10_res18.py --load ./checkpoints/small/cifar10/moco_ccrop/last.pth

# CIFAR-100
python DDP_linear.py configs/linear/cifar100_res18.py --load ./checkpoints/small/cifar100/simsiam_ccrop/last.pth

# IN-200 
python DDP_linear.py configs/linear/IN200_res50.py --load ./checkpoints/IN200/mocov2_ccrop/last.pth

# IN-1K
python DDP_linear.py configs/linear/IN1K_res50.py --load ./checkpoints/IN1K/mocov2_ccrop/last.pth

More models and datasets coming soon.

[CVPR 2022 Oral] Crafting Better Contrastive Views for Siamese Representation Learning

Related tags

Overview

Crafting Better Contrastive Views for Siamese Representation Learning (CVPR 2022 Oral)

Preparation

Pre-train

Linear Evaluation

Owner

Unsupervised Image Generation with Infinite Generative Adversarial Networks

Implementation for Panoptic-PolarNet (CVPR 2021)

Multi-task Self-supervised Object Detection via Recycling of Bounding Box Annotations (CVPR, 2019)

PyTorch 1.5 implementation for paper DECOR-GAN: 3D Shape Detailization by Conditional Refinement.

Chinese license plate recognition

FIRM-AFL is the first high-throughput greybox fuzzer for IoT firmware.

The Face Mask recognition system uses AI technology to detect the person with or without a mask.

Object Detection using YOLO from PyImageSearch

Unicorn can be used for performance analyses of highly configurable systems with causal reasoning

PyTorch implementation of the R2Plus1D convolution based ResNet architecture described in the paper "A Closer Look at Spatiotemporal Convolutions for Action Recognition"

Deep learning operations reinvented (for pytorch, tensorflow, jax and others)

Pytorch implementation of MaskGIT: Masked Generative Image Transformer

Keras udrl - Keras implementation of Upside Down Reinforcement Learning

EdiBERT is a generative model based on a bi-directional transformer, suited for image manipulation

RGBD-Net - This repository contains a pytorch lightning implementation for the 3DV 2021 RGBD-Net paper.

Hierarchical Aggregation for 3D Instance Segmentation (ICCV 2021)

[SIGGRAPH Asia 2021] Pose with Style: Detail-Preserving Pose-Guided Image Synthesis with Conditional StyleGAN

Simple renderer for use with MuJoCo (>=2.1.2) Python Bindings.

[ICML 2021, Long Talk] Delving into Deep Imbalanced Regression

Codes for CIKM'21 paper 'Self-Supervised Graph Co-Training for Session-based Recommendation'.