PyTorch implementation of the Crafting Better Contrastive Views for Siamese Representation Learning

Last update: Dec 28, 2022

Related tags

Overview

Crafting Better Contrastive Views for Siamese Representation Learning

This is the official PyTorch implementation of the ContrastiveCrop paper:

@article{peng2022crafting,
  title={Crafting Better Contrastive Views for Siamese Representation Learning},
  author={Peng, Xiangyu and Wang, Kai and Zhu, Zheng and You, Yang},
  journal={arXiv preprint arXiv:2202.03278},
  year={2022}
}

This repo includes PyTorch implementation of SimCLR, MoCo, BYOL and SimSiam, as well as their DDP training code.

Preparation

Create a python enviroment with pytorch >= 1.8.1.
pip install -r requirements.txt
Modify dataset root in the config file.

Pre-train

# MoCo, CIFAR-10
python DDP_moco_ccrop.py configs/small/cifar10/moco_alpha0.1_th0.1.py

# SimSiam, CIFAR-100
python DDP_simsiam_ccrop.py configs/small/cifar100/simsiam_alpha0.1_th0.1.py

Linear Evaluation

# CIFAR-10
python DDP_linear.py configs/linear/cifar10_res18.py --load ./checkpoints/small/cifar10/moco_alpha0.1_th0.1/last.pth

# CIFAR-100
python DDP_linear.py configs/linear/cifar100_res18.py --load ./checkpoints/small/cifar100/simsiam_alpha0.1_th0.1/last.pth

More models and datasets coming soon.

PyTorch implementation of the Crafting Better Contrastive Views for Siamese Representation Learning

Related tags

Overview

Crafting Better Contrastive Views for Siamese Representation Learning

Preparation

Pre-train

Linear Evaluation

Owner

Learning Facial Representations from the Cycle-consistency of Face (ICCV 2021)

[NeurIPS 2021] “Improving Contrastive Learning on Imbalanced Data via Open-World Sampling”,

Pytorch implementation of the paper SPICE: Semantic Pseudo-labeling for Image Clustering

PArallel Distributed Deep LEarning: Machine Learning Framework from Industrial Practice （『飞桨』核心框架，深度学习&机器学习高性能单机、分布式训练和跨平台部署）

Official implement of Paper：A deeply supervised image fusion network for change detection in high resolution bi-temporal remote sening images

PyDeepFakeDet is an integrated and scalable tool for Deepfake detection.

ESP32 python application to read data from a Tilt™ Hydrometer for homebrewing

CURL: Contrastive Unsupervised Representations for Reinforcement Learning

A curated list of awesome game datasets, and tools to artificial intelligence in games

[CVPR 2021] Exemplar-Based Open-Set Panoptic Segmentation Network (EOPSN)

GANsformer: Generative Adversarial Transformers Drew A

Empirical Study of Transformers for Source Code & A Simple Approach for Handling Out-of-Vocabulary Identifiers in Deep Learning for Source Code

Distributed Deep learning with Keras & Spark

68 keypoint annotations for COFW test data

Lucid library adapted for PyTorch

Uncertainty-aware Semantic Segmentation of LiDAR Point Clouds for Autonomous Driving

Pytorch implementation of the paper: "SAPNet: Segmentation-Aware Progressive Network for Perceptual Contrastive Image Deraining"

SimDeblur is a simple framework for image and video deblurring, implemented by PyTorch

VD-BERT: A Unified Vision and Dialog Transformer with BERT

Multivariate Boosted TRee