PyTorch implementation of the Crafting Better Contrastive Views for Siamese Representation Learning

Last update: Dec 28, 2022

Related tags

Overview

Crafting Better Contrastive Views for Siamese Representation Learning

This is the official PyTorch implementation of the ContrastiveCrop paper:

@article{peng2022crafting,
  title={Crafting Better Contrastive Views for Siamese Representation Learning},
  author={Peng, Xiangyu and Wang, Kai and Zhu, Zheng and You, Yang},
  journal={arXiv preprint arXiv:2202.03278},
  year={2022}
}

This repo includes PyTorch implementation of SimCLR, MoCo, BYOL and SimSiam, as well as their DDP training code.

Preparation

Create a python enviroment with pytorch >= 1.8.1.
pip install -r requirements.txt
Modify dataset root in the config file.

Pre-train

# MoCo, CIFAR-10
python DDP_moco_ccrop.py configs/small/cifar10/moco_alpha0.1_th0.1.py

# SimSiam, CIFAR-100
python DDP_simsiam_ccrop.py configs/small/cifar100/simsiam_alpha0.1_th0.1.py

Linear Evaluation

# CIFAR-10
python DDP_linear.py configs/linear/cifar10_res18.py --load ./checkpoints/small/cifar10/moco_alpha0.1_th0.1/last.pth

# CIFAR-100
python DDP_linear.py configs/linear/cifar100_res18.py --load ./checkpoints/small/cifar100/simsiam_alpha0.1_th0.1/last.pth

More models and datasets coming soon.

PyTorch implementation of the Crafting Better Contrastive Views for Siamese Representation Learning

Related tags

Overview

Crafting Better Contrastive Views for Siamese Representation Learning

Preparation

Pre-train

Linear Evaluation

Owner

Benchmark spaces - Benchmarks of how well different two dimensional spaces work for clustering algorithms

Learning from Guided Play: A Scheduled Hierarchical Approach for Improving Exploration in Adversarial Imitation Learning Source Code

An executor that performs image segmentation on fashion items

Towards Multi-Camera 3D Human Pose Estimation in Wild Environment

A tf.keras implementation of Facebook AI's MadGrad optimization algorithm

Fast and Context-Aware Framework for Space-Time Video Super-Resolution (VCIP 2021)

NOD: Taking a Closer Look at Detection under Extreme Low-Light Conditions with Night Object Detection Dataset

Liquid Warping GAN with Attention: A Unified Framework for Human Image Synthesis

Source code related to the article submitted to the International Conference on Computational Science ICCS 2022 in London

Code for our NeurIPS 2021 paper 'Exploiting the Intrinsic Neighborhood Structure for Source-free Domain Adaptation'

Stratified Transformer for 3D Point Cloud Segmentation (CVPR 2022)

A Kaggle competition: discriminate gender based on handwriting

Metric learning algorithms in Python

Learning Pixel-level Semantic Affinity with Image-level Supervision for Weakly Supervised Semantic Segmentation, CVPR 2018

Real-time analysis of intracranial neurophysiology recordings.

ZeroGen: Efficient Zero-shot Learning via Dataset Generation

Software & Hardware to do multi color printing with Sharpies

Transformers based fully on MLPs

Measuring Coding Challenge Competence With APPS

Framework for training options with different attention mechanism and using them to solve downstream tasks.