PyTorch implementation of the Crafting Better Contrastive Views for Siamese Representation Learning

Last update: Dec 28, 2022

Related tags

Overview

Crafting Better Contrastive Views for Siamese Representation Learning

This is the official PyTorch implementation of the ContrastiveCrop paper:

@article{peng2022crafting,
  title={Crafting Better Contrastive Views for Siamese Representation Learning},
  author={Peng, Xiangyu and Wang, Kai and Zhu, Zheng and You, Yang},
  journal={arXiv preprint arXiv:2202.03278},
  year={2022}
}

This repo includes PyTorch implementation of SimCLR, MoCo, BYOL and SimSiam, as well as their DDP training code.

Preparation

Create a python enviroment with pytorch >= 1.8.1.
pip install -r requirements.txt
Modify dataset root in the config file.

Pre-train

# MoCo, CIFAR-10
python DDP_moco_ccrop.py configs/small/cifar10/moco_alpha0.1_th0.1.py

# SimSiam, CIFAR-100
python DDP_simsiam_ccrop.py configs/small/cifar100/simsiam_alpha0.1_th0.1.py

Linear Evaluation

# CIFAR-10
python DDP_linear.py configs/linear/cifar10_res18.py --load ./checkpoints/small/cifar10/moco_alpha0.1_th0.1/last.pth

# CIFAR-100
python DDP_linear.py configs/linear/cifar100_res18.py --load ./checkpoints/small/cifar100/simsiam_alpha0.1_th0.1/last.pth

More models and datasets coming soon.

PyTorch implementation of the Crafting Better Contrastive Views for Siamese Representation Learning

Related tags

Overview

Crafting Better Contrastive Views for Siamese Representation Learning

Preparation

Pre-train

Linear Evaluation

Owner

Hyper-parameter optimization for sklearn

Edge-oriented Convolution Block for Real-time Super Resolution on Mobile Devices, ACM Multimedia 2021

CVPR2022 (Oral) - Rethinking Semantic Segmentation: A Prototype View

NICE-GAN — Official PyTorch Implementation Reusing Discriminators for Encoding: Towards Unsupervised Image-to-Image Translation

Code base for "On-the-Fly Test-time Adaptation for Medical Image Segmentation"

Shape-Adaptive Selection and Measurement for Oriented Object Detection

JORLDY an open-source Reinforcement Learning (RL) framework provided by KakaoEnterprise

Official Repo of my work for SREC Nandyal Machine Learning Bootcamp

This is the repository for CVPR2021 Dynamic Metric Learning: Towards a Scalable Metric Space to Accommodate Multiple Semantic Scales

Reference implementation of code generation projects from Facebook AI Research. General toolkit to apply machine learning to code, from dataset creation to model training and evaluation. Comes with pretrained models.

deep_image_prior_extension

TaCL: Improving BERT Pre-training with Token-aware Contrastive Learning

https://arxiv.org/abs/2102.11005

The official codes of "Semi-supervised Models are Strong Unsupervised Domain Adaptation Learners".

Code for our ALiBi method for transformer language models.

Manipulation OpenAI Gym environments to simulate robots at the STARS lab

A Collection of Papers and Codes for ICCV2021 Low Level Vision and Image Generation

Telegram chatbot created with deep learning model (LSTM) and telebot library.

.NET bindings for the Pytorch engine

Generating synthetic mobility data for a realistic population with RNNs to improve utility and privacy