PyTorch implementation of the Crafting Better Contrastive Views for Siamese Representation Learning

Last update: Dec 28, 2022

Related tags

Overview

Crafting Better Contrastive Views for Siamese Representation Learning

This is the official PyTorch implementation of the ContrastiveCrop paper:

@article{peng2022crafting,
  title={Crafting Better Contrastive Views for Siamese Representation Learning},
  author={Peng, Xiangyu and Wang, Kai and Zhu, Zheng and You, Yang},
  journal={arXiv preprint arXiv:2202.03278},
  year={2022}
}

This repo includes PyTorch implementation of SimCLR, MoCo, BYOL and SimSiam, as well as their DDP training code.

Preparation

Create a python enviroment with pytorch >= 1.8.1.
pip install -r requirements.txt
Modify dataset root in the config file.

Pre-train

# MoCo, CIFAR-10
python DDP_moco_ccrop.py configs/small/cifar10/moco_alpha0.1_th0.1.py

# SimSiam, CIFAR-100
python DDP_simsiam_ccrop.py configs/small/cifar100/simsiam_alpha0.1_th0.1.py

Linear Evaluation

# CIFAR-10
python DDP_linear.py configs/linear/cifar10_res18.py --load ./checkpoints/small/cifar10/moco_alpha0.1_th0.1/last.pth

# CIFAR-100
python DDP_linear.py configs/linear/cifar100_res18.py --load ./checkpoints/small/cifar100/simsiam_alpha0.1_th0.1/last.pth

More models and datasets coming soon.

PyTorch implementation of the Crafting Better Contrastive Views for Siamese Representation Learning

Related tags

Overview

Crafting Better Contrastive Views for Siamese Representation Learning

Preparation

Pre-train

Linear Evaluation

Owner

Dataset para entrenamiento de yoloV3 para 4 clases

Understanding and Overcoming the Challenges of Efficient Transformer Quantization

Styled text-to-drawing synthesis method. Featured at the 2021 NeurIPS Workshop on Machine Learning for Creativity and Design

Putting NeRF on a Diet: Semantically Consistent Few-Shot View Synthesis Implementation

for a paper about leveraging discourse markers for training new models

[CVPR 2022 Oral] Balanced MSE for Imbalanced Visual Regression https://arxiv.org/abs/2203.16427

Rlmm blender toolkit - A set of tools to streamline level generation in UDK straight from Blender

This repository holds the code for the paper "Deep Conditional Gaussian Mixture Model forConstrained Clustering".

To propose and implement a multi-class classification approach to disaster assessment from the given data set of post-earthquake satellite imagery.

PyTorch implementation of "A Full-Band and Sub-Band Fusion Model for Real-Time Single-Channel Speech Enhancement."

Plaything for Autistic Children (demo for PaddlePaddle/Wechaty/Mixlab project)

PyTorch Implementations for DeeplabV3 and PSPNet

I decide to sync up this repo and self-critical.pytorch. (The old master is in old master branch for archive)

Implementation of Graph Convolutional Networks in TensorFlow

An Efficient Training Approach for Very Large Scale Face Recognition or F²C for simplicity.

This is an official implementation for the WTW Dataset in "Parsing Table Structures in the Wild " on table detection and table structure recognition.

MANO hand model porting for the GraspIt simulator

Pytorch library for end-to-end transformer models training and serving

Package for extracting emotions from social media text. Tailored for financial data.

ChebLieNet, a spectral graph neural network turned equivariant by Riemannian geometry on Lie groups.