Self-Supervised Learning

Last update: Dec 14, 2021

Overview

Self-Supervised Learning

Features

self_supervised offers features like

modular framework
support for multi-gpu training using PyTorch Lightning
easy to use and written in a PyTorch like style
supports custom backbone models for self-supervised pre-training

Supported Models

Supported Loss Function

Benchmarks

Currently implemented models and their accuracy on cifar10 and imagenette.

ImageNette

Model	Epochs	Batch Size	Test Accuracy
MoCo	800	256	0.827
SimCLR	800	256	0.847
SimSiam	800	256	0.827
BarlowTwins	800	256	0.801
BYOL	800	256	0.851

Cifar10

Model	Epochs	Batch Size	Test Accuracy
MoCo	200	128	0.83
SimCLR	200	128	0.78
SimSiam	200	128	0.73
BarlowTwins	200	128	0.84
BYOL	200	128	0.85
MoCo	200	512	0.85
SimCLR	200	512	0.83
SimSiam	200	512	0.81
BarlowTwins	200	512	0.78
BYOL	200	512	0.84
MoCo	800	128	0.89
SimCLR	800	128	0.87
SimSiam	800	128	0.80
MoCo	800	512	0.90
SimCLR	800	512	0.89
SimSiam	800	512	0.91

Tutorials

Want to jump to the tutorials and see lightly in action?

Self-Supervised Learning

Related tags

Overview

Self-Supervised Learning

Features

Supported Models

Supported Loss Function

Benchmarks

ImageNette

Cifar10

Tutorials

Further Reading

Owner

Robin

SalGAN: Visual Saliency Prediction with Generative Adversarial Networks

Black box hyperparameter optimization made easy.

Toward Spatially Unbiased Generative Models (ICCV 2021)

GAN-generated image detection based on CNNs

Code release for DS-NeRF (Depth-supervised Neural Radiance Fields)

Implementation of Convolutional LSTM in PyTorch.

Code reproduce for paper "Vehicle Re-identification with Viewpoint-aware Metric Learning"

Finetune SSL models for MOS prediction

Shape-Adaptive Selection and Measurement for Oriented Object Detection

Google AI Open Images - Object Detection Track: Open Solution

学习 python3 以来写的一些垃圾玩具……

This program creates a formatted excel file which highlights the undervalued stock according to Graham's number.

Next-Best-View Estimation based on Deep Reinforcement Learning for Active Object Classification

MutualGuide is a compact object detector specially designed for embedded devices

A curated list of awesome papers for Semantic Retrieval (TOIS Accepted: Semantic Models for the First-stage Retrieval: A Comprehensive Review).

Solve a Rubiks Cube using Python Opencv and Kociemba module

A research toolkit for particle swarm optimization in Python

BT-Unet: A-Self-supervised-learning-framework-for-biomedical-image-segmentation-using-Barlow-Twins

A tool for making map images from OpenTTD save games

This repo tries to recognize faces in the dataset you created