Self-Supervised Learning

Last update: Dec 14, 2021

Overview

Self-Supervised Learning

Features

self_supervised offers features like

modular framework
support for multi-gpu training using PyTorch Lightning
easy to use and written in a PyTorch like style
supports custom backbone models for self-supervised pre-training

Supported Models

Supported Loss Function

Benchmarks

Currently implemented models and their accuracy on cifar10 and imagenette.

ImageNette

Model	Epochs	Batch Size	Test Accuracy
MoCo	800	256	0.827
SimCLR	800	256	0.847
SimSiam	800	256	0.827
BarlowTwins	800	256	0.801
BYOL	800	256	0.851

Cifar10

Model	Epochs	Batch Size	Test Accuracy
MoCo	200	128	0.83
SimCLR	200	128	0.78
SimSiam	200	128	0.73
BarlowTwins	200	128	0.84
BYOL	200	128	0.85
MoCo	200	512	0.85
SimCLR	200	512	0.83
SimSiam	200	512	0.81
BarlowTwins	200	512	0.78
BYOL	200	512	0.84
MoCo	800	128	0.89
SimCLR	800	128	0.87
SimSiam	800	128	0.80
MoCo	800	512	0.90
SimCLR	800	512	0.89
SimSiam	800	512	0.91

Tutorials

Want to jump to the tutorials and see lightly in action?

Self-Supervised Learning

Related tags

Overview

Self-Supervised Learning

Features

Supported Models

Supported Loss Function

Benchmarks

ImageNette

Cifar10

Tutorials

Further Reading

Owner

Robin

Rethinking the U-Net architecture for multimodal biomedical image segmentation

Quantized models with python

Simulations for Turring patterns on an apically expanding domain. T

A clean and robust Pytorch implementation of PPO on continuous action space.

Code in conjunction with the publication 'Contrastive Representation Learning for Hand Shape Estimation'

Pywonderland - A tour in the wonderland of math with python.

A privacy-focused, intelligent security camera system.

Numenta Platform for Intelligent Computing is an implementation of Hierarchical Temporal Memory (HTM), a theory of intelligence based strictly on the neuroscience of the neocortex.

Official repository for "On Generating Transferable Targeted Perturbations" (ICCV 2021)

Leveraging Two Types of Global Graph for Sequential Fashion Recommendation, ICMR 2021

RRxIO - Robust Radar Visual/Thermal Inertial Odometry: Robust and accurate state estimation even in challenging visual conditions.

The official code repo of "HTS-AT: A Hierarchical Token-Semantic Audio Transformer for Sound Classification and Detection"

Food recognition model using convolutional neural network & computer vision

PyTorch implementation of Lip to Speech Synthesis with Visual Context Attentional GAN (NeurIPS2021)

Unified Pre-training for Self-Supervised Learning and Supervised Learning for ASR

The official implementation of the CVPR2021 paper: Decoupled Dynamic Filter Networks

Implementation of Transformer in Transformer, pixel level attention paired with patch level attention for image classification, in Pytorch

This repo is duplication of jwyang/faster-rcnn.pytorch

Data manipulation and transformation for audio signal processing, powered by PyTorch

Joint parameterization and fitting of stroke clusters