This repository contains PyTorch code for Robust Vision Transformers.

Last update: Dec 07, 2022

Related tags

Overview

RVT: Robust Vision Transformers

This repository contains PyTorch code for Robust Vision Transformers.

For details see Rethinking the Design Principles of Robust Vision Transformer by Xiaofeng Mao, Gege Qi, Yuefeng Chen, Yuan He and Hui Xue.

Usage

First, clone the repository locally:

git clone https://github.com/vtddggg/Robust-Vision-Transformer.git

Then, install PyTorch 1.7.0+ and torchvision 0.8.1+ and pytorch-image-models 0.3.2:

conda install -c pytorch pytorch torchvision
pip install timm==0.3.2

We use 4 nodes with 8 gpus to train RVT-Ti, RVT-S and RVT-B:

Training RVT-Ti

python -m torch.distributed.launch --nproc_per_node=8 --nnodes=4 main.py --model rvt_tiny --data-path /path/to/imagenet --output_dir output --dist-eval

Training RVT-S

python -m torch.distributed.launch --nproc_per_node=8 --nnodes=4 main.py --model rvt_small --data-path /path/to/imagenet --output_dir output --dist-eval

Training RVT-B

python -m torch.distributed.launch --nproc_per_node=8 --nnodes=4 main.py --model rvt_base --data-path /path/to/imagenet --output_dir output --batch-size 32 --dist-eval

If you want to train RVT-Ti*, RVT-S* or RVT-B*, simply add --use_mask and --use_patch_aug to enable positon-aware attention scaling and patch-wise augmentation.

This repository contains PyTorch code for Robust Vision Transformers.

Related tags

Overview

RVT: Robust Vision Transformers

Usage

Training RVT-Ti

Training RVT-S

Training RVT-B

Owner

Contrastive unpaired image-to-image translation, faster and lighter training than cyclegan (ECCV 2020, in PyTorch)

Few-shot NLP benchmark for unified, rigorous eval

Bayes-Newton—A Gaussian process library in JAX, with a unifying view of approximate Bayesian inference as variants of Newton's algorithm.

Unofficial implementation of the Involution operation from CVPR 2021

Codebase for the self-supervised goal reaching benchmark introduced in the LEXA paper

ivadomed is an integrated framework for medical image analysis with deep learning.

2021搜狐校园文本匹配算法大赛分比我们低的都是帅哥队

Additional environments compatible with OpenAI gym

PointCloud Annotation Tools, support to label object bound box, ground, lane and kerb

Depression Asisstant GDSC Challenge Solution

[CVPR2022] Bridge-Prompt: Towards Ordinal Action Understanding in Instructional Videos

Automatic tool focused on deriving metallicities of open clusters

This is the repository for Learning to Generate Piano Music With Sustain Pedals

Deploy tensorflow graphs for fast evaluation and export to tensorflow-less environments running numpy.

BasicNeuralNetwork - This project looks over the basic structure of a neural network and how machine learning training algorithms work

This is the research repository for Vid2Doppler: Synthesizing Doppler Radar Data from Videos for Training Privacy-Preserving Activity Recognition.

A learning-based data collection tool for human segmentation

Data and analysis code for an MS on SK VOC genomes phenotyping/neutralisation assays

A framework for attentive explainable deep learning on tabular data

This is the code repository for the paper A hierarchical semantic segmentation framework for computer-vision-based bridge column damage detection

This repository contains PyTorch code for Robust Vision Transformers.

Related tags

Overview

RVT: Robust Vision Transformers

Usage

Training RVT-Ti

Training RVT-S

Training RVT-B

Owner

Contrastive unpaired image-to-image translation, faster and lighter training than cyclegan (ECCV 2020, in PyTorch)

Few-shot NLP benchmark for unified, rigorous eval

Bayes-Newton—A Gaussian process library in JAX, with a unifying view of approximate Bayesian inference as variants of Newton's algorithm.

Unofficial implementation of the Involution operation from CVPR 2021

Codebase for the self-supervised goal reaching benchmark introduced in the LEXA paper

ivadomed is an integrated framework for medical image analysis with deep learning.

2021搜狐校园文本匹配算法大赛 分比我们低的都是帅哥队

Additional environments compatible with OpenAI gym

PointCloud Annotation Tools, support to label object bound box, ground, lane and kerb

Depression Asisstant GDSC Challenge Solution

[CVPR2022] Bridge-Prompt: Towards Ordinal Action Understanding in Instructional Videos

Automatic tool focused on deriving metallicities of open clusters

This is the repository for Learning to Generate Piano Music With Sustain Pedals

Deploy tensorflow graphs for fast evaluation and export to tensorflow-less environments running numpy.

BasicNeuralNetwork - This project looks over the basic structure of a neural network and how machine learning training algorithms work

This is the research repository for Vid2Doppler: Synthesizing Doppler Radar Data from Videos for Training Privacy-Preserving Activity Recognition.

A learning-based data collection tool for human segmentation

Data and analysis code for an MS on SK VOC genomes phenotyping/neutralisation assays

A framework for attentive explainable deep learning on tabular data

This is the code repository for the paper A hierarchical semantic segmentation framework for computer-vision-based bridge column damage detection

2021搜狐校园文本匹配算法大赛分比我们低的都是帅哥队