RVT: Robust Vision Transformers
This repository contains PyTorch code for Robust Vision Transformers.
For details see Rethinking the Design Principles of Robust Vision Transformer by Xiaofeng Mao, Gege Qi, Yuefeng Chen, Yuan He and Hui Xue.
Usage
First, clone the repository locally:
git clone https://github.com/vtddggg/Robust-Vision-Transformer.git
Then, install PyTorch 1.7.0+ and torchvision 0.8.1+ and pytorch-image-models 0.3.2:
conda install -c pytorch pytorch torchvision
pip install timm==0.3.2
We use 4 nodes with 8 gpus to train RVT-Ti, RVT-S and RVT-B:
Training RVT-Ti
python -m torch.distributed.launch --nproc_per_node=8 --nnodes=4 main.py --model rvt_tiny --data-path /path/to/imagenet --output_dir output --dist-eval
Training RVT-S
python -m torch.distributed.launch --nproc_per_node=8 --nnodes=4 main.py --model rvt_small --data-path /path/to/imagenet --output_dir output --dist-eval
Training RVT-B
python -m torch.distributed.launch --nproc_per_node=8 --nnodes=4 main.py --model rvt_base --data-path /path/to/imagenet --output_dir output --batch-size 32 --dist-eval
If you want to train RVT-Ti*, RVT-S* or RVT-B*, simply add --use_mask and --use_patch_aug to enable positon-aware attention scaling and patch-wise augmentation.
79 Dec 02, 2022
245 Dec 28, 2022
78 Dec 19, 2022
79 Dec 24, 2022
4 Aug 18, 2022
2.2k Jan 01, 2023
192 Jan 05, 2023
3 Nov 11, 2022
12 May 06, 2022
59 Dec 09, 2022
1 Jun 12, 2022
18 Sep 02, 2022
14 Sep 16, 2022
134 Dec 08, 2022
1 Jan 11, 2022
1 Nov 09, 2021
21 Nov 17, 2022
218 Dec 27, 2022
98 Dec 24, 2022
150 Dec 20, 2022