Official Code for AdvRush: Searching for Adversarially Robust Neural Architectures (ICCV '21)

Last update: Dec 10, 2022

Related tags

Overview

AdvRush

Official Code for AdvRush: Searching for Adversarially Robust Neural Architectures (ICCV '21)

Environmental Set-up

Python == 3.6.12, PyTorch == 1.2.0, torchvision == 0.4.0

AdvRush Search Process

cd advrush && python train_search.py --batch_size 32 --gpu 0 --epochs 60 --a_gamma 0.01 --a_warmup_epochs 0 --w_warmup_epochs 60 --loss_hessian loss_cure

Adversarial Training

cd advrush && python adv_train.py --batch_size 64 --gpu 0 --epochs 200 --adv_loss pgd --arch ADVRUSH

Evaluation under PGD Attack

Prior to the evaluation process, add all necessary checkpoint files (preferably in the form of .pth.tar) to the /eval/checkpoints folder. To conduct white-box attacks,

cd eval &&
python pgd_attack.py --white-box-attack True --test-batch-size 10 --arch [arch_name] --checkpoint [./checkpoints/file_name.pth.tar] --data_type [cifar10/svhn]

To conduct black-box attacks,

cd eval &&
python pgd_attack.py --test-batch-size 10 --target_arch [target_arch] --target_checkpoint [./checkpoints/target_file.pth.tar] --source_arch [source_arch] --source_checkpoint [./checkpoints/source_file.pth.tar] --data_type cifar10

References

DARTS: Differentiable Architecture Search [ICLR '19] code paper

Robustness via Curvature Regularization, and Vice Versa [CVPR '19] code paper

Tradeoff-inspired Adversarial Defense via Surrogate-loss Minimization [ICML '19] code paper

Official Code for AdvRush: Searching for Adversarially Robust Neural Architectures (ICCV '21)

Related tags

Overview

AdvRush

Environmental Set-up

AdvRush Search Process

Adversarial Training

Evaluation under PGD Attack

References

Owner

Additional code for Stable-baselines3 to load and upload models from the Hub.

A plug-and-play library for neural networks written in Python

[CVPR 2022] Deep Equilibrium Optical Flow Estimation

PenguinSpeciesPredictionML - Basic model to predict Penguin species based on beak size and sex.

A Kaggle competition: discriminate gender based on handwriting

Official implementation of "Articulation Aware Canonical Surface Mapping"

Interactive dimensionality reduction for large datasets

Collection of generative models, e.g. GAN, VAE in Pytorch and Tensorflow.

WRENCH: Weak supeRvision bENCHmark

Code for Contrastive-Geometry Networks for Generalized 3D Pose Transfer

Motion Planner Augmented Reinforcement Learning for Robot Manipulation in Obstructed Environments (CoRL 2020)

Code repository for the work "Multi-Domain Incremental Learning for Semantic Segmentation", accepted at WACV 2022

SwinTrack: A Simple and Strong Baseline for Transformer Tracking

Pytorch implementation for RelTransformer

Code for LIGA-Stereo Detector, ICCV'21

CLADE - Efficient Semantic Image Synthesis via Class-Adaptive Normalization (TPAMI 2021)

Leveraging OpenAI's Codex to solve cornerstone problems in Music

Implementation of Neural Distance Embeddings for Biological Sequences (NeuroSEED) in PyTorch

Continual reinforcement learning baselines: experiment specifications, implementation of existing methods, and common metrics. Easily extensible to new methods.

Food recognition model using convolutional neural network & computer vision