PyTorch implementation of our Adam-NSCL algorithm from our CVPR2021 (oral) paper "Training Networks in Null Space for Continual Learning"

Last update: Dec 21, 2022

Overview

Adam-NSCL

This is a PyTorch implementation of Adam-NSCL algorithm for continual learning from our CVPR2021 (oral) paper:

Title: Training Networks in Null Space of Feature Covariance for Continual Learning

Authors: Shipeng Wang, Xiaorong Li, Jian Sun, Zongben Xu

Email: [email protected]; [email protected]

Arxiv: https://arxiv.org/pdf/2103.07113

Usage

sh scripts_svd/adamnscl.sh

Requirements: Python 3.7, PyTorch=1.5,tensorboardX

Citation

@InProceedings{Wang_2021_CVPR,
    author    = {Wang, Shipeng and Li, Xiaorong and Sun, Jian and Xu, Zongben},
    title     = {Training Networks in Null Space of Feature Covariance for Continual Learning},
    booktitle = {Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)},
    month     = {June},
    year      = {2021},
    pages     = {184-193}
}

Owner

Shipeng Wang

GitHub Repository

Official PyTorch implementation of the NeurIPS 2021 paper StyleGAN3

Alias-Free Generative Adversarial Networks (StyleGAN3) Official PyTorch implementation of the NeurIPS 2021 paper Alias-Free Generative Adversarial Net

92 Nov 18, 2022

Tensorflow implementation of ID-Unet: Iterative Soft and Hard Deformation for View Synthesis.

ID-Unet: Iterative-view-synthesis(CVPR2021 Oral) Tensorflow implementation of ID-Unet: Iterative Soft and Hard Deformation for View Synthesis. Overvie

17 Aug 23, 2022

TimeSHAP explains Recurrent Neural Network predictions.

TimeSHAP TimeSHAP is a model-agnostic, recurrent explainer that builds upon KernelSHAP and extends it to the sequential domain. TimeSHAP computes even

90 Dec 18, 2022

It is a simple library to speed up CLIP inference up to 3x (K80 GPU)

CLIP-ONNX It is a simple library to speed up CLIP inference up to 3x (K80 GPU) Usage Install clip-onnx module and requirements first. Use this trick !

93 Dec 20, 2022

A Tensorflow based library for Time Series Modelling with Gaussian Processes

Markovflow Documentation | Tutorials | API reference | Slack What does Markovflow do? Markovflow is a Python library for time-series analysis via prob

24 Dec 12, 2022

meProp: Sparsified Back Propagation for Accelerated Deep Learning

meProp The codes were used for the paper meProp: Sparsified Back Propagation for Accelerated Deep Learning with Reduced Overfitting (ICML 2017) [pdf]

107 Nov 18, 2022

Fluency ENhanced Sentence-bert Evaluation (FENSE), metric for audio caption evaluation. And Benchmark dataset AudioCaps-Eval, Clotho-Eval.

FENSE The metric, Fluency ENhanced Sentence-bert Evaluation (FENSE), for audio caption evaluation, proposed in the paper "Can Audio Captions Be Evalua

13 Dec 23, 2022

NATS-Bench: Benchmarking NAS Algorithms for Architecture Topology and Size

NATS-Bench: Benchmarking NAS Algorithms for Architecture Topology and Size Xuanyi Dong, Lu Liu, Katarzyna Musial, Bogdan Gabrys in IEEE Transactions o

137 Dec 20, 2022

Code for the paper "Graph Attention Tracking". (CVPR2021)

SiamGAT 1. Environment setup This code has been tested on Ubuntu 16.04, Python 3.5, Pytorch 1.2.0, CUDA 9.0. Please install related libraries before r

122 Dec 24, 2022

Weakly Supervised Segmentation with Tensorflow. Implements instance segmentation as described in Simple Does It: Weakly Supervised Instance and Semantic Segmentation, by Khoreva et al. (CVPR 2017).

Weakly Supervised Segmentation with TensorFlow This repo contains a TensorFlow implementation of weakly supervised instance segmentation as described

220 Dec 13, 2022

PyTorch implementation of our Adam-NSCL algorithm from our CVPR2021 (oral) paper "Training Networks in Null Space for Continual Learning"

Related tags

Overview

Adam-NSCL

Usage

Owner

Shipeng Wang

Official PyTorch implementation of the NeurIPS 2021 paper StyleGAN3

Tensorflow implementation of ID-Unet: Iterative Soft and Hard Deformation for View Synthesis.

TimeSHAP explains Recurrent Neural Network predictions.

It is a simple library to speed up CLIP inference up to 3x (K80 GPU)

A Tensorflow based library for Time Series Modelling with Gaussian Processes

meProp: Sparsified Back Propagation for Accelerated Deep Learning

Fluency ENhanced Sentence-bert Evaluation (FENSE), metric for audio caption evaluation. And Benchmark dataset AudioCaps-Eval, Clotho-Eval.

NATS-Bench: Benchmarking NAS Algorithms for Architecture Topology and Size

Code for the paper "Graph Attention Tracking". (CVPR2021)

Weakly Supervised Segmentation with Tensorflow. Implements instance segmentation as described in Simple Does It: Weakly Supervised Instance and Semantic Segmentation, by Khoreva et al. (CVPR 2017).

PyTorch implementation of saliency map-aided GAN for Auto-demosaic+denosing

A cross-lingual COVID-19 fake news dataset

Converting CPT to bert form for use

Discovering Interpretable GAN Controls [NeurIPS 2020]

When in Doubt: Improving Classification Performance with Alternating Normalization

Codebase to experiment with a hybrid Transformer that combines conditional sequence generation with regression

Adversarial Attacks on Probabilistic Autoregressive Forecasting Models.

This repository provides the official code for GeNER (an automated dataset Generation framework for NER).

Code for "Finding Regions of Heterogeneity in Decision-Making via Expected Conditional Covariance" at NeurIPS 2021

Python scripts form performing stereo depth estimation using the CoEx model in ONNX.