i-SpaSP: Structured Neural Pruning via Sparse Signal Recovery

This is a public code repository for the publication:

i-SpaSP: Structured Neural Pruning via Sparse Signal Recovery
Cameron R Wolfe, Anastasios Kyrillidis

Environment/Dependencies

Requires anaconda to be installed (python3) Anaconda can be installed at https://www.anaconda.com/products/individual

conda create -n ispasp python=3.6 anaconda
conda activate ispasp
conda install pytorch torchvision torchaudio cudatoolkit=11.3 -c pytorch
pip install -r requirements.txt

File Arrangement

Here we summarize all files present in this repo and their purpose.

+-- prune_resnet34_ispasp.py : i-SpaSP implementation for ResNet34
+-- prune_mobilenetv2_ispasp.py : i-SpaSP implementation for MobileNetV2
+-- lib/ : utility/helper functions
|   +-- data.py: helper functions for handling data
|   +-- utils.py: helper functions for computing performance metrics
+-- scripts/ : contains python scripts for running pruning experiments
|   +-- prune_rn34_ispasp.py: run an i-SpaSP pruning experiment for ResNet34  
|   +-- prune_mbnv2_ispasp.py: run an i-SpaSP pruning experiment for MobileNetV2
+-- requirements.txt : dependencies for pruning experiments

i-SpaSP: Structured Neural Pruning via Sparse Signal Recovery

Related tags

Overview

i-SpaSP: Structured Neural Pruning via Sparse Signal Recovery

Environment/Dependencies

File Arrangement

Owner

Cameron Ronald Wolfe

This is a repository with the code for the ACL 2019 paper

RITA is a family of autoregressive protein models, developed by LightOn in collaboration with the OATML group at Oxford and the Debora Marks Lab at Harvard.

Code accompanying our paper Feature Learning in Infinite-Width Neural Networks

Deep Two-View Structure-from-Motion Revisited

RTS3D: Real-time Stereo 3D Detection from 4D Feature-Consistency Embedding Space for Autonomous Driving

Alphabetical Letter Recognition

PyTorch implementation of Spiking Neural Networks trained on surrogate gradient & BPTT using snntorch.

🗣️ Microsoft Edge TTS for Home Assistant, no need for app_key

This repository contains a CBIR system that uses swin transformer to extract image's feature.

[AAAI 2022] Sparse Structure Learning via Graph Neural Networks for Inductive Document Classification

Toontown House CT Edition

FaRL for Facial Representation Learning

Created as part of CS50 AI's coursework. This AI makes use of knowledge entailment to calculate the best probabilities to win Minesweeper.

A task Provided by A respective Artenal Ai and Ml based Company to complete it

Starter kit for getting started in the Music Demixing Challenge.

Repository for RNNs using TensorFlow and Keras - LSTM and GRU Implementation from Scratch - Simple Classification and Regression Problem using RNNs

This repo contains the official implementations of EigenDamage: Structured Pruning in the Kronecker-Factored Eigenbasis

vit for few-shot classification

Official implementation of "OpenPifPaf: Composite Fields for Semantic Keypoint Detection and Spatio-Temporal Association" in PyTorch.

JAXDL: JAX (Flax) Deep Learning Library