FasterAI: A library to make smaller and faster models with FastAI.

Last update: Jan 01, 2023

Overview

Fasterai

fasterai is a library created to make neural network smaller and faster. It essentially relies on common compression techniques for networks such as pruning, knowledge distillation, ...

Project Documentation

Visit Read The Docs Project Page or read following README to know more about using Fasterai

Available Methods

1. Pruning

Make your model sparse (i.e. prune it) according to a:

Sparsity: the amount of weights that will be replaced by 0
Granularity: the granularity at which you operate the pruning (removing weights, vectors, kernels, filters)
Method: prune either each layer independantly (local pruning) or the whole model (global pruning)
Criteria: the criteria used to select the weights to remove (magnitude, movement, ...)
Schedule: which schedule you want to use for pruning (one shot, iterative, gradual, ...)

2. Knowledge Distillation

Distill the knowledge acquired by a big model into a smaller one.

3. Lottery Ticket Hypothesis

Find the winning ticket in you network, i.e. the initial subnetwork able to attain at least similar performances than the network as a whole.

Quick Start

1. Create your model with fastai

learn = cnn_learner(dls, model)

2. Get you Fasterai Callback

sp_cb=SparsifyCallback(end_sparsity, granularity, method, criteria, sched_func)

3. Train you model to make it sparse !

learn.fit_one_cycle(n_epochs, cbs=sp_cb)

More about other methods in the tutorials section

Installation

pip install git+https://github.com/nathanhubens/fasterai.git

pip install fasterai

Citing

@misc{Hubens:2020,
  Author = {Nathan Hubens},
  Title = {Fasterai},
  Year = {2020},
  Publisher = {GitHub},
  Journal = {GitHub repository},
  Howpublished = {\url{https://github.com/nathanhubens/fasterai}}
}

You might also like...

shufflev2-yolov5：lighter, faster and easier to deploy

shufflev2-yolov5: lighter, faster and easier to deploy. Evolved from yolov5 and the size of model is only 1.7M (int8) and 3.3M (fp16). It can reach 10+ FPS on the Raspberry Pi 4B when the input size is 320×320~

1.5k Jan 5, 2023

LF-YOLO (Lighter and Faster YOLO) is used to detect defect of X-ray weld image.

This project is based on ultralytics/yolov3. LF-YOLO (Lighter and Faster YOLO) is used to detect defect of X-ray weld image. Download $ git clone http

26 Dec 13, 2022

A Python package for faster, safer, and simpler ML processes

Bender 🤖 A Python package for faster, safer, and simpler ML processes. Why use bender? Bender will make your machine learning processes, faster, safe

6 Dec 13, 2022

Much faster than SORT(Simple Online and Realtime Tracking), a little worse than SORT

QSORT QSORT(Quick + Simple Online and Realtime Tracking) is a simple online and realtime tracking algorithm for 2D multiple object tracking in video s

8 Jul 27, 2022

This project is based on RIFE and aims to make RIFE more practical for users by adding various features and design new models

This project is based on RIFE and aims to make RIFE more practical for users by adding various features and design new models. Because improving the PSNR index is not compatible with subjective effects, we hope this part of work and our academic research are independent of each other.

190 Jan 8, 2023

LeViT a Vision Transformer in ConvNet's Clothing for Faster Inference

FasterAI: A library to make smaller and faster models with FastAI.

Related tags

Overview

Fasterai

Project Documentation

Available Methods

1. Pruning

2. Knowledge Distillation

3. Lottery Ticket Hypothesis

Quick Start

1. Create your model with fastai

2. Get you Fasterai Callback

3. Train you model to make it sparse !

Installation

Citing

You might also like...

shufflev2-yolov5：lighter, faster and easier to deploy

LF-YOLO (Lighter and Faster YOLO) is used to detect defect of X-ray weld image.

A Python package for faster, safer, and simpler ML processes

Much faster than SORT(Simple Online and Realtime Tracking), a little worse than SORT

This project is based on RIFE and aims to make RIFE more practical for users by adding various features and design new models

LeViT a Vision Transformer in ConvNet's Clothing for Faster Inference

Code to run experiments in SLOE: A Faster Method for Statistical Inference in High-Dimensional Logistic Regression.

PyTorch implementation of the Quasi-Recurrent Neural Network - up to 16 times faster than NVIDIA's cuDNN LSTM

A pytorch implementation of faster RCNN detection framework (Use detectron2, it's a masterpiece)

Releases(v0.1.9)

v0.1.9(Jul 4, 2022)

v0.1.8(May 29, 2022)

v0.1.6(Apr 19, 2022)

Owner

Nathan Hubens

atmaCup #11 の Public 4th / Pricvate 5th Solution のリポジトリです。

A framework that constructs deep neural networks, autoencoders, logistic regressors, and linear networks

A PyTorch implementation of Implicit Q-Learning

Project NII pytorch scripts

Linear Variational State Space Filters

PyTorch implementation of Super SloMo by Jiang et al.

Object Detection and Multi-Object Tracking

Self Driving RC Car Code

Home for cuQuantum Python & NVIDIA cuQuantum SDK C++ samples

This package proposes simplified exporting pytorch models to ONNX and TensorRT, and also gives some base interface for model inference.

Implementation of the paper Scalable Intervention Target Estimation in Linear Models (NeurIPS 2021), and the code to generate simulation results.

Image to Image translation, image generataton, few shot learning

Code for CVPR2021 "Visualizing Adapted Knowledge in Domain Transfer". Visualization for domain adaptation. #explainable-ai

Use your Philips Hue lights as Racing Flags. Works with Assetto Corsa, Assetto Corsa Competizione and iRacing.

MultiMix: Sparingly Supervised, Extreme Multitask Learning From Medical Images (ISBI 2021, MELBA 2021)

Collapse by Conditioning: Training Class-conditional GANs with Limited Data

Unified Pre-training for Self-Supervised Learning and Supervised Learning for ASR

Definition of a business problem according to Wilson Lower Bound Score and Time Based Average Rating

Official implementation of our paper "Learning to Bootstrap for Combating Label Noise"

MatryODShka: Real-time 6DoF Video View Synthesis using Multi-Sphere Images