FasterAI: A library to make smaller and faster models with FastAI.

Last update: Jan 01, 2023

Overview

Fasterai

fasterai is a library created to make neural network smaller and faster. It essentially relies on common compression techniques for networks such as pruning, knowledge distillation, ...

Project Documentation

Visit Read The Docs Project Page or read following README to know more about using Fasterai

Available Methods

1. Pruning

Make your model sparse (i.e. prune it) according to a:

Sparsity: the amount of weights that will be replaced by 0
Granularity: the granularity at which you operate the pruning (removing weights, vectors, kernels, filters)
Method: prune either each layer independantly (local pruning) or the whole model (global pruning)
Criteria: the criteria used to select the weights to remove (magnitude, movement, ...)
Schedule: which schedule you want to use for pruning (one shot, iterative, gradual, ...)

2. Knowledge Distillation

Distill the knowledge acquired by a big model into a smaller one.

3. Lottery Ticket Hypothesis

Find the winning ticket in you network, i.e. the initial subnetwork able to attain at least similar performances than the network as a whole.

Quick Start

1. Create your model with fastai

learn = cnn_learner(dls, model)

2. Get you Fasterai Callback

sp_cb=SparsifyCallback(end_sparsity, granularity, method, criteria, sched_func)

3. Train you model to make it sparse !

learn.fit_one_cycle(n_epochs, cbs=sp_cb)

More about other methods in the tutorials section

Installation

pip install git+https://github.com/nathanhubens/fasterai.git

pip install fasterai

Citing

@misc{Hubens:2020,
  Author = {Nathan Hubens},
  Title = {Fasterai},
  Year = {2020},
  Publisher = {GitHub},
  Journal = {GitHub repository},
  Howpublished = {\url{https://github.com/nathanhubens/fasterai}}
}

You might also like...

shufflev2-yolov5：lighter, faster and easier to deploy

shufflev2-yolov5: lighter, faster and easier to deploy. Evolved from yolov5 and the size of model is only 1.7M (int8) and 3.3M (fp16). It can reach 10+ FPS on the Raspberry Pi 4B when the input size is 320×320~

1.5k Jan 5, 2023

LF-YOLO (Lighter and Faster YOLO) is used to detect defect of X-ray weld image.

This project is based on ultralytics/yolov3. LF-YOLO (Lighter and Faster YOLO) is used to detect defect of X-ray weld image. Download $ git clone http

26 Dec 13, 2022

A Python package for faster, safer, and simpler ML processes

Bender 🤖 A Python package for faster, safer, and simpler ML processes. Why use bender? Bender will make your machine learning processes, faster, safe

6 Dec 13, 2022

Much faster than SORT(Simple Online and Realtime Tracking), a little worse than SORT

QSORT QSORT(Quick + Simple Online and Realtime Tracking) is a simple online and realtime tracking algorithm for 2D multiple object tracking in video s

8 Jul 27, 2022

This project is based on RIFE and aims to make RIFE more practical for users by adding various features and design new models

This project is based on RIFE and aims to make RIFE more practical for users by adding various features and design new models. Because improving the PSNR index is not compatible with subjective effects, we hope this part of work and our academic research are independent of each other.

190 Jan 8, 2023

LeViT a Vision Transformer in ConvNet's Clothing for Faster Inference

FasterAI: A library to make smaller and faster models with FastAI.

Related tags

Overview

Fasterai

Project Documentation

Available Methods

1. Pruning

2. Knowledge Distillation

3. Lottery Ticket Hypothesis

Quick Start

1. Create your model with fastai

2. Get you Fasterai Callback

3. Train you model to make it sparse !

Installation

Citing

You might also like...

shufflev2-yolov5：lighter, faster and easier to deploy

LF-YOLO (Lighter and Faster YOLO) is used to detect defect of X-ray weld image.

A Python package for faster, safer, and simpler ML processes

Much faster than SORT(Simple Online and Realtime Tracking), a little worse than SORT

This project is based on RIFE and aims to make RIFE more practical for users by adding various features and design new models

LeViT a Vision Transformer in ConvNet's Clothing for Faster Inference

Code to run experiments in SLOE: A Faster Method for Statistical Inference in High-Dimensional Logistic Regression.

PyTorch implementation of the Quasi-Recurrent Neural Network - up to 16 times faster than NVIDIA's cuDNN LSTM

A pytorch implementation of faster RCNN detection framework (Use detectron2, it's a masterpiece)

Releases(v0.1.9)

v0.1.9(Jul 4, 2022)

v0.1.8(May 29, 2022)

v0.1.6(Apr 19, 2022)

Owner

Nathan Hubens

The code release of paper 'Domain Generalization for Medical Imaging Classification with Linear-Dependency Regularization' NIPS 2020.

DeOldify - A Deep Learning based project for colorizing and restoring old images (and video!)

git《Investigating Loss Functions for Extreme Super-Resolution》(CVPR 2020) GitHub:

Old Photo Restoration (Official PyTorch Implementation)

Training Structured Neural Networks Through Manifold Identification and Variance Reduction

Image super-resolution through deep learning

Pixel Consensus Voting for Panoptic Segmentation (CVPR 2020)

PyElastica is the Python implementation of Elastica, an open-source software for the simulation of assemblies of slender, one-dimensional structures using Cosserat Rod theory.

Code base of object detection

A Pytorch implementation of MoveNet from Google. Include training code and pre-train model.

The Rich Get Richer: Disparate Impact of Semi-Supervised Learning

MonoRec: Semi-Supervised Dense Reconstruction in Dynamic Environments from a Single Moving Camera

AdaFocus (ICCV 2021) Adaptive Focus for Efficient Video Recognition

[ICCV'21] NEAT: Neural Attention Fields for End-to-End Autonomous Driving

[ICCV2021] Learning to Track Objects from Unlabeled Videos

Arquitetura e Desenho de Software.

Robust & Reliable Route Recommendation on Road Networks

CAUSE: Causality from AttribUtions on Sequence of Events

Feup-csr - Repository holding my group's submission to the CSR project competition

SegNet-Basic with Keras