QAT(quantize aware training) for classification with MQBench

Last update: Nov 18, 2022

Overview

MQBench Quantization Aware Training with PyTorch

I am using MQBench(Model Quantization Benchmark)(http://mqbench.tech/) to quantize the model for deployment.

MQBench is a benchmark and framework for evluating the quantization algorithms under real world hardware deployments.

Prerequisites

Python 3.7+
PyTorch 1.8.1+

Install MQBench Lib

Before run this repository, you should install MQBench:

git clone https://github.com/ModelTC/MQBench.git
cd MQBench
python setup.py build
python setup.py install

Training Fp32 Model

# Start training fp32 model with: 
# model_name can be ResNet18, MobileNet, ...
python main.py model_name

# You can manually config the training with: 
python main.py --resume --lr=0.01

Training Quantize Model

# Start training quantize model with: 
# model_name can be ResNet18, MobileNet, ...
python main.py model_name --quantize

# You can manually config the training with: 
python main.py --resume --parallel DP --BackendType Tensorrt --quantize
python -m torch.distributed.launch main.py --local_rank 0 --parallel DDP --resume  --BackendType Tensorrt --quantize

Fp32 Accuracy

Model	Acc.
VGG16	92.64%
ResNet18	93.02%
ResNet50	93.62%
ResNet101	93.75%
RegNetX_200MF	94.24%
RegNetY_400MF	94.29%
MobileNetV2	94.43%
ResNeXt29(32x4d)	94.73%
ResNeXt29(2x64d)	94.82%
SimpleDLA	94.89%
DenseNet121	95.04%
PreActResNet18	95.11%
DPN92	95.16%
DLA	95.47%

QAT(quantize aware training) for classification with MQBench

Related tags

Overview

MQBench Quantization Aware Training with PyTorch

Prerequisites

Install MQBench Lib

Training Fp32 Model

Training Quantize Model

Fp32 Accuracy

Owner

Ling Zhang

A Python package for faster, safer, and simpler ML processes

An experiment to bait a generalized frontrunning MEV bot

RoMA: Robust Model Adaptation for Offline Model-based Optimization

A Python Reconnection Tool for alt:V

Putting NeRF on a Diet: Semantically Consistent Few-Shot View Synthesis Implementation

An implementation of an abstract algebra for music tones (pitches).

The devkit of the nuPlan dataset.

Object Detection and Multi-Object Tracking

An index of recommendation algorithms that are based on Graph Neural Networks.

Efficient Training of Audio Transformers with Patchout

The official implementation of NeMo: Neural Mesh Models of Contrastive Features for Robust 3D Pose Estimation [ICLR-2021]. https://arxiv.org/pdf/2101.12378.pdf

Luminaire is a python package that provides ML driven solutions for monitoring time series data.

CCAFNet: Crossflow and Cross-scale Adaptive Fusion Network for Detecting Salient Objects in RGB-D Images

Compact Bilinear Pooling for PyTorch

PenguinSpeciesPredictionML - Basic model to predict Penguin species based on beak size and sex.

Realtime segmentation with ENet, the fast and accurate segmentation net.

PyTorch Implementation of Daft-Exprt: Robust Prosody Transfer Across Speakers for Expressive Speech Synthesis

Segmentation and Identification of Vertebrae in CT Scans using CNN, k-means Clustering and k-NN

VLGrammar: Grounded Grammar Induction of Vision and Language

Easy and comprehensive assessment of predictive power, with support for neuroimaging features