QAT(quantize aware training) for classification with MQBench

Last update: Nov 18, 2022

Overview

MQBench Quantization Aware Training with PyTorch

I am using MQBench(Model Quantization Benchmark)(http://mqbench.tech/) to quantize the model for deployment.

MQBench is a benchmark and framework for evluating the quantization algorithms under real world hardware deployments.

Prerequisites

Python 3.7+
PyTorch 1.8.1+

Install MQBench Lib

Before run this repository, you should install MQBench:

git clone https://github.com/ModelTC/MQBench.git
cd MQBench
python setup.py build
python setup.py install

Training Fp32 Model

# Start training fp32 model with: 
# model_name can be ResNet18, MobileNet, ...
python main.py model_name

# You can manually config the training with: 
python main.py --resume --lr=0.01

Training Quantize Model

# Start training quantize model with: 
# model_name can be ResNet18, MobileNet, ...
python main.py model_name --quantize

# You can manually config the training with: 
python main.py --resume --parallel DP --BackendType Tensorrt --quantize
python -m torch.distributed.launch main.py --local_rank 0 --parallel DDP --resume  --BackendType Tensorrt --quantize

Fp32 Accuracy

Model	Acc.
VGG16	92.64%
ResNet18	93.02%
ResNet50	93.62%
ResNet101	93.75%
RegNetX_200MF	94.24%
RegNetY_400MF	94.29%
MobileNetV2	94.43%
ResNeXt29(32x4d)	94.73%
ResNeXt29(2x64d)	94.82%
SimpleDLA	94.89%
DenseNet121	95.04%
PreActResNet18	95.11%
DPN92	95.16%
DLA	95.47%

QAT(quantize aware training) for classification with MQBench

Related tags

Overview

MQBench Quantization Aware Training with PyTorch

Prerequisites

Install MQBench Lib

Training Fp32 Model

Training Quantize Model

Fp32 Accuracy

Owner

Ling Zhang

[Preprint] ConvMLP: Hierarchical Convolutional MLPs for Vision, 2021

Blender Add-On for slicing meshes with planes

Mixed Transformer UNet for Medical Image Segmentation

Dynamic Graph Event Detection

Semi-Supervised Learning with Ladder Networks in Keras. Get 98% test accuracy on MNIST with just 100 labeled examples !

[CVPRW 21] "BNN - BN = ? Training Binary Neural Networks without Batch Normalization", Tianlong Chen, Zhenyu Zhang, Xu Ouyang, Zechun Liu, Zhiqiang Shen, Zhangyang Wang

Code for CoMatch: Semi-supervised Learning with Contrastive Graph Regularization

Official implementation for paper Render In-between: Motion Guided Video Synthesis for Action Interpolation

Official implementation for paper: A Latent Transformer for Disentangled Face Editing in Images and Videos.

True per-item rarity for Loot

Code for the paper "Balancing Training for Multilingual Neural Machine Translation, ACL 2020"

QuickAI is a Python library that makes it extremely easy to experiment with state-of-the-art Machine Learning models.

A highly efficient and modular implementation of Gaussian Processes in PyTorch

Joint-task Self-supervised Learning for Temporal Correspondence (NeurIPS 2019)

Create Own QR code with Python

Unsupervised Real-World Super-Resolution: A Domain Adaptation Perspective

K-Means Clustering and Hierarchical Clustering Unsupervised Learning Solution in Python3.

Implementation of Hierarchical Transformer Memory (HTM) for Pytorch

This application explain how we can easily integrate Deepface framework with Python Django application

Learning Super-Features for Image Retrieval