A Machine Teaching Framework for Scalable Recognition

Last update: Dec 08, 2021

Related tags

Overview

MEMORABLE

This repository contains the source code accompanying our ICCV 2021 paper.

A Machine Teaching Framework for Scalable Recognition
Pei Wang, Nuno Vasconcelos.
In ICCV, 2021.

@InProceedings{wang2021gradient,
author = {Wang, Pei and Vasconcelos, Nuno},
title = {A Machine Teaching Framework for Scalable Recognition},
booktitle = {Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV)},
month = {October},
year = {2021}
}

Requirements

The project was implemented and tested in Python 3.5 and Pytorch 1.0. Other versions should work after minor modification.
NVIDIA GPU and cuDNN are required to have fast speeds. For now, CUDA 8.0 with cuDNN 6.0.20 has been tested. The other versions should be working.

Datasets

Butterflies and Chinese Characters, Gull are used. Please organize them as below after download,

datasets
|_ butterflies_crop
  |_ images
    |_ Viceroy
    |_ ...
|_ chinese_chars
  |_ images
    |_ grass
    |_ ...
|_ CUBgull
  |_ images
    |_ CaliforniaGull
    |_ ...

Implementation details

To generate counterfactual explanations

get_all_CE_butterflies.py
get_all_CE_gull.py

by SimCLR model

get_all_CE_butterflies_simclr.py
get_all_CE_gull_simclr.py

To generate teaching images and explanations

train_butterflies_CMaxGrad.py
train_gull_CMaxGrad.py

by SimCLR model

train_butterflies_CMaxGrad_simclr.py
train_gull_CMaxGrad_simclr.py

For the SimCLR, we used repo for training. Thanks for their open-source. For standard model, we trained by

train_butterflies_resnet18.py
train_gull_resnet18_linear.py

For questions, feel free to reach out

Pei Wang: [email protected]

A Machine Teaching Framework for Scalable Recognition

Related tags

Overview

MEMORABLE

Requirements

Datasets

Implementation details

To generate counterfactual explanations

To generate teaching images and explanations

Owner

A simple software for capturing human body movements using the Kinect camera.

Easy to use Python camera interface for NVIDIA Jetson

The official implementation of our CVPR 2021 paper - Hybrid Rotation Averaging: A Fast and Robust Rotation Averaging Approach

List some popular DeepFake models e.g. DeepFake, FaceSwap-MarekKowal, IPGAN, FaceShifter, FaceSwap-Nirkin, FSGAN, SimSwap, CihaNet, etc.

This is an official implementation for "AS-MLP: An Axial Shifted MLP Architecture for Vision".

[ACM MM 2021] TSA-Net: Tube Self-Attention Network for Action Quality Assessment

Use of Attention Gates in a Convolutional Neural Network / Medical Image Classification and Segmentation

Generalized Proximal Policy Optimization with Sample Reuse (GePPO)

nfelo: a power ranking, prediction, and betting model for the NFL

The official start-up code for paper "FFA-IR: Towards an Explainable and Reliable Medical Report Generation Benchmark."

UNet model with VGG11 encoder pre-trained on Kaggle Carvana dataset

Binary Stochastic Neurons in PyTorch

AI-generated-characters for Learning and Wellbeing

Code, pre-trained models and saliency results for the paper "Boosting RGB-D Saliency Detection by Leveraging Unlabeled RGB Images".

Callable PyTrees and filtered JIT/grad transformations => neural networks in JAX.

PED: DETR for Crowd Pedestrian Detection

Pytorch implementations of popular off-policy multi-agent reinforcement learning algorithms, including QMix, VDN, MADDPG, and MATD3.

A system used to detect whether a person is wearing a medical mask or not.

Approaches to modeling terrain and maps in python

Multiple paper open-source codes of the Microsoft Research Asia DKI group