Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning

Last update: Nov 10, 2022

Related tags

Overview

Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning

This repository provides an implementation of the paper Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning accepted at AISTATS 2022 as oral presentation. We propose a noise-reduced data valuation method, Beta Shapley, which is powerful at capturing the importance of data points.

Quick start

We provide a notebook using the Covertype dataset. It shows how to compute the Beta Shapley value and its application on several downstream ML tasks.

--> Beta Shapley can identify noisy samples by focusing marginal contributions on small cardinalities.

--> Beta Shapley on the CIFAR100 test dataset. Mislabeled data points have negative Beta Shapley values, meaning they actually harm the model performance. Beta Shapley can detect mislabeled points.

Files

betashap/ShapEngine.py: main class for computing Beta-Shapley.

betashap/data.py: handles loading and preprocessing datasets.

Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning

Related tags

Overview

Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning

Quick start

Files

Owner

Yongchan Kwon

TorchX: A PyTorch Extension Library for More Efficient Deep Learning

Modelisation on galaxy evolution using PEGASE-HR

A free, multiplatform SDK for real-time facial motion capture using blendshapes, and rigid head pose in 3D space from any RGB camera, photo, or video.

INSPIRED: A Transparent Dialogue Dataset for Interactive Semantic Parsing

Improving Compound Activity Classification via Deep Transfer and Representation Learning

DeepHyper: Scalable Asynchronous Neural Architecture and Hyperparameter Search for Deep Neural Networks

A Python Package for Portfolio Optimization using the Critical Line Algorithm

A package, and script, to perform imaging transcriptomics on a neuroimaging scan.

End-to-end machine learning project for rices detection

Cascading Feature Extraction for Fast Point Cloud Registration (BMVC 2021)

DetCo: Unsupervised Contrastive Learning for Object Detection

Instant Real-Time Example-Based Style Transfer to Facial Videos

TensorFlow Implementation of Unsupervised Cross-Domain Image Generation

Extreme Lightwegith Portrait Segmentation

CC-GENERATOR - A python script for generating CC

Source code for NAACL 2021 paper "TR-BERT: Dynamic Token Reduction for Accelerating BERT Inference"

Justmagic - Use a function as a method with this mystic script, like in Nim

Frequency Spectrum Augmentation Consistency for Domain Adaptive Object Detection

A Pytorch reproduction of Range Loss, which is proposed in paper 《Range Loss for Deep Face Recognition with Long-Tailed Training Data》

Learning Super-Features for Image Retrieval