Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning

Last update: Nov 10, 2022

Related tags

Overview

Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning

This repository provides an implementation of the paper Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning accepted at AISTATS 2022 as oral presentation. We propose a noise-reduced data valuation method, Beta Shapley, which is powerful at capturing the importance of data points.

Quick start

We provide a notebook using the Covertype dataset. It shows how to compute the Beta Shapley value and its application on several downstream ML tasks.

--> Beta Shapley can identify noisy samples by focusing marginal contributions on small cardinalities.

--> Beta Shapley on the CIFAR100 test dataset. Mislabeled data points have negative Beta Shapley values, meaning they actually harm the model performance. Beta Shapley can detect mislabeled points.

Files

betashap/ShapEngine.py: main class for computing Beta-Shapley.

betashap/data.py: handles loading and preprocessing datasets.

Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning

Related tags

Overview

Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning

Quick start

Files

Owner

Yongchan Kwon

ServiceX Transformer that converts flat ROOT ntuples into columnwise data

Official codes: Self-Supervised Learning by Estimating Twin Class Distribution

A library for hidden semi-Markov models with explicit durations

torchbearer: A model fitting library for PyTorch

Scalable, event-driven, deep-learning-friendly backtesting library

A minimal implementation of Gaussian process regression in PyTorch

Stroke-predictions-ml-model - Machine learning model to predict individuals chances of having a stroke

Translate darknet to tensorflow. Load trained weights, retrain/fine-tune using tensorflow, export constant graph def to mobile devices

Use evolutionary algorithms instead of gridsearch in scikit-learn

OpenMMLab 3D Human Parametric Model Toolbox and Benchmark

A pytorch implementation of MBNET: MOS PREDICTION FOR SYNTHESIZED SPEECH WITH MEAN-BIAS NETWORK

Implementation of H-Transformer-1D, Hierarchical Attention for Sequence Learning using 🤗 transformers

DecoupledNet is semantic segmentation system which using heterogeneous annotations

Code for the AAAI 2022 paper "Zero-Shot Cross-Lingual Machine Reading Comprehension via Inter-Sentence Dependency Graph".

Generate indoor scenes with Transformers

A script depending on VASP output for calculating Fermi-Softness.

A motion tracking system for any arbitaray points in a video frame.

Code for project: "Learning to Minimize Remainder in Supervised Learning".

This is the offical website for paper ''Category-consistent deep network learning for accurate vehicle logo recognition''

TalkingHead-1KH is a talking-head dataset consisting of YouTube videos