Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning

Last update: Nov 10, 2022

Related tags

Overview

Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning

This repository provides an implementation of the paper Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning accepted at AISTATS 2022 as oral presentation. We propose a noise-reduced data valuation method, Beta Shapley, which is powerful at capturing the importance of data points.

Quick start

We provide a notebook using the Covertype dataset. It shows how to compute the Beta Shapley value and its application on several downstream ML tasks.

--> Beta Shapley can identify noisy samples by focusing marginal contributions on small cardinalities.

--> Beta Shapley on the CIFAR100 test dataset. Mislabeled data points have negative Beta Shapley values, meaning they actually harm the model performance. Beta Shapley can detect mislabeled points.

Files

betashap/ShapEngine.py: main class for computing Beta-Shapley.

betashap/data.py: handles loading and preprocessing datasets.

Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning

Related tags

Overview

Beta Shapley: a Unified and Noise-reduced Data Valuation Framework for Machine Learning

Quick start

Files

Owner

Yongchan Kwon

SeqFormer: a Frustratingly Simple Model for Video Instance Segmentation

Compute descriptors for 3D point cloud registration using a multi scale sparse voxel architecture

SysWhispers Shellcode Loader

An expansion for RDKit to read all types of files in one line

A keras implementation of ENet (abandoned for the foreseeable future)

Underwater industrial application yolov5m6

The Noise Contrastive Estimation for softmax output written in Pytorch

Pytorch codes for "Self-supervised Multi-view Stereo via Effective Co-Segmentation and Data-Augmentation"

Tutoriais publicados nas nossas redes sociais para obtenção de dados, análises simples e outras tarefas relevantes no mercado financeiro.

Machine Learning automation and tracking

CVPR2021 Content-Aware GAN Compression

The official code of "SCROLLS: Standardized CompaRison Over Long Language Sequences".

Text Summarization - WCN — Weighted Contextual N-gram method for evaluation of Text Summarization

GAN Image Generator and Characterwise Image Recognizer with python

PyTorch implementation of image classification models for CIFAR-10/CIFAR-100/MNIST/FashionMNIST/Kuzushiji-MNIST/ImageNet

Objax Apache-2Objax (🥉19 · ⭐ 580) - Objax is a machine learning framework that provides an Object.. Apache-2 jax

Code for WECHSEL: Effective initialization of subword embeddings for cross-lingual transfer of monolingual language models.

Estimating Example Difficulty using Variance of Gradients

Clean Machine Learning, a Coding Kata

In this project, we create and implement a deep learning library from scratch.