Unified Pre-training for Self-Supervised Learning and Supervised Learning for ASR

Last update: Jan 09, 2023

Related tags

Overview

UniSpeech

The family of UniSpeech:

UniSpeech (ICML 2021): Unified Pre-training for Self-Supervised Learning and Supervised Learning for ASR

UniSpeech-SAT (ICASSP 2022 Submission): Universal Speech Representation Learning with Speaker Aware Pre-Training

Pre-trained models

We strongly suggest using our UniSpeech-SAT model for speaker related tasks, since it shows very powerful performance on various speaker related benchmarks.

Model	Dataset	Model
UniSpeech Base	1500 hrs CommonVoice	download
UniSpeech Large	1500 hrs CommonVoice	download
UniSpeech-SAT Base	960 hrs LibriSpeech	download
UniSpeech-SAT Base+	60k hrs Libri-Light + 10k hrs GigaSpeech + 24k hrs VoxPopuli	download
UniSpeech-SAT Large	60k hrs Libri-Light + 10k hrs GigaSpeech + 24k hrs VoxPopuli	download

License

This project is licensed under the license found in the LICENSE file in the root directory of this source tree. Portions of the source code are based on the FAIRSEQ project.

Microsoft Open Source Code of Conduct

Contact Information

For help or issues using UniSpeech models, please submit a GitHub issue.

For other communications related to UniSpeech, please contact Yu Wu ([email protected]).

Unified Pre-training for Self-Supervised Learning and Supervised Learning for ASR

Related tags

Overview

UniSpeech

Pre-trained models

License

Contact Information

Owner

Microsoft

Boundary IoU API (Beta version)

G-NIA model from "Single Node Injection Attack against Graph Neural Networks" (CIKM 2021)

A 1.3B text-to-image generation model trained on 14 million image-text pairs

Python lib to talk to pylontech lithium batteries (US2000, US3000, ...) using RS485

ADB-IP-ROTATION - Use your mobile phone to gain a temporary IP address using ADB and data tethering

A graph neural network (GNN) model to predict protein-protein interactions (PPI) with no sample features

Official PyTorch implementation of DD3D: Is Pseudo-Lidar needed for Monocular 3D Object detection? (ICCV 2021), Dennis Park, Rares Ambrus, Vitor Guizilini, Jie Li, and Adrien Gaidon.

A gesture recognition system powered by OpenPose, k-nearest neighbours, and local outlier factor.

Lorien: A Unified Infrastructure for Efficient Deep Learning Workloads Delivery

KakaoBrain KoGPT (Korean Generative Pre-trained Transformer)

EMNLP 2021 Adapting Language Models for Zero-shot Learning by Meta-tuning on Dataset and Prompt Collections

Visualize Camera's Pose Using Extrinsic Parameter by Plotting Pyramid Model on 3D Space

Implementations for the ICLR-2021 paper: SEED: Self-supervised Distillation For Visual Representation.

AIR^2 for Interaction Prediction

This repo is a PyTorch implementation for Paper "Unsupervised Learning for Cuboid Shape Abstraction via Joint Segmentation from Point Clouds"

An addon uses SMPL's poses and global translation to drive cartoon character in Blender.

Implementation of Memory-Efficient Neural Networks with Multi-Level Generation, ICCV 2021

Apply our monocular depth boosting to your own network!

MetaShift: A Dataset of Datasets for Evaluating Contextual Distribution Shifts and Training Conflicts (ICLR 2022)

Datasets, Transforms and Models specific to Computer Vision

Unified Pre-training for Self-Supervised Learning and Supervised Learning for ASR

Related tags

Overview

UniSpeech

Pre-trained models

License

Contact Information

Owner

Microsoft

Boundary IoU API (Beta version)

G-NIA model from "Single Node Injection Attack against Graph Neural Networks" (CIKM 2021)

A 1.3B text-to-image generation model trained on 14 million image-text pairs

Python lib to talk to pylontech lithium batteries (US2000, US3000, ...) using RS485

ADB-IP-ROTATION - Use your mobile phone to gain a temporary IP address using ADB and data tethering

A graph neural network (GNN) model to predict protein-protein interactions (PPI) with no sample features

Official PyTorch implementation of DD3D: Is Pseudo-Lidar needed for Monocular 3D Object detection? (ICCV 2021), Dennis Park*, Rares Ambrus*, Vitor Guizilini, Jie Li, and Adrien Gaidon.

A gesture recognition system powered by OpenPose, k-nearest neighbours, and local outlier factor.

Lorien: A Unified Infrastructure for Efficient Deep Learning Workloads Delivery

KakaoBrain KoGPT (Korean Generative Pre-trained Transformer)

EMNLP 2021 Adapting Language Models for Zero-shot Learning by Meta-tuning on Dataset and Prompt Collections

Visualize Camera's Pose Using Extrinsic Parameter by Plotting Pyramid Model on 3D Space

Implementations for the ICLR-2021 paper: SEED: Self-supervised Distillation For Visual Representation.

AIR^2 for Interaction Prediction

This repo is a PyTorch implementation for Paper "Unsupervised Learning for Cuboid Shape Abstraction via Joint Segmentation from Point Clouds"

An addon uses SMPL's poses and global translation to drive cartoon character in Blender.

Implementation of Memory-Efficient Neural Networks with Multi-Level Generation, ICCV 2021

Apply our monocular depth boosting to your own network!

MetaShift: A Dataset of Datasets for Evaluating Contextual Distribution Shifts and Training Conflicts (ICLR 2022)

Datasets, Transforms and Models specific to Computer Vision

Official PyTorch implementation of DD3D: Is Pseudo-Lidar needed for Monocular 3D Object detection? (ICCV 2021), Dennis Park, Rares Ambrus, Vitor Guizilini, Jie Li, and Adrien Gaidon.