Unified Pre-training for Self-Supervised Learning and Supervised Learning for ASR

Last update: Jan 09, 2023

Related tags

Overview

UniSpeech

The family of UniSpeech:

UniSpeech (ICML 2021): Unified Pre-training for Self-Supervised Learning and Supervised Learning for ASR

UniSpeech-SAT (ICASSP 2022 Submission): Universal Speech Representation Learning with Speaker Aware Pre-Training

Pre-trained models

We strongly suggest using our UniSpeech-SAT model for speaker related tasks, since it shows very powerful performance on various speaker related benchmarks.

Model	Dataset	Model
UniSpeech Base	1500 hrs CommonVoice	download
UniSpeech Large	1500 hrs CommonVoice	download
UniSpeech-SAT Base	960 hrs LibriSpeech	download
UniSpeech-SAT Base+	60k hrs Libri-Light + 10k hrs GigaSpeech + 24k hrs VoxPopuli	download
UniSpeech-SAT Large	60k hrs Libri-Light + 10k hrs GigaSpeech + 24k hrs VoxPopuli	download

License

This project is licensed under the license found in the LICENSE file in the root directory of this source tree. Portions of the source code are based on the FAIRSEQ project.

Microsoft Open Source Code of Conduct

Contact Information

For help or issues using UniSpeech models, please submit a GitHub issue.

For other communications related to UniSpeech, please contact Yu Wu ([email protected]).

Unified Pre-training for Self-Supervised Learning and Supervised Learning for ASR

Related tags

Overview

UniSpeech

Pre-trained models

License

Contact Information

Owner

Microsoft

Code for paper Novel View Synthesis via Depth-guided Skip Connections

Official Pytorch Implementation for Splicing ViT Features for Semantic Appearance Transfer presenting Splice

Deep Inertial Prediction (DIPr)

PyTorch implementation of SimCLR: A Simple Framework for Contrastive Learning of Visual Representations

Defocus Map Estimation and Deblurring from a Single Dual-Pixel Image

💊 A 3D Generative Model for Structure-Based Drug Design (NeurIPS 2021)

For auto aligning, cropping, and scaling HR and LR images for training image based neural networks

A new data augmentation method for extreme lighting conditions.

VIMPAC: Video Pre-Training via Masked Token Prediction and Contrastive Learning

This repo includes our code for evaluating and improving transferability in domain generalization (NeurIPS 2021)

Code for Deterministic Neural Networks with Appropriate Inductive Biases Capture Epistemic and Aleatoric Uncertainty

Pixel Consensus Voting for Panoptic Segmentation (CVPR 2020)

Code for the Image similarity challenge.

내가 보려고 정리한 <프로그래밍 기초 Ⅰ> / organized for me

The official pytorch implementation of our paper "Is Space-Time Attention All You Need for Video Understanding?"

Sign Language Translation with Transformers (COLING'2020, ECCV'20 SLRTP Workshop)

Deep Structured Instance Graph for Distilling Object Detectors (ICCV 2021)

PHOTONAI is a high level python API for designing and optimizing machine learning pipelines.

Imaginaire - NVIDIA's Deep Imagination Team's PyTorch Library

Cave Generation using metaballs in Blender. Originally created by sdfgeoff, Edited by Myself (Archie Jaskowicz).