Speech Recognition for Uyghur using Speech transformer

Last update: Nov 17, 2022

Overview

Speech Recognition for Uyghur using Speech transformer

Training:

this model using CTC loss and Cross Entropy loss for training.

unzip results.7z and thuyg20_data.7z to the same folder where python source files located. then run:

python train.py

Recognition:

for recognition download only pretrained model. then run:

python .\tonu.py .\test6.wav

result will be:

        Model loaded: results/UFormer_last.pth
            Best CER: 4.16%
             Trained: 276 epochs
The model has 36,418,306 trainable parameters
 Feature  has 25,869,058 trainable parameters
  Encoder has 4,205,568 trainable parameters
  Decoder has 6,343,680 trainable parameters

======================
Recognizing file .\test6.wav
test6.wav -> u qizlarning resimi chiqip qalsa bilekchila sinchilap qaraytti

This project using

A free Uyghur speech database Released by [email protected] University & Xinjiang University

Reference

https://github.com/gentaiscool/end2end-asr-pytorch

pytorch-kaldi is a project for developing state-of-the-art DNN/RNN hybrid speech recognition systems. The DNN part is managed by pytorch, while feature extraction, label computation, and decoding are performed with the kaldi toolkit.

The PyTorch-Kaldi Speech Recognition Toolkit PyTorch-Kaldi is an open-source repository for developing state-of-the-art DNN/HMM speech recognition sys

2.3k Dec 27, 2022

Espresso: A Fast End-to-End Neural Speech Recognition Toolkit

Espresso Espresso is an open-source, modular, extensible end-to-end neural automatic speech recognition (ASR) toolkit based on the deep learning libra

919 Jan 3, 2023

Modular and extensible speech recognition library leveraging pytorch-lightning and hydra.

Lightning ASR Modular and extensible speech recognition library leveraging pytorch-lightning and hydra What is Lightning ASR • Installation • Get Star

40 Sep 19, 2022

voice2json is a collection of command-line tools for offline speech/intent recognition on Linux

Command-line tools for speech and intent recognition on Linux

988 Jan 4, 2023

Open-Source Toolkit for End-to-End Speech Recognition leveraging PyTorch-Lightning and Hydra.

OpenSpeech provides reference implementations of various ASR modeling papers and three languages recipe to perform tasks on automatic speech recogniti

26 Dec 14, 2022

Open-Source Toolkit for End-to-End Speech Recognition leveraging PyTorch-Lightning and Hydra.

OpenSpeech provides reference implementations of various ASR modeling papers and three languages recipe to perform tasks on automatic speech recogniti

86 Jun 11, 2021

A fast and lightweight python-based CTC beam search decoder for speech recognition.

pyctcdecode A fast and feature-rich CTC beam search decoder for speech recognition written in Python, providing n-gram (kenlm) language model support

315 Dec 21, 2022

Open-Source Toolkit for End-to-End Speech Recognition leveraging PyTorch-Lightning and Hydra.

🤗 Contributing to OpenSpeech 🤗 OpenSpeech provides reference implementations of various ASR modeling papers and three languages recipe to perform ta

513 Jan 3, 2023

ExKaldi-RT: An Online Speech Recognition Extension Toolkit of Kaldi

ExKaldi-RT is an online ASR toolkit for Python language. It reads realtime streaming audio and do online feature extraction, probability computation, and online decoding.

31 Aug 16, 2021

Comments

W2Llayer

Dear Gheyret, Thanks for your work.

I spent some time today to try to figure out the source of this feature extraction layer, can you point me the paper/any reference on it?

I think it is a great design to extract speech features, so just want to understand it more deeply,

Thanks a lot,

Kelvin

opened by kelvinqin 2

Releases(premodel)

premodel(Jun 18, 2021)

Pretrained model.
Source code(tar.gz)
Source code(zip)
results.7z(131.19 MB)

Owner

Uyghur

GitHub Repository

Ελληνικά νέα (Python script) / Greek News Feed (Python script)

Ελληνικά νέα (Python script) / Greek News Feed (Python script) Ελληνικά English Το 2017 είχα υλοποιήσει ένα Python script για να εμφανίζει τα τωρινά ν

1 Jun 14, 2022

[EMNLP 2021] LM-Critic: Language Models for Unsupervised Grammatical Error Correction

LM-Critic: Language Models for Unsupervised Grammatical Error Correction This repo provides the source code & data of our paper: LM-Critic: Language M

98 Nov 24, 2022

Data loaders and abstractions for text and NLP

torchtext This repository consists of: torchtext.data: Generic data loaders, abstractions, and iterators for text (including vocabulary and word vecto

3.2k Dec 30, 2022

API for the GPT-J language model 🦜. Including a FastAPI backend and a streamlit frontend

gpt-j-api 🦜 An API to interact with the GPT-J language model. You can use and test the model in two different ways: Streamlit web app at http://api.v

276 Dec 31, 2022

A python package to fine-tune transformer-based models for named entity recognition (NER).

nerblackbox A python package to fine-tune transformer-based language models for named entity recognition (NER). Resources Source Code: https://github.

13 Jul 30, 2022

Data and evaluation code for the paper WikiNEuRal: Combined Neural and Knowledge-based Silver Data Creation for Multilingual NER (EMNLP 2021).

Data and evaluation code for the paper WikiNEuRal: Combined Neural and Knowledge-based Silver Data Creation for Multilingual NER. @inproceedings{tedes

40 Dec 11, 2022

Speech Recognition for Uyghur using Speech transformer

Related tags

Overview

Speech Recognition for Uyghur using Speech transformer

Training:

Recognition:

This project using

Reference

You might also like...

pytorch-kaldi is a project for developing state-of-the-art DNN/RNN hybrid speech recognition systems. The DNN part is managed by pytorch, while feature extraction, label computation, and decoding are performed with the kaldi toolkit.

Espresso: A Fast End-to-End Neural Speech Recognition Toolkit

Modular and extensible speech recognition library leveraging pytorch-lightning and hydra.

voice2json is a collection of command-line tools for offline speech/intent recognition on Linux

Open-Source Toolkit for End-to-End Speech Recognition leveraging PyTorch-Lightning and Hydra.

Open-Source Toolkit for End-to-End Speech Recognition leveraging PyTorch-Lightning and Hydra.

A fast and lightweight python-based CTC beam search decoder for speech recognition.

Open-Source Toolkit for End-to-End Speech Recognition leveraging PyTorch-Lightning and Hydra.

ExKaldi-RT: An Online Speech Recognition Extension Toolkit of Kaldi

Comments

W2Llayer

Releases(premodel)

premodel(Jun 18, 2021)

Owner

Uyghur

Ελληνικά νέα (Python script) / Greek News Feed (Python script)

[EMNLP 2021] LM-Critic: Language Models for Unsupervised Grammatical Error Correction

Data loaders and abstractions for text and NLP

API for the GPT-J language model 🦜. Including a FastAPI backend and a streamlit frontend

A python package to fine-tune transformer-based models for named entity recognition (NER).

Data and evaluation code for the paper WikiNEuRal: Combined Neural and Knowledge-based Silver Data Creation for Multilingual NER (EMNLP 2021).

Python generation script for BitBirds

Uses Google's gTTS module to easily create robo text readin' on command.

Smart discord chatbot integrated with Dialogflow

Making text a first-class citizen in TensorFlow.

Code for "Parallel Instance Query Network for Named Entity Recognition", accepted at ACL 2022.

The Easy-to-use Dialogue Response Selection Toolkit for Researchers

SimBERT升级版（SimBERTv2）！

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

A Multi-modal Model Chinese Spell Checker Released on ACL2021.

Predict an emoji that is associated with a text

Espresso: A Fast End-to-End Neural Speech Recognition Toolkit

To be a next-generation DL-based phenotype prediction from genome mutations.

A relatively simple python program to generate one of those reddit text to speech videos dominating youtube.

KakaoBrain KoGPT (Korean Generative Pre-trained Transformer)