Ukrainian TTS (text-to-speech) using Coqui TTS

Last update: Dec 26, 2022

Overview

title	emoji	colorFrom	colorTo	sdk	app_file	pinned
Ukrainian TTS	🐸	green	green	gradio	app.py	false

Ukrainian TTS 📢 🤖

Ukrainian TTS (text-to-speech) using Coqui TTS.

Trained on M-AILABS Ukrainian dataset using sumska voice.

Link to online demo -> https://huggingface.co/spaces/robinhad/ukrainian-tts

Support

If you like my work, please support -> SUPPORT LINK

Example

test.mp4

How to use :

pip install -r requirements.txt.
Download model from "Releases" tab.
Launch as one-time command:

tts --text "Text for TTS" \
    --model_path path/to/model.pth.tar \
    --config_path path/to/config.json \
    --out_path folder/to/save/output.wav

or alternatively launch web server using:

tts-server --model_path path/to/model.pth.tar \
    --config_path path/to/config.json

How to train:

Refer to "Nervous beginner guide" in Coqui TTS docs.
Instead of provided config.json use one from this repo.

Attribution

Code for app.py taken from https://huggingface.co/spaces/julien-c/coqui

Comments

Error with file: speakers.pth

FileNotFoundError: [Errno 2] No such file or directory: '/home/user/Soft/Python/mamba1/TTS/vits_mykyta_latest-September-12-2022_12+38AM-829e2c24/speakers.pth'

opened by akirsoft 4

doc: fix examples in README

Problem

The one-time snippet does not work as is and complains that the speaker is not defined

 > initialization of speaker-embedding layers.
 > Text: Перевірка мікрофона
 > Text splitted to sentences.
['Перевірка мікрофона']
Traceback (most recent call last):
  File "/home/serg/.local/bin/tts", line 8, in <module>
    sys.exit(main())
  File "/home/serg/.local/lib/python3.8/site-packages/TTS/bin/synthesize.py", line 350, in main
    wav = synthesizer.tts(
  File "/home/serg/.local/lib/python3.8/site-packages/TTS/utils/synthesizer.py", line 228, in tts
    raise ValueError(
ValueError:  [!] Look like you use a multi-speaker model. You need to define either a `speaker_name` or a `speaker_wav` to use a multi-speaker model.

Also it speakers.pth should be downloaded.

Fix

Just a few documentation changes:

make instructions on what to download from Releases more precise
add --speaker_id argument with one of the speakers

opened by seriar 2

One vowel words in the end of the sentence aren't stressed

Input:


Бобер на березі з бобренятами бублики пік.

Боронила борона по боронованому полю.

Ішов Прокіп, кипів окріп, прийшов Прокіп - кипить окріп, як при Прокопі, так і при Прокопі і при Прокопенятах.

Сидить Прокоп — кипить окроп, Пішов Прокоп — кипить окроп. Як при Прокопові кипів окроп, Так і без Прокопа кипить окроп.

Result:


Боб+ер н+а березі з бобрен+ятами б+ублики пік.

Борон+ила борон+а п+о борон+ованому п+олю.

Іш+ов Пр+окіп, кип+ів окр+іп, прийш+ов Пр+окіп - кип+ить окр+іп, +як пр+и Пр+окопі, т+ак +і пр+и Пр+окопі +і пр+и Прокопенятах.

Сид+ить Прок+оп — кип+ить окроп, Піш+ов Прок+оп — кип+ить окроп. +Як пр+и Пр+окопові кип+ів окроп, Т+ак +і б+ез Пр+окопа кип+ить окроп.```

opened by robinhad 0

Error import StressOption

Traceback (most recent call last): File "/home/user/Soft/Python/mamba1/test.py", line 1, in from ukrainian_tts.tts import TTS, Voices, StressOption ImportError: cannot import name 'StressOption' from 'ukrainian_tts.tts'

opened by akirsoft 0

Vits improvements

vitsArgs = VitsArgs(
    # hifi V3
    resblock_type_decoder = '2',
    upsample_rates_decoder = [8,8,4],
    upsample_kernel_sizes_decoder = [16,16,8],
    upsample_initial_channel_decoder = 256,
    resblock_kernel_sizes_decoder = [3,5,7],
    resblock_dilation_sizes_decoder = [[1,2], [2,6], [3,12]],
)

opened by robinhad 0

Model improvement checklist
[x] Add Ukrainian accentor - https://github.com/egorsmkv/ukrainian-accentor

[ ] Fine-tune from existing checkpoint (e.g. VITS Ljspeech)

[ ] Try to increase fft_size, hop_length to match sample_rate accordingly

[ ] Include more dataset samples into model
opened by robinhad 0

Releases(v4.0.0)

v4.0.0(Dec 10, 2022)

This is a release of Ukrainian TTS model and checkpoint. License for this model is GNU GPL v3 License. This release has a stress support using + sign before vowels. Model was trained for 160 000 steps by @robinhad .
Source code(tar.gz)
Source code(zip)
config.yaml(7.88 KB)
model.pth(368.17 MB)
v3.0.0(Sep 14, 2022)
This is a release of Ukrainian TTS model and checkpoint. License for this model is GNU GPL v3 License. This release has a stress support using + sign before vowels. Model was trained for 280 000 steps by @robinhad . Kudos to @egorsmkv for providing dataset for this model. Kudos to @proger for providing alignment scripts. Kudos to @dchaplinsky for Dmytro voice.

Example:

Test sentence:

К+ам'ян+ець-Под+ільський - м+істо в Хмельн+ицькій +області Укра+їни, ц+ентр Кам'ян+ець-Под+ільської міськ+ої об'+єднаної територі+альної гром+ади +і Кам'ян+ець-Под+ільського рай+ону.

Mykyta (male):

https://user-images.githubusercontent.com/5759207/190852232-34956a1d-77a9-42b9-b96d-39d0091e3e34.mp4

Olena (female):

https://user-images.githubusercontent.com/5759207/190852238-366782c1-9472-45fc-8fea-31346242f927.mp4

Dmytro (male):

https://user-images.githubusercontent.com/5759207/190852251-db105567-52ba-47b5-8ec6-5053c3baac8c.mp4

Olha (female):

https://user-images.githubusercontent.com/5759207/190852259-c6746172-05c4-4918-8286-a459c654eef1.mp4

Lada (female):

https://user-images.githubusercontent.com/5759207/190852270-7aed2db9-dc08-4a9f-8775-07b745657ca1.mp4
Source code(tar.gz)
Source code(zip)
config.json(12.07 KB)
model-inference.pth(329.95 MB)
model.pth(989.97 MB)
speakers.pth(495 bytes)
v3.0.0-alpha(Sep 8, 2022)

Mykyta, Lada and Olena License: GPL v3 licence.
Source code(tar.gz)
Source code(zip)
config.json(9.94 KB)
model-inference.pth(329.95 MB)
model.pth(989.96 MB)
speakers.pth(431 bytes)
v2.0.0(Jul 10, 2022)
This is a release of Ukrainian TTS model and checkpoint using voice (7 hours) from Mykyta dataset. License for this model is GNU GPL v3 License. This release has a stress support using + sign before vowels. Model was trained for 140 000 steps by @robinhad . Kudos to @egorsmkv for providing Mykyta and Olena dataset.

Example:

Test sentence:

К+ам'ян+ець-Под+ільський - м+істо в Хмельн+ицькій +області Укра+їни, ц+ентр Кам'ян+ець-Под+ільської міськ+ої об'+єднаної територі+альної гром+ади +і Кам'ян+ець-Под+ільського рай+ону.

Mykyta (male):

https://user-images.githubusercontent.com/5759207/178158485-29a5d496-7eeb-4938-8ea7-c345bc9fed57.mp4

Olena (female):

https://user-images.githubusercontent.com/5759207/178158492-8504080e-2f13-43f1-83f0-489b1f9cd66b.mp4
Source code(tar.gz)
Source code(zip)
config.json(9.97 KB)
model-inference.pth(329.95 MB)
model.pth(989.72 MB)
optimized.pth(329.95 MB)
speakers.pth(431 bytes)
v2.0.0-beta(May 8, 2022)

This is a beta release of Ukrainian TTS model and checkpoint using voice (7 hours) from Mykyta dataset. License for this model is GNU GPL v3 License. This release has a stress support using + sign before vowels. Model was trained for 150 000 steps by @robinhad . Kudos to @egorsmkv for providing Mykyta dataset.

Example:

https://user-images.githubusercontent.com/5759207/167305810-2b023da7-0657-44ac-961f-5abf1aa6ea7d.mp4

:
Source code(tar.gz)
Source code(zip)
config.json(8.85 KB)
LICENSE(34.32 KB)
model-inference.pth(317.15 MB)
model.pth(951.32 MB)
tts_output.wav(1.11 MB)
v1.0.0(Jan 14, 2022)

This is release of Ukrainian TTS model and checkpoint using voice (10 hours) from M-AILABS Ukrainian dataset. Model was trained using 200 000 steps. Example:

https://user-images.githubusercontent.com/5759207/149566245-40656002-3999-48a8-b671-e0f74c3d6e2f.mp4
Source code(tar.gz)
Source code(zip)
config.json(6.44 KB)
example.mp4(32.07 KB)
v0.0.1(Oct 14, 2021)

This is release of Ukrainian TTS model and checkpoint using voice (10 hours) from M-AILABS Ukrainian dataset. Model was trained using 14145 steps. Example:

https://user-images.githubusercontent.com/5759207/140622395-9e734c95-159c-4d72-9f56-e8d1f1ac66c2.mp4
Source code(tar.gz)
Source code(zip)
config.json(4.96 KB)
test.mp4(32.73 KB)
vocoder_config.json(4.39 KB)

Owner

Yurii Paniv

AI and stuff

GitHub Repository https://huggingface.co/spaces/robinhad/ukrainian-tts

FedNLP: A Benchmarking Framework for Federated Learning in Natural Language Processing

FedNLP is a research-oriented benchmarking framework for advancing federated learning (FL) in natural language processing (NLP). It uses FedML repository as the git submodule. In other words, FedNLP

216 Nov 27, 2022

Utilities for preprocessing text for deep learning with Keras

Note: This utility is really old and is no longer maintained. You should use keras.layers.TextVectorization instead of this. Utilities for pre-process

180 Dec 09, 2022

Sequence modeling benchmarks and temporal convolutional networks

Sequence Modeling Benchmarks and Temporal Convolutional Networks (TCN) This repository contains the experiments done in the work An Empirical Evaluati

3.5k Jan 03, 2023

Words_And_Phrases - Just a repo for useful words and phrases that might come handy in some scenarios. Feel free to add yours

Words_And_Phrases Just a repo for useful words and phrases that might come handy in some scenarios. Feel free to add yours Abbreviations Abbreviation

1 Feb 01, 2022

Repository of the Code to Chatbots, developed in Python

Description In this repository you will find the Code to my Chatbots, developed in Python. I'll explain the structure of this Repository later. Requir

0 Oct 25, 2022

A list of NLP(Natural Language Processing) tutorials

NLP Tutorial A list of NLP(Natural Language Processing) tutorials built on PyTorch. Table of Contents A step-by-step tutorial on how to implement and

1.3k Dec 25, 2022

Colibri core is an NLP tool as well as a C++ and Python library for working with basic linguistic constructions such as n-grams and skipgrams (i.e patterns with one or more gaps, either of fixed or dynamic size) in a quick and memory-efficient way. At the core is the tool ``colibri-patternmodeller`` whi ch allows you to build, view, manipulate and query pattern models.

Colibri Core by Maarten van Gompel, [email protected], Radboud University Nij

122 Nov 17, 2022

The model is designed to train a single and large neural network in order to predict correct translation by reading the given sentence.

Neural Machine Translation communication system The model is basically direct to convert one source language to another targeted language using encode

7 Sep 22, 2022

Ukrainian TTS (text-to-speech) using Coqui TTS

Related tags

Overview

Ukrainian TTS 📢 🤖

Support

Example

How to use :

How to train:

Attribution

Comments

Error with file: speakers.pth

doc: fix examples in README

Problem

Fix

One vowel words in the end of the sentence aren't stressed

Error import StressOption

Vits improvements

Model improvement checklist

Releases(v4.0.0)

v4.0.0(Dec 10, 2022)

v3.0.0(Sep 14, 2022)

Example:

v3.0.0-alpha(Sep 8, 2022)

v2.0.0(Jul 10, 2022)

Example:

v2.0.0-beta(May 8, 2022)

Example:

v1.0.0(Jan 14, 2022)

v0.0.1(Oct 14, 2021)

Owner

Yurii Paniv

FedNLP: A Benchmarking Framework for Federated Learning in Natural Language Processing

Utilities for preprocessing text for deep learning with Keras

Sequence modeling benchmarks and temporal convolutional networks

Words_And_Phrases - Just a repo for useful words and phrases that might come handy in some scenarios. Feel free to add yours

Repository of the Code to Chatbots, developed in Python

A list of NLP(Natural Language Processing) tutorials

The model is designed to train a single and large neural network in order to predict correct translation by reading the given sentence.

Finetune gpt-2 in google colab

CoNLL-English NER Task (NER in English)

Pytorch-Named-Entity-Recognition-with-BERT

Code for Emergent Translation in Multi-Agent Communication

Longformer: The Long-Document Transformer

ThinkTwice: A Two-Stage Method for Long-Text Machine Reading Comprehension

Research code for the paper "Fine-tuning wav2vec2 for speaker recognition"

Official implementation of Meta-StyleSpeech and StyleSpeech

Original implementation of the pooling method introduced in "Speaker embeddings by modeling channel-wise correlations"

Google's Meena transformer chatbot implementation

A method to generate speech across multiple speakers

Predict the spans of toxic posts that were responsible for the toxic label of the posts