Update README.md
Browse files
README.md
CHANGED
@@ -11,25 +11,21 @@ pipeline_tag: text-to-speech
|
|
11 |
|
12 |
# Parler-TTS v0.1
|
13 |
|
14 |
-
[[Paper we reproduce]](https://arxiv.org/abs/2402.01912)
|
15 |
-
[[Models]](https://huggingface.co/parler-tts)
|
16 |
-
[[Training Code]](training)
|
17 |
-
[[Interactive Demo]](https://huggingface.co/spaces/parler-tts/parler_tts_mini)
|
18 |
|
19 |
-
|
20 |
-
> We're proud to release Parler-TTS v0.1, our first 300M-parameters Parler-TTS model, trained on 10.5K hours of audio data.
|
21 |
-
|
22 |
-
Parler-TTS is a reproduction of the text-to-speech (TTS) model from the paper [Natural language guidance of high-fidelity text-to-speech with synthetic annotations](https://www.text-description-to-speech.com)
|
23 |
-
by Dan Lyth and Simon King, from Stability AI and Edinburgh University respectively.
|
24 |
-
|
25 |
-
Contrarily to standard TTS models, Parler-TTS allows you to directly describe the speaker characteristics with a simple text description where you can modulate gender, pitch, speaking style, accent, etc.
|
26 |
|
27 |
## Usage
|
28 |
|
29 |
-
> [!
|
|
|
30 |
> You can directly try it out in an interactive demo [here](https://huggingface.co/spaces/parler-tts/parler_tts_mini)!
|
31 |
|
32 |
-
Using Parler-TTS is as simple as "bonjour". Simply
|
|
|
|
|
|
|
|
|
|
|
33 |
|
34 |
```py
|
35 |
from parler_tts import ParlerTTSForConditionalGeneration
|
@@ -50,10 +46,23 @@ audio_arr = generation.cpu().numpy().squeeze()
|
|
50 |
sf.write("parler_tts_out.wav", audio_arr, model.config.sampling_rate)
|
51 |
```
|
52 |
|
|
|
|
|
|
|
|
|
53 |
|
54 |
-
##
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
55 |
|
56 |
-
Parler-TTS has light-weight dependencies and can be installed in one line:
|
57 |
-
```sh
|
58 |
-
pip install parler-tts
|
59 |
-
```
|
|
|
11 |
|
12 |
# Parler-TTS v0.1
|
13 |
|
|
|
|
|
|
|
|
|
14 |
|
15 |
+
Parler-TTS v0.1 is a lightweight text-to-speech (TTS) model, trained on 10.5K hours of audio data, that can generate high-quality, natural sounding speech with features that can be controlled using a simple text prompt (e.g. gender, background noise, speaking rate, pitch and reverberation)
|
|
|
|
|
|
|
|
|
|
|
|
|
16 |
|
17 |
## Usage
|
18 |
|
19 |
+
> [!IMPORTANT]
|
20 |
+
> **NOTE:**
|
21 |
> You can directly try it out in an interactive demo [here](https://huggingface.co/spaces/parler-tts/parler_tts_mini)!
|
22 |
|
23 |
+
Using Parler-TTS is as simple as "bonjour". Simply install the library once:
|
24 |
+
```sh
|
25 |
+
pip install git+https://github.com/huggingface/parler-tts.git
|
26 |
+
```
|
27 |
+
|
28 |
+
You can then use the model with the following inference snippet:
|
29 |
|
30 |
```py
|
31 |
from parler_tts import ParlerTTSForConditionalGeneration
|
|
|
46 |
sf.write("parler_tts_out.wav", audio_arr, model.config.sampling_rate)
|
47 |
```
|
48 |
|
49 |
+
> [!TIP] Tips for ensuring good generation:
|
50 |
+
> * Include the term "very clear audio" to generate the highest quality audio, and "very noisy audio" for high levels of background noise
|
51 |
+
> * Punctuation can be used to control the prosody of the generations, e.g. use commas to add small breaks in speech
|
52 |
+
> * The remaining speech features (gender, speaking rate, pitch and reverberation) can be controlled directly through the prompt
|
53 |
|
54 |
+
## Motivation
|
55 |
+
|
56 |
+
Parler-TTS is a reproduction of work from the paper [Natural language guidance of high-fidelity text-to-speech with synthetic annotations](https://www.text-description-to-speech.com) by Dan Lyth and Simon King, from Stability AI and Edinburgh University respectively.
|
57 |
+
|
58 |
+
Contrarily to other TTS models, Parler-TTS is a **fully open-source** release. All of the datasets, pre-processing, training code and weights are released publicly under permissive license, enabling the community to build on our work and develop their own powerful TTS models.
|
59 |
+
Parler-TTS was released alongside:
|
60 |
+
* [The Parler-TTS repository](https://github.com/huggingface/parler-tts) - you can train and fine-tuned your own version of the model.
|
61 |
+
* [The Data-Speech repository](https://github.com/huggingface/dataspeech) - a suite of utility scripts designed to annotate speech datasets.
|
62 |
+
* [The Parler-TTS organization](https://huggingface.co/parler-tts) - where you can find the annotated datasets as well as the future checkpoints.
|
63 |
+
|
64 |
+
|
65 |
+
## License
|
66 |
+
|
67 |
+
This model is permissively licensed under the Apache 2.0 license.
|
68 |
|
|
|
|
|
|
|
|