ylacombe HF staff commited on
Commit
39c608d
1 Parent(s): 545cd46

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +27 -18
README.md CHANGED
@@ -11,25 +11,21 @@ pipeline_tag: text-to-speech
11
 
12
  # Parler-TTS v0.1
13
 
14
- [[Paper we reproduce]](https://arxiv.org/abs/2402.01912)
15
- [[Models]](https://huggingface.co/parler-tts)
16
- [[Training Code]](training)
17
- [[Interactive Demo]](https://huggingface.co/spaces/parler-tts/parler_tts_mini)
18
 
19
- > [!IMPORTANT]
20
- > We're proud to release Parler-TTS v0.1, our first 300M-parameters Parler-TTS model, trained on 10.5K hours of audio data.
21
-
22
- Parler-TTS is a reproduction of the text-to-speech (TTS) model from the paper [Natural language guidance of high-fidelity text-to-speech with synthetic annotations](https://www.text-description-to-speech.com)
23
- by Dan Lyth and Simon King, from Stability AI and Edinburgh University respectively.
24
-
25
- Contrarily to standard TTS models, Parler-TTS allows you to directly describe the speaker characteristics with a simple text description where you can modulate gender, pitch, speaking style, accent, etc.
26
 
27
  ## Usage
28
 
29
- > [!TIP]
 
30
  > You can directly try it out in an interactive demo [here](https://huggingface.co/spaces/parler-tts/parler_tts_mini)!
31
 
32
- Using Parler-TTS is as simple as "bonjour". Simply use the following inference snippet.
 
 
 
 
 
33
 
34
  ```py
35
  from parler_tts import ParlerTTSForConditionalGeneration
@@ -50,10 +46,23 @@ audio_arr = generation.cpu().numpy().squeeze()
50
  sf.write("parler_tts_out.wav", audio_arr, model.config.sampling_rate)
51
  ```
52
 
 
 
 
 
53
 
54
- ## Installation steps
 
 
 
 
 
 
 
 
 
 
 
 
 
55
 
56
- Parler-TTS has light-weight dependencies and can be installed in one line:
57
- ```sh
58
- pip install parler-tts
59
- ```
 
11
 
12
  # Parler-TTS v0.1
13
 
 
 
 
 
14
 
15
+ Parler-TTS v0.1 is a lightweight text-to-speech (TTS) model, trained on 10.5K hours of audio data, that can generate high-quality, natural sounding speech with features that can be controlled using a simple text prompt (e.g. gender, background noise, speaking rate, pitch and reverberation)
 
 
 
 
 
 
16
 
17
  ## Usage
18
 
19
+ > [!IMPORTANT]
20
+ > **NOTE:**
21
  > You can directly try it out in an interactive demo [here](https://huggingface.co/spaces/parler-tts/parler_tts_mini)!
22
 
23
+ Using Parler-TTS is as simple as "bonjour". Simply install the library once:
24
+ ```sh
25
+ pip install git+https://github.com/huggingface/parler-tts.git
26
+ ```
27
+
28
+ You can then use the model with the following inference snippet:
29
 
30
  ```py
31
  from parler_tts import ParlerTTSForConditionalGeneration
 
46
  sf.write("parler_tts_out.wav", audio_arr, model.config.sampling_rate)
47
  ```
48
 
49
+ > [!TIP] Tips for ensuring good generation:
50
+ > * Include the term "very clear audio" to generate the highest quality audio, and "very noisy audio" for high levels of background noise
51
+ > * Punctuation can be used to control the prosody of the generations, e.g. use commas to add small breaks in speech
52
+ > * The remaining speech features (gender, speaking rate, pitch and reverberation) can be controlled directly through the prompt
53
 
54
+ ## Motivation
55
+
56
+ Parler-TTS is a reproduction of work from the paper [Natural language guidance of high-fidelity text-to-speech with synthetic annotations](https://www.text-description-to-speech.com) by Dan Lyth and Simon King, from Stability AI and Edinburgh University respectively.
57
+
58
+ Contrarily to other TTS models, Parler-TTS is a **fully open-source** release. All of the datasets, pre-processing, training code and weights are released publicly under permissive license, enabling the community to build on our work and develop their own powerful TTS models.
59
+ Parler-TTS was released alongside:
60
+ * [The Parler-TTS repository](https://github.com/huggingface/parler-tts) - you can train and fine-tuned your own version of the model.
61
+ * [The Data-Speech repository](https://github.com/huggingface/dataspeech) - a suite of utility scripts designed to annotate speech datasets.
62
+ * [The Parler-TTS organization](https://huggingface.co/parler-tts) - where you can find the annotated datasets as well as the future checkpoints.
63
+
64
+
65
+ ## License
66
+
67
+ This model is permissively licensed under the Apache 2.0 license.
68