Update README.md
Browse files
README.md
CHANGED
@@ -20,7 +20,7 @@ tags:
|
|
20 |
|
21 |
# FlauBERT-Oral models: Using ASR-Generated Text for Spoken Language Modeling
|
22 |
|
23 |
-
**FlauBERT-Oral** are French BERT models trained on a very large amount of automatically transcribed speech from 350,000 hours of diverse French TV shows. They were trained with the [FlauBERT software]
|
24 |
|
25 |
## Available FlauBERT-Oral models
|
26 |
|
|
|
20 |
|
21 |
# FlauBERT-Oral models: Using ASR-Generated Text for Spoken Language Modeling
|
22 |
|
23 |
+
**FlauBERT-Oral** are French BERT models trained on a very large amount of automatically transcribed speech from 350,000 hours of diverse French TV shows. They were trained with the [**FlauBERT software**](https://github.com/getalp/Flaubert) using the same parameters as the [flaubert-base-uncased](https://huggingface.co/flaubert/flaubert_base_uncased) model (12 layers, 12 attention heads, 768 dims, 137M parameters, uncased).
|
24 |
|
25 |
## Available FlauBERT-Oral models
|
26 |
|