Update README.md
Browse files
README.md
CHANGED
@@ -33,20 +33,20 @@ model-index:
|
|
33 |
This model is a fine-tuned version of [facebook/wav2vec2-xls-r-1b](https://huggingface.co/facebook/wav2vec2-xls-r-1b) on 40 hours of FPT Open Speech Dataset (FOSD).
|
34 |
|
35 |
### Benchmark WER result:
|
36 |
-
| | [VIVOS](https://huggingface.co/datasets/vivos) | [COMMON VOICE 7.0](https://huggingface.co/datasets/mozilla-foundation/common_voice_7_0) |
|
37 |
|---|---|---|
|
38 |
|without LM| 25.93 | 34.21 |
|
39 |
-
|with 4-grams LM| 24.11 | 28.27 |
|
40 |
|
41 |
### Benchmark CER result:
|
42 |
| | [VIVOS](https://huggingface.co/datasets/vivos) | [COMMON VOICE 7.0](https://huggingface.co/datasets/mozilla-foundation/common_voice_7_0) |
|
43 |
|---|---|---|
|
44 |
|without LM| 9.24 | 19.94 |
|
45 |
-
|with 4-grams LM| 10.37 | 14.42 |
|
46 |
|
47 |
## Evaluation
|
48 |
|
49 |
-
Please use eval.py file to run evaluation
|
50 |
|
51 |
```python
|
52 |
python eval_custom.py --model_id geninhu/xls-asr-vi-40h-1B --dataset mozilla-foundation/common_voice_7_0 --config vi --split test --log_outputs
|
|
|
33 |
This model is a fine-tuned version of [facebook/wav2vec2-xls-r-1b](https://huggingface.co/facebook/wav2vec2-xls-r-1b) on 40 hours of FPT Open Speech Dataset (FOSD).
|
34 |
|
35 |
### Benchmark WER result:
|
36 |
+
| | [VIVOS](https://huggingface.co/datasets/vivos) | [COMMON VOICE 7.0](https://huggingface.co/datasets/mozilla-foundation/common_voice_7_0) | [COMMON VOICE 8.0](https://huggingface.co/datasets/mozilla-foundation/common_voice_8_0)
|
37 |
|---|---|---|
|
38 |
|without LM| 25.93 | 34.21 |
|
39 |
+
|with 4-grams LM| 24.11 | 28.27 | 31.158 |
|
40 |
|
41 |
### Benchmark CER result:
|
42 |
| | [VIVOS](https://huggingface.co/datasets/vivos) | [COMMON VOICE 7.0](https://huggingface.co/datasets/mozilla-foundation/common_voice_7_0) |
|
43 |
|---|---|---|
|
44 |
|without LM| 9.24 | 19.94 |
|
45 |
+
|with 4-grams LM| 10.37 | 14.42 | 16.179 |
|
46 |
|
47 |
## Evaluation
|
48 |
|
49 |
+
Please use the eval.py file to run the evaluation
|
50 |
|
51 |
```python
|
52 |
python eval_custom.py --model_id geninhu/xls-asr-vi-40h-1B --dataset mozilla-foundation/common_voice_7_0 --config vi --split test --log_outputs
|