Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,39 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
language:
|
3 |
+
- en
|
4 |
+
metrics:
|
5 |
+
- wer
|
6 |
+
pipeline_tag: automatic-speech-recognition
|
7 |
+
---
|
8 |
+
# Model Card: LEVI Whisper Medium Fine-Tuned Model
|
9 |
+
|
10 |
+
## Model Information
|
11 |
+
- **Model Name:** levicu/LEVI_whisper_medium
|
12 |
+
- **Description:** This model is a fine-tuned version of the OpenAI Whisper Medium model, tailored for speech recognition tasks using the LEVI v2 dataset, which consists of classroom audiovisual recording data.
|
13 |
+
- **Model Architecture:** openai/whisper-medium
|
14 |
+
- **Dataset:** LEVI v2 (classroom audiovisual recording data)
|
15 |
+
|
16 |
+
## Training Details
|
17 |
+
- **Training Procedure:**
|
18 |
+
- LoRA Parameter Efficient Fine-tuning technique with the following parameters:
|
19 |
+
- r=32
|
20 |
+
- lora_alpha=64
|
21 |
+
- target_modules=["q_proj", "v_proj"]
|
22 |
+
- lora_dropout=0.05
|
23 |
+
- bias="none"
|
24 |
+
- INT8 quantization
|
25 |
+
- Trained for 6 epochs with a learning rate of 1e-4 and warmup steps of 100 without gradient accumulation.
|
26 |
+
- **Evaluation Metrics:** Word Error Rate (WER)
|
27 |
+
|
28 |
+
## Usage
|
29 |
+
- **Usage:** The model can be used for speech recognition tasks. Inputs should be audio files, and the model outputs transcriptions.
|
30 |
+
|
31 |
+
## Limitations and Ethical Considerations
|
32 |
+
- **Limitations:** None provided.
|
33 |
+
- **Ethical Considerations:** Consider the ethical implications of using this model, particularly in scenarios involving sensitive or private information.
|
34 |
+
|
35 |
+
## License
|
36 |
+
- **License:** Not specified.
|
37 |
+
|
38 |
+
## Contact Information
|
39 |
+
- **Contact:** For questions, feedback, or support regarding the model, please contact [email protected] or [email protected].
|