NiranjanC commited on
Commit
ae2a0bf
1 Parent(s): 5074382

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +39 -0
README.md ADDED
@@ -0,0 +1,39 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+ metrics:
5
+ - wer
6
+ pipeline_tag: automatic-speech-recognition
7
+ ---
8
+ # Model Card: LEVI Whisper Medium Fine-Tuned Model
9
+
10
+ ## Model Information
11
+ - **Model Name:** levicu/LEVI_whisper_medium
12
+ - **Description:** This model is a fine-tuned version of the OpenAI Whisper Medium model, tailored for speech recognition tasks using the LEVI v2 dataset, which consists of classroom audiovisual recording data.
13
+ - **Model Architecture:** openai/whisper-medium
14
+ - **Dataset:** LEVI v2 (classroom audiovisual recording data)
15
+
16
+ ## Training Details
17
+ - **Training Procedure:**
18
+ - LoRA Parameter Efficient Fine-tuning technique with the following parameters:
19
+ - r=32
20
+ - lora_alpha=64
21
+ - target_modules=["q_proj", "v_proj"]
22
+ - lora_dropout=0.05
23
+ - bias="none"
24
+ - INT8 quantization
25
+ - Trained for 6 epochs with a learning rate of 1e-4 and warmup steps of 100 without gradient accumulation.
26
+ - **Evaluation Metrics:** Word Error Rate (WER)
27
+
28
+ ## Usage
29
+ - **Usage:** The model can be used for speech recognition tasks. Inputs should be audio files, and the model outputs transcriptions.
30
+
31
+ ## Limitations and Ethical Considerations
32
+ - **Limitations:** None provided.
33
+ - **Ethical Considerations:** Consider the ethical implications of using this model, particularly in scenarios involving sensitive or private information.
34
+
35
+ ## License
36
+ - **License:** Not specified.
37
+
38
+ ## Contact Information
39
+ - **Contact:** For questions, feedback, or support regarding the model, please contact [email protected] or [email protected].