---
license: llama3.2
datasets:
- mlabonne/orpo-dpo-mix-40k
language:
- en
base_model:
- meta-llama/Llama-3.2-1B
library_name: transformers
pipeline_tag: text-generation
model-index:
- name: week2-llama3-1B
  results:
  - task:
      type: text-generation
    dataset:
      name: mlabonne/orpo-dpo-mix-40k
      type: mlabonne/orpo-dpo-mix-40k
    metrics:
    - name: EQ-Bench (0-Shot)
      type: EQ-Bench (0-Shot)
      value: 1.5355
---
## Model Overview  
This model is a fine-tuned variant of **Llama-3.2-1B**, leveraging **ORPO** (Optimized Regularization for Prompt Optimization) for enhanced performance. It has been fine-tuned using the **mlabonne/orpo-dpo-mix-40k** dataset as part of the *Finetuning Open Source LLMs Course - Week 2 Project*. 

## Intended Use  
This model is optimized for general-purpose language tasks, including text parsing, understanding contextual prompts, and enhanced interpretability in natural language processing applications. 

## Evaluation Results
The model was evaluated on the following benchmarks, with the following performance metrics:
| Tasks  |Version|Filter|n-shot|     Metric      |   | Value |   |Stderr|
|--------|------:|------|-----:|-----------------|---|------:|---|-----:|
|eq_bench|    2.1|none  |     0|eqbench          |↑  | 1.5355|±  |0.9184|
|        |       |none  |     0|percent_parseable|↑  |16.9591|±  |2.8782|
|hellaswag|      1|none  |     0|acc                    |↑  |0.4812|±  |0.0050|
|         |       |none  |     0|acc_norm               |↑  |0.6467|±  |0.0049|
|ifeval   |      4|none  |     0|inst_level_loose_acc   |↑  |0.3984|±  |   N/A|
|         |       |none  |     0|inst_level_strict_acc  |↑  |0.2974|±  |   N/A|
|         |       |none  |     0|prompt_level_loose_acc |↑  |0.2755|±  |0.0193|
|         |       |none  |     0|prompt_level_strict_acc|↑  |0.1848|±  |0.0168|
|tinyMMLU |      0|none  |     0|acc_norm               |↑  |0.3995|±  |   N/A|

## Key Features  
- **Model Size**: 1 Billion parameters  
- **Fine-tuning Method**: ORPO  
- **Dataset**: mlabonne/orpo-dpo-mix-40k