TinyStories-Alpaca / README.md
blueapple8259's picture
Adding Evaluation Results (#2)
608563b
metadata
datasets:
  - vicgalle/alpaca-gpt4
language:
  - en
license: cc-by-nc-4.0

This model is a roneneldan/TinyStories-33M model fine-tuned with the vicgalle/alpaca-gp4 dataset.

prompt:

Lily asked the teacher a question. "{prompt}" The teacher smiled and said, "

Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Metric Value
Avg. 24.51
ARC (25-shot) 23.98
HellaSwag (10-shot) 24.92
MMLU (5-shot) 23.35
TruthfulQA (0-shot) 46.68
Winogrande (5-shot) 51.85
GSM8K (5-shot) 0.0
DROP (3-shot) 0.81