leaderboard-pr-bot's picture
Adding Evaluation Results
9fda0e5
|
raw
history blame
904 Bytes
metadata
license: llama2

ShearedPlats-7b

An experimental finetune of Sheared LLaMA 1.3b with Alpaca-QLoRA

Datasets

Trained on alpca style datasets

Prompt Template

Uses alpaca style prompt template # [Open LLM Leaderboard Evaluation Results](https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard) Detailed results can be found [here](https://huggingface.co/datasets/open-llm-leaderboard/details_vihangd__shearedplats-1.3b-v1)
Metric Value
Avg. 31.63
ARC (25-shot) 35.41
HellaSwag (10-shot) 62.75
MMLU (5-shot) 24.75
TruthfulQA (0-shot) 33.93
Winogrande (5-shot) 58.48
GSM8K (5-shot) 0.53
DROP (3-shot) 5.55