CausalLM

/

34b-beta

like 61

Congrats on your overwhelming victory- 85.6 on MMLU!

The next best open model is PlatiYi-34B-Llama-Q. https://huggingface.co/kyujinpy/PlatYi-34B-Llama-Q

diff from top = 85.6% - 78.78% = 6.82% (it's notably difficult to achieve higher percentage levels for smaller LLMs, so an extra congratulations is due)

A permission-only vision-language model was taken down for unexplained reasons "V0202" "beat" your model with 86.32, but you've kept your model open for the community to use, so your model will be both on top and have community-verifiable results.

So you have a current top on HF with an overwhelming score.

Congrats and thank you!