Hugging Face's logo

Spaces:
openGPT-X
/
european-llm-leaderboard
Running on CPU Upgrade

App Files Community
4
european-llm-leaderboard / README.md
Klaudia Thellmann
Replaced EU emoji
b110bcf unverified
preview code
|
raw
history blame contribute delete
685 Bytes

A newer version of the Gradio SDK is available: 5.6.0

Upgrade
metadata
title: European Leaderboard
emoji: 🌍
colorFrom: blue
colorTo: blue
sdk: gradio
sdk_version: 4.19.2
app_file: app.py
pinned: false
license: unknown

This is the OpenGPT-X mutlilingual leaderboard source code repository. The leaderboard aims to provied an overview of LLM performance over various languages. The basic task set consists of MMLU, ARC, HellaSwag, GSM8k, TruthfulQA and belebele. To make the results comparable to the Open LLM leaderboard (https://huggingface.co/open-llm-leaderboard) we selected the former five tasks based on our internal machine translations of the English base tasks, in addition to the high-quality multilingual benchmark belebele by Meta.