Please add GGUF support for Hebrew Leaderboard

#1
by SicariusSicariiStuff - opened

Hi, I didn't know how else to contact you,
Kindly please add GGUF support for the leaderboard. GPTQ is a depreciate format, EXL2 or GGUF would provide better compatibility with quantized models.

Thank you.

DICTA: The Israel Center for Text Analysis org

Hi,
Feel free to also open a discussion on the leaderboard page.

Regarding support for GGUF - the leaderboard uses the lighteval library with the HF endpoints deployed with a TGI container. In order to support GGUF we would have to create a container which serves a GGUF model on a TGI-compatible server.

We'll add it to the list, but it can take some time until we add support for it.

Sign up or log in to comment