Jamba model FAILED

#854
by devingulliver - opened

Jamba is the first production-grade Attention-SSM hybrid model, so it's crucial to represent on the leaderboard.
Unfortunately it failed (request file here).
What can be done to fix this?

Open LLM Leaderboard org

Hi @devingulliver ,

Thanks for providing the requests file! We are investigating the problem and I'll relaunch the model as soon as possible

Open LLM Leaderboard org

I've relaunch your model, it should be fine now :)

I close this discussion, please, ping me here if you encounter any other problem with this model or start a new one

alozowski changed discussion status to closed

I see the eval worked this time! Unfortunately it's not showing up on the leaderboard for me. Can you confirm this?

Open LLM Leaderboard org

Hi!
Unless I'm mistaken, this model is on the leaderboard.
image.png

Open LLM Leaderboard org

(You sometimes need to wait a bit for the viewer to restart)

It is there now! Just had to wait 24 hours
Thanks

Sign up or log in to comment