The magical model that stays in Pending Evaluation Queue forever! ⏳

#543
by rishiraj - opened

Multiple batches of models and been submitted after https://huggingface.co/rishiraj/oswald-4x7b and all of them have made their way to the "Running Evaluation Queue" section. However just this model constantly stays in the "Pending Evaluation Queue" like a king. Models come and go, this stays (now for 6 days) defying the very definition of a queue which is first-in, first-out (FIFO)!

rishiraj changed discussion status to closed
rishiraj changed discussion status to open
Open LLM Leaderboard org

Hi, this looks like a bug in our queuing display system, thanks for the report.
However, if you look at your model's request file history, you'll notice that it actually finished running an hour before you opened your issue ^^"

Open LLM Leaderboard org
edited Jan 17

Closing as this model was evaluated. (This is why we ask users to always provide request files when they open issues btw)

clefourrier changed discussion status to closed

Sign up or log in to comment