Spaces:
Running
sorting by WER broken bc string
Sorting by WER is not working correctly as the field is interpreted as a string and not int/float value.
Hey @cansa ! Thanks for opening this issue! Could you elaborate on what you mean here? 🙂 Is there a model that is ranked highest on https://huggingface.co/spaces/whisper-event/leaderboard that isn't appearing on the winners list? Happy to dig into this with @reach-vb if so!
When I tap on the WER header on the winners table, it sorts the table like the example below:
Current sorted list: [1, 10, 2, 37, 529, 7, 8000, 99]
Properly sorted list: [1, 2, 7, 10, etc you get the idea]
Hey @cansa ! Thanks for explaining, I now understand the issue! The table is not really meant to be sorted by WER; we don't want to compare across languages, but rather display the best performing model in each language. If you want to sort models in a particular language by WER, I advise that you check out the leaderboard at https://huggingface.co/spaces/whisper-event/leaderboard