Spaces:
Running
on
CPU Upgrade
Running
on
CPU Upgrade
Nan is not captured properly
#315
by
sieu-n
- opened
No description provided.
sieu-n
changed pull request title from
Update src/display_models/read_results.py
to Nan is not captured properly
While reading the data from open-llm-leaderboard/results
using this code for analysis, I noticed that the values are float("nan")
instead of None, and the condition doesn't capture them. Probably nothing serious in terms of the leaderboard though :)
edit: small typo fixes
A slight change I believe would be that about 40 out of the 2000 models will have the partial average
score, computed as the sum of successful metrics / 4, which is nan
in the current code because the condition fails to catch and exclude it.
Hi ! Thank you for this PR ! Do you have an example of a model where this change does catch a nan
?
Closing for inactivity, feel free to reopen if needed!
clefourrier
changed pull request status to
closed