Is there a downloadable version of the leaderboard results as CSV format?

#1
by zhiminy - opened

I want to further compare the results but it is hard to copy and paste the results from screen.

Vectara org

Hi,
You can find the downloadable summaries at - https://github.com/vectara/hallucination-leaderboard?tab=readme-ov-file#data

Thanks for your reply, @viveksourabh
But this is not the leaderboard shown on the main page. Do you have the one that already aggregates the evaluation results (just the same as the main page leaderboard but in CSV format)?

Vectara org

Hey @zhiminy ,
Sorry for the late response. However, we don't have a downloadable version of the aggregated eval results.

Is there an historic data of this? so for example I can compare how GPT 4 has improved within time?

Vectara org

Hi @Agoncalves85 , there has been no re-evaluation of the models. therefore, we cannot track how models improve over time. but this is a good suggestion and we will consider in the future.

Sign up or log in to comment