When is the leaderboard updated for new models that are uploaded?

#75
by tanmaylaud - opened

Hi,
I have a model:
tanmaylaud/ret-phi2-v0

I would like to know when it would show up on the leaderboard.

Massive Text Embedding Benchmark org

Hello!

We refresh the leaderboard every once in a while (e.g. every 2 weeks or so), or when someone requests us to. That's when a new load of models get added automatically if they have the correct MTEB metadata in their READMEs. However, we do verify beforehand whether the new models are not duplicates, and we require the README to be non-empty & the model to be usable (i.e. so it must either have weights or an accessible API).

  • Tom Aarsen

Hi @tomaarsen ,
I updated the model card with metrics and brief description. Could you please update the leaderboard.

Sign up or log in to comment