Spaces:
Sleeping
Sleeping
| title: Humanlike Evaluation Leaderboard | |
| emoji: 🥇 | |
| colorFrom: blue | |
| colorTo: indigo | |
| sdk: gradio | |
| sdk_version: 4.37.1 | |
| app_file: app.py | |
| pinned: true | |
| license: apache-2.0 | |
| tags: | |
| - leaderboard | |
| models: | |
| - google/gemma-2-9b | |
| python>3.10 | |
| pip spacy | |
| python -m spacy download en_core_web_sm | |
| pip install google.generativeai | |
| python -m spacy download en_core_web_trf | |
| Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference | |
| Most of the variables to change for a default leaderboard are in env (replace the path for your leaderboard) and src/display/about. | |
| Results files should have the following format: | |
| ``` | |
| { | |
| "config": { | |
| "model_dtype": "torch.float16", # or torch.bfloat16 or 8bit or 4bit | |
| "model_name": "path of the model on the hub: org/model", | |
| "model_sha": "revision on the hub", | |
| }, | |
| "results": { | |
| "task_name": { | |
| "metric_name": score, | |
| }, | |
| "task_name2": { | |
| "metric_name": score, | |
| } | |
| } | |
| } | |
| ``` | |
| Request files are created automatically by this tool. |