Spaces:
Runtime error
Evaluating on SQuAD gives 404 Client Error
I am trying to evaluate question answering models on squad_v2. However, I get the following error below:
HTTPError: 404 Client Error: Not Found for url: https://api-staging.autotrain.huggingface.co/projects/1655/data/squad_v2?type=dataset&config_name=squad_v2&split_name=validation
Traceback:
File "/home/user/.local/lib/python3.8/site-packages/streamlit/scriptrunner/script_runner.py", line 554, in _run_script
exec(code, module.__dict__)
File "/home/user/app/app.py", line 564, in <module>
data_json_resp = http_post(
File "/home/user/app/utils.py", line 45, in http_post
response.raise_for_status()
File "/home/user/.local/lib/python3.8/site-packages/requests/models.py", line 1021, in raise_for_status
raise HTTPError(http_error_msg, response=self)
Thanks for reporting! I'll take a look at what's causing this and report back with a fix :)
Hi @timbmg , I just merged a fix this morning. Can you try again and report back with steps to reproduce if it still doesn't work?
Great, thank you @mathemakitten ! I just tested it and it started to run. So looks good:)
Is there a way to check the status of the evaluation? I submitted it a couple of hours ago, but didn't get a notification (yet). It also does not seem to be in the autoevaluate/leaderboards.
Hey @timbmg thanks for resubmitting! There is an issue on our infra at the moment, which is why you haven't received a notification yet. We're looking into this and will report back once it's back online!
Regarding checking the status of the evaluation, this isn't currently possible outside the HF team. I'll discuss internally to see if there's a simple solution we can provide!
@timbmg I haven't been able to evaluate my own models on here for a couple weeks. My post is right below your's.