Spaces:

open-llm-leaderboard

/

open_llm_leaderboard

like 11.8k

Running on CPU Upgrade

Run time error homies

Vmware/open-llama-7b-v2-open-instruct
Could not find request file for Weyaxi/Bagel-Hermes-2x34b
Could not find request file for Weyaxi/Einstein-v5-v0.2-7B
Could not find request file for Weyaxi/einstein-v2-test-model
Could not find request file for abacusai/Smaug-70B-v0.1
Could not find request file for abhishek/ccy0-2g7e-wqsa-0
Could not find request file for adept/persimmon-8b-chat
Could not find request file for adonlee/LLaMA_2_13B_SFT_v1.5
Could not find request file for adonlee/LLaMA_2_13B_SFT_v1
Could not find request file for adonlee/LLaMA_2_13B_SFT_v1
Could not find request file for adonlee/LLaMA_2_13B_SFT_v1
Traceback (most recent call last):
  File "/home/user/app/app.py", line 125, in <module>
    init_space(full_init=do_full_init)
  File "/home/user/app/app.py", line 97, in init_space
    raw_data, original_df = get_leaderboard_df(
  File "/home/user/app/src/populate.py", line 15, in get_leaderboard_df
    raw_data = get_raw_eval_results(results_path=results_path, requests_path=requests_path, dynamic_path=dynamic_path)
  File "/home/user/app/src/leaderboard/read_evals.py", line 198, in get_raw_eval_results
    eval_result.update_with_request_file(requests_path)
  File "/home/user/app/src/leaderboard/read_evals.py", line 103, in update_with_request_file
    request_file = get_request_file_for_model(requests_path, self.full_model, self.precision.value.name)
  File "/home/user/app/src/leaderboard/read_evals.py", line 167, in get_request_file_for_model
    req_content = json.load(f)
  File "/usr/local/lib/python3.10/json/__init__.py", line 293, in load
    return loads(fp.read(),
  File "/usr/local/lib/python3.10/json/__init__.py", line 346, in loads
    return _default_decoder.decode(s)
  File "/usr/local/lib/python3.10/json/decoder.py", line 337, in decode
    obj, end = self.raw_decode(s, idx=_w(s, 0).end())
  File "/usr/local/lib/python3.10/json/decoder.py", line 353, in raw_decode
    obj, end = self.scan_once(s, idx)
json.decoder.JSONDecodeError: Expecting ',' delimiter: line 13 column 3 (char 359)