Spaces:

open-llm-leaderboard

/

open_llm_leaderboard

like 11.7k

Running on CPU Upgrade

Hi @Kquant03 ,

According to our FAQ, could you please provide the request file for your submission?

Hi @Kquant03 ,

According to our FAQ, could you please provide the request file for your submission?

https://huggingface.co/datasets/open-llm-leaderboard/requests/blob/main/Replete-AI/L3-Pneuma-8B_eval_request_False_bfloat16_Original.json

here you are, sir :)

Thank you for providing the request file!

There is a problem with "use_chat_template": true:

[rank4]: AttributeError: 'PreTrainedTokenizerFast' object has no attribute 'default_chat_template'. Did you mean: 'get_chat_template'?

As I can see in the tokenizer_config.json, there is no chat_template there. I can resubmit the model with "use_chat_template": false if you agree

Thank you for providing the request file!

There is a problem with "use_chat_template": true:

[rank4]: AttributeError: 'PreTrainedTokenizerFast' object has no attribute 'default_chat_template'. Did you mean: 'get_chat_template'?

As I can see in the tokenizer_config.json, there is no chat_template there. I can resubmit the model with "use_chat_template": false if you agree

yes, please...thank you for your kindness

Done! I've resubmitted your model

I'm closing this issue, please, ping me here in case of any problems with this model again or open a new one