Why is "trust_remote_code" not supported?

#501
by Q-bert - opened

I made Mamba Model Collection. I want to submit for eval. But i cant , it doesnt support.

https://huggingface.co/collections/Q-bert/mamba-65869481595e25821853d20d

And there is so many model isue about this.

Open LLM Leaderboard org

Hi ! trust_remote_code is not supported because of security concerns. We cannot allow remote code to run on the eval cluster as it is not sandboxed for now.

SaylorTwift changed discussion status to closed

Sign up or log in to comment