TeeZee

/

2xbagel-dpo-34b-v0.2-bpw3.0-h6-exl2

like 1

Using text-generation-webui

Traceback (most recent call last):
File "text-generation-webui/modules/ui_model_menu.py", line 213, in load_model_wrapper
shared.model, shared.tokenizer = load_model(selected_model, loader)
File "text-generation-webui/modules/models.py", line 87, in load_model
output = load_func_maploader
File "text-generation-webui/modules/models.py", line 389, in ExLlamav2_HF_loader
return Exllamav2HF.from_pretrained(model_name)
File "text-generation-webui/modules/exllamav2_hf.py", line 162, in from_pretrained
config.prepare()
File "text-generation-webui/.venv/lib/python3.10/site-packages/exllamav2/config.py", line 74, in prepare
assert os.path.exists(self.model_config), "Can't find " + self.model_config
AssertionError: Can't find TeeZee_2xbagel-dpo-34b-v0.2-bpw3.0-h6-exl2/config.json