runtime error
ages/torchvision/transforms/_transforms_video.py:22: UserWarning: The 'torchvision.transforms._transforms_video' module is deprecated since 0.12 and will be removed in the future. Please use the 'torchvision.transforms' module instead. warnings.warn( /home/user/.local/lib/python3.10/site-packages/torchvision/transforms/functional_tensor.py:5: UserWarning: The torchvision.transforms.functional_tensor module is deprecated in 0.15 and will be **removed in 0.17**. Please don't rely on it. You probably just need to use APIs in torchvision.transforms.functional or in torchvision.transforms.v2.functional. warnings.warn( Downloading shards: 0%| | 0/2 [00:00<?, ?it/s][A Downloading shards: 50%|βββββ | 1/2 [01:10<01:10, 70.62s/it][A Downloading shards: 100%|ββββββββββ| 2/2 [01:50<00:00, 52.32s/it][A Downloading shards: 100%|ββββββββββ| 2/2 [01:50<00:00, 55.06s/it] Traceback (most recent call last): File "/home/user/app/app.py", line 142, in <module> handler = Chat(model_path, conv_mode=conv_mode, load_8bit=load_8bit, load_4bit=load_8bit, device=device) File "/home/user/app/llava/serve/gradio_utils.py", line 56, in __init__ self.tokenizer, self.model, processor, context_len = load_pretrained_model(model_path, model_base, model_name, File "/home/user/app/llava/model/builder.py", line 114, in load_pretrained_model model = LlavaLlamaForCausalLM.from_pretrained(model_path, low_cpu_mem_usage=True, **kwargs) File "/home/user/.local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 2903, in from_pretrained ) = cls._load_pretrained_model( File "/home/user/.local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 3002, in _load_pretrained_model raise ValueError( ValueError: The current `device_map` had weights offloaded to the disk. Please provide an `offload_folder` for them. Alternatively, make sure you have `safetensors` installed if the model you are using offers the weights in this format.
Container logs:
Fetching error logs...