runtime error
Exit code: 1. Reason: Downloading shards: 75%|███████▌ | 3/4 [01:29<00:30, 30.17s/it][A Downloading shards: 100%|██████████| 4/4 [01:37<00:00, 21.50s/it][A Downloading shards: 100%|██████████| 4/4 [01:37<00:00, 24.42s/it] Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s][A Loading checkpoint shards: 25%|██▌ | 1/4 [00:10<00:32, 10.79s/it][A Loading checkpoint shards: 50%|█████ | 2/4 [00:23<00:24, 12.03s/it][A Loading checkpoint shards: 75%|███████▌ | 3/4 [00:38<00:13, 13.51s/it][A Loading checkpoint shards: 100%|██████████| 4/4 [00:41<00:00, 9.32s/it][A Loading checkpoint shards: 100%|██████████| 4/4 [00:41<00:00, 10.46s/it] Traceback (most recent call last): File "/home/user/app/app.py", line 30, in <module> llama_model = AutoModelForCausalLM.from_pretrained("meta-llama/Meta-Llama-3-8B-Instruct", token=TOKEN, torch_dtype=torch.float16).to('cuda') File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 2905, in to return super().to(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1174, in to return self._apply(convert) File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 780, in _apply module._apply(fn) File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 780, in _apply module._apply(fn) File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 805, in _apply param_applied = fn(param) File "/usr/local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1160, in convert return t.to( File "/usr/local/lib/python3.10/site-packages/torch/cuda/__init__.py", line 314, in _lazy_init torch._C._cuda_init() RuntimeError: Found no NVIDIA driver on your system. Please check that you have an NVIDIA GPU and installed a driver from http://www.nvidia.com/Download/index.aspx
Container logs:
Fetching error logs...