runtime error

Exit code: 1. Reason: h_fwd") /home/camenduru/.local/lib/python3.10/site-packages/xformers/ops/fmha/flash.py:344: FutureWarning: `torch.library.impl_abstract` was renamed to `torch.library.register_fake`. Please use that instead; we will remove `torch.library.impl_abstract` in a future version of PyTorch. @torch.library.impl_abstract("xformers_flash::flash_bwd") The cache for model files in Transformers v4.22.0 has been updated. Migrating your old cache. This is a one-time only operation. You can interrupt this and resume the migration later on by calling `transformers.utils.move_cache()`. 0it [00:00, ?it/s] 0it [00:00, ?it/s] Loading pipeline components...: 0%| | 0/5 [00:00<?, ?it/s] Loading pipeline components...: 100%|██████████| 5/5 [00:00<00:00, 750.99it/s] Traceback (most recent call last): File "/content/marigold-e2e-ft/worker_runpod.py", line 29, in <module> pipe_normals = pipe_normals.to('cuda') File "/home/camenduru/.local/lib/python3.10/site-packages/diffusers/pipelines/pipeline_utils.py", line 431, in to module.to(device, dtype) File "/home/camenduru/.local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1174, in to return self._apply(convert) File "/home/camenduru/.local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 780, in _apply module._apply(fn) File "/home/camenduru/.local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 780, in _apply module._apply(fn) File "/home/camenduru/.local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 805, in _apply param_applied = fn(param) File "/home/camenduru/.local/lib/python3.10/site-packages/torch/nn/modules/module.py", line 1160, in convert return t.to( File "/home/camenduru/.local/lib/python3.10/site-packages/torch/cuda/__init__.py", line 314, in _lazy_init torch._C._cuda_init() RuntimeError: Found no NVIDIA driver on your system. Please check that you have an NVIDIA GPU and installed a driver from http://www.nvidia.com/Download/index.aspx

Container logs: