runtime error

Exit code: 1. Reason: un_mp_engine ERROR 11-30 23:33:40 engine.py:366] engine = MQLLMEngine.from_engine_args(engine_args=engine_args, ERROR 11-30 23:33:40 engine.py:366] File "/home/user/.local/lib/python3.9/site-packages/vllm/engine/multiprocessing/engine.py", line 114, in from_engine_args ERROR 11-30 23:33:40 engine.py:366] engine_config = engine_args.create_engine_config() ERROR 11-30 23:33:40 engine.py:366] File "/home/user/.local/lib/python3.9/site-packages/vllm/engine/arg_utils.py", line 958, in create_engine_config ERROR 11-30 23:33:40 engine.py:366] device_config = DeviceConfig(device=self.device) Process SpawnProcess-1: ERROR 11-30 23:33:40 engine.py:366] File "/home/user/.local/lib/python3.9/site-packages/vllm/config.py", line 1208, in __init__ ERROR 11-30 23:33:40 engine.py:366] raise RuntimeError("Failed to infer device type") ERROR 11-30 23:33:40 engine.py:366] RuntimeError: Failed to infer device type Traceback (most recent call last): File "/usr/local/lib/python3.9/multiprocessing/process.py", line 315, in _bootstrap self.run() File "/usr/local/lib/python3.9/multiprocessing/process.py", line 108, in run self._target(*self._args, **self._kwargs) File "/home/user/.local/lib/python3.9/site-packages/vllm/engine/multiprocessing/engine.py", line 368, in run_mp_engine raise e File "/home/user/.local/lib/python3.9/site-packages/vllm/engine/multiprocessing/engine.py", line 357, in run_mp_engine engine = MQLLMEngine.from_engine_args(engine_args=engine_args, File "/home/user/.local/lib/python3.9/site-packages/vllm/engine/multiprocessing/engine.py", line 114, in from_engine_args engine_config = engine_args.create_engine_config() File "/home/user/.local/lib/python3.9/site-packages/vllm/engine/arg_utils.py", line 958, in create_engine_config device_config = DeviceConfig(device=self.device) File "/home/user/.local/lib/python3.9/site-packages/vllm/config.py", line 1208, in __init__ raise RuntimeError("Failed to infer device type") RuntimeError: Failed to infer device type

Container logs: