runtime error

beddings with new imports of: >> from langchain_community.embeddings import HuggingFaceEmbeddings You can use the langchain cli to **automatically** upgrade many imports. Please see documentation here <https://python.langchain.com/v0.2/docs/versions/v0_2/> warn_deprecated( 0%| | 0.00/139M [00:00<?, ?iB/s] 95%|██████████████████████████████████████ | 132M/139M [00:01<00:00, 138MiB/s] 100%|████████████████████████████████████████| 139M/139M [00:01<00:00, 139MiB/s] /usr/local/lib/python3.10/site-packages/torch/nn/utils/weight_norm.py:28: UserWarning: torch.nn.utils.weight_norm is deprecated in favor of torch.nn.utils.parametrizations.weight_norm. warnings.warn("torch.nn.utils.weight_norm is deprecated in favor of torch.nn.utils.parametrizations.weight_norm.") Downloading: "https://dl.fbaipublicfiles.com/encodec/v0/encodec_24khz-d7cc33bc.th" to /home/user/.cache/torch/hub/checkpoints/encodec_24khz-d7cc33bc.th 0%| | 0.00/88.9M [00:00<?, ?B/s] 100%|██████████| 88.9M/88.9M [00:00<00:00, 307MB/s] Traceback (most recent call last): File "/home/user/app/app.py", line 75, in <module> llm = load_llm() File "/home/user/app/app.py", line 39, in load_llm model = AutoModelForCausalLM.from_pretrained( File "/usr/local/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py", line 564, in from_pretrained return model_class.from_pretrained( File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 3279, in from_pretrained hf_*********.validate_environment( File "/usr/local/lib/python3.10/site-packages/transformers/quantizers/quantizer_bnb_4bit.py", line 62, in validate_environment raise RuntimeError("No GPU found. A GPU is needed for quantization.") RuntimeError: No GPU found. A GPU is needed for quantization.

Container logs: