huggingface_hub==0.22.2
transformers
torch
accelerate
llama-cpp-python