huggingface_hub==0.22.2
transformers
torch
accelerate
git+https://github.com/xu-song/llama-cpp-python.git