huggingface_hub==0.22.2
transformers
torch
accelerate
git+https://github.com/xu-song/llama-cpp-python.git -C cmake.args="-DGGML_BLAS=ON;-DGGML_BLAS_VENDOR=OpenBLAS"