requirements.txt

accelerate
huggingface_hub
opencv-python
transformers
peft
flash-attn
https://github.com/Dao-AILab/flash-attention/releases/download/v2.5.9.post1/flash_attn-2.5.9.post1+cu122torch2.3cxx11abiFALSE-cp310-cp310-linux_x86_64.whl