requirements.txt

flash_attn
accelerate
git+https://github.com/huggingface/transformers.git@main