torch
transformers>=4.39.1
bitsandbytes
accelerate
tokenizers
pydantic
fastapi
uvicorn