torch
transformers==4.37.2
accelerate
auto-gptq
optimum