The Impact of Hyperparameters on Large Language Model Inference Performance: An Evaluation of vLLM and HuggingFace Pipelines
Paper
•
2408.01050
•
Published
•
8
Matias Martinez
martinezmatias
AI & ML interests
AI-based software engineering researcher and senior software engineer.
Organizations
