"Give Me BF16 or Give Me Death"? Accuracy-Performance Trade-Offs in LLM Quantization
Paper
•
2411.02355
•
Published
•
44
Kyle Sayers
kylesayrs
·
AI & ML interests
None yet
Recent Activity
upvoted
a
paper
20 days ago
"Give Me BF16 or Give Me Death"? Accuracy-Performance Trade-Offs in LLM
Quantization
updated
a model
about 2 months ago
nm-testing/tinyllama-one-shot-w4a16-group-packed
Organizations
