"Give Me BF16 or Give Me Death"? Accuracy-Performance Trade-Offs in LLM Quantization
Paper
•
2411.02355
•
Published
•
44
Eliza Wszola
EliWsz
AI & ML interests
None yet
Recent Activity
upvoted
a
paper
15 days ago
updated
a model
23 days ago
nm-testing/Llama-3.2-1B-Instruct-HQQ
Organizations
