"Give Me BF16 or Give Me Death"? Accuracy-Performance Trade-Offs in LLM Quantization
Paper
β’
2411.02355
β’
Published
β’
44
Thomas Lazarus PRO
lazarustda
AI & ML interests
None yet
Recent Activity
upvoted
a
paper
17 days ago
"Give Me BF16 or Give Me Death"? Accuracy-Performance Trade-Offs in LLM
Quantization
Organizations
lazarustda's activity
upvoted
a
paper
17 days ago
Reacted to
victor's
post with π₯
3 months ago
Post
5449
π Calling all Hugging Face users! We want to hear from YOU!
What feature or improvement would make the biggest impact on Hugging Face?
Whether it's the Hub, better documentation, new integrations, or something completely different β we're all ears!
Your feedback shapes the future of Hugging Face. Drop your ideas in the comments below! π
What feature or improvement would make the biggest impact on Hugging Face?
Whether it's the Hub, better documentation, new integrations, or something completely different β we're all ears!
Your feedback shapes the future of Hugging Face. Drop your ideas in the comments below! π
- 154 replies
Reacted to
merve's
post with π
4 months ago
Post
3656
At Hugging Face we have an open-source Cookbook with many applied AI recipes π
Here are some of the latest recipes contributed β₯₯
- "Information Extraction with Haystack and NuExtract": Use Haystack and transformers to build structured data extraction pipelines using LLMs by @anakin87 https://huggingface.co/learn/cookbook/en/information_extraction_haystack_nuextract
- "Build RAG with Hugging Face and Milvus": Learn how to use Milvus with sentence transformers to build RAG pipelines https://huggingface.co/learn/cookbook/rag_with_hf_and_milvus
- "Code Search with Vector Embeddings and Qdrant": Search a codebase by building a retrieval pipeline using Qdrant and sentence transformers https://huggingface.co/learn/cookbook/code_search
- Data analyst agent: get your dataβs insights in the blink of an eye β¨: great recipe by our own @m-ric showing how to build an agent that can do data analysis! π± https://huggingface.co/learn/cookbook/agent_data_analyst
Here are some of the latest recipes contributed β₯₯
- "Information Extraction with Haystack and NuExtract": Use Haystack and transformers to build structured data extraction pipelines using LLMs by @anakin87 https://huggingface.co/learn/cookbook/en/information_extraction_haystack_nuextract
- "Build RAG with Hugging Face and Milvus": Learn how to use Milvus with sentence transformers to build RAG pipelines https://huggingface.co/learn/cookbook/rag_with_hf_and_milvus
- "Code Search with Vector Embeddings and Qdrant": Search a codebase by building a retrieval pipeline using Qdrant and sentence transformers https://huggingface.co/learn/cookbook/code_search
- Data analyst agent: get your dataβs insights in the blink of an eye β¨: great recipe by our own @m-ric showing how to build an agent that can do data analysis! π± https://huggingface.co/learn/cookbook/agent_data_analyst
upvoted
an
article
4 months ago
Article
Inference for PROs
β’
50
liked
3
models
4 months ago
upvoted
an
article
5 months ago
Article
𧨠Diffusers welcomes Stable Diffusion 3
β’
92
upvoted
2
collections
7 months ago
liked
a
model
7 months ago
Upload folder using huggingface_hub
1
#1 opened 7 months ago
by
lazarustda
lazarustda
updated
a
model
7 months ago
upvoted
an
article
7 months ago
Article
StarCoder2-Instruct: Fully Transparent and Permissive Self-Alignment for Code Generation
β’
75
liked
a
model
7 months ago
liked
a
Space
7 months ago
upvoted
a
collection
7 months ago
upvoted
an
article
7 months ago
Article
LLM Comparison/Test: Llama 3 Instruct 70B + 8B HF/GGUF/EXL2 (20 versions tested and compared!)
By
β’
β’
59
liked
a
model
7 months ago
Reacted to
fdaudens's
post with π
7 months ago
Post
4005
Open-source AI on your phone? The HuggingChat app is out for iOs, with the best models: Command R, Zephyr Orpo, Mixtral, Gemma... https://apps.apple.com/ca/app/huggingchat/id6476778843?l=fr-CA
- 2 replies