Daniël de Kok's picture

1 1 1

Daniël de Kok

danieldk

·

https://danieldk.eu/

AI & ML interests

Fast, low-level ML code, model implementation

Organizations

danieldk's activity

upvoted a collection 4 months ago

Llama 3.1 GPTQ, AWQ, and BNB Quants

Optimised Quants for high-throughput deployments! Compatible with Transformers, TGI & VLLM 🤗 • 9 items • Updated Sep 26 • 54