ikawrakow
/

various-2bit-sota-gguf

Inference Endpoints

Model card Files Files and versions Community

various-2bit-sota-gguf / README.md

ikawrakow's picture

Update README.md

5c2dcb5 10 months ago

|

156 Bytes

	---
	license: apache-2.0
	---
	Various models in GGUF format quantized with a new 2-bit approach. Intended for use with llama.cpp. Requires llama.cpp PR 4773.