Esperanto
/

llama3.1-8b-Instruct-kvc-AWQ-int4-onnx

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

llama3.1-8b-Instruct-kvc-AWQ-int4-onnx / model.layers.0.self_attn.k_proj.scales

Commit History

Added model and tokenizer

4a00c78

ericsorides commited on 22 days ago