kaitchup
/

Llama-3.1-Minitron-4B-Width-Base-AutoRound-GPTQ-asym-4bit

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Llama-3.1-Minitron-4B-Width-Base-AutoRound-GPTQ-asym-4bit

Commit History

Update README.md

76efa40
verified

bnjmnmarie commited on Aug 26

Upload LlamaForCausalLM

e628039
verified

bnjmnmarie commited on Aug 25

Upload tokenizer

d61f7e6
verified

bnjmnmarie commited on Aug 25

initial commit

0a0aede
verified

bnjmnmarie commited on Aug 25