unsloth
/

Meta-Llama-3.1-70B-bnb-4bit

Text Generation

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

Meta-Llama-3.1-70B-bnb-4bit / generation_config.json

Commit History

Upload config

f5aad55
verified

danielhanchen commited on Aug 7

Upload config

1f9629b
verified

danielhanchen commited on Aug 6

Update generation_config.json

2ca18fe
verified

danielhanchen commited on Jul 25

Upload LlamaForCausalLM

0d886a8
verified

danielhanchen commited on Jul 23