Edit Models filters

Model Tree

meta-llama/Llama-2-70b-chat-hf

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

8

Full-text search

Active filters: meta-llama/Llama-2-70b-chat-hf

TheBloke/Llama-2-70B-Chat-GGUF

Text Generation • Updated Nov 21, 2023 • 9.1k • 122

mlc-ai/Llama-2-70b-chat-hf-q4f16_1-MLC

Updated Jul 11 • 8 • 2

TheBloke/Llama-2-70B-Chat-GPTQ

Text Generation • Updated Sep 27, 2023 • 9.68k • 260

TheBloke/Llama-2-70B-Chat-AWQ

Text Generation • Updated Nov 9, 2023 • 5.3k • 23

jamesdborin/llama2-70b-chat-4bit-AWQ

Text Generation • Updated Dec 11, 2023 • 20 • 1

softmax/Llama-2-70b-chat-hf-marlin

Text Generation • Updated Mar 17 • 471

strangervb/Llama-2-70B-Chat-GPTQ-2

Text Generation • Updated Mar 25 • 18

TitanML/llama2-70b-chat-4bit-AWQ

Text Generation • Updated Apr 24 • 20