Edit Models filters

Inference status

Misc

Inference Endpoints

text-generation-inference

AutoTrain Compatible

4-bit precision

Misc with no match

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

145

Full-text search

Active filters: llama-3.1

hugging-quants/Meta-Llama-3.1-8B-Instruct-BNB-NF4

Text Generation • Updated Aug 8 • 1.51k • 7

hugging-quants/Meta-Llama-3.1-8B-BNB-NF4

Text Generation • Updated Aug 8 • 543

ModelCloud/Meta-Llama-3.1-8B-Instruct-gptq-4bit

Text Generation • Updated Jul 29 • 151 • 3

brittlewis12/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated Jul 27 • 253 • 1

ModelCloud/Meta-Llama-3.1-8B-gptq-4bit

Text Generation • Updated Jul 26 • 42

ModelCloud/Meta-Llama-3.1-70B-Instruct-gptq-4bit

Text Generation • Updated Jul 27 • 223 • 4

ValiantLabs/Llama3.1-8B-Fireplace2

Text Generation • Updated Sep 1 • 515 • 6

OpenBuddy/openbuddy-llama3.1-8b-v22.1-131k

Text Generation • Updated Jul 24 • 314 • 5

sunnyyy/openbuddy-llama3.1-8b-v22.1-131k-Q4_K_M-GGUF

Text Generation • Updated Jul 25 • 21

jburmeister/Meta-Llama-3.1-70B-Instruct-AWQ-INT4

Text Generation • Updated Jul 25 • 31

jburmeister/Meta-Llama-3.1-405B-Instruct-AWQ-INT4

Text Generation • Updated Jul 25 • 4

azhiboedova/Meta-Llama-3.1-8B-Instruct-AQLM-2Bit-1x16

Text Generation • Updated Aug 28 • 754 • 13

mudler/Llama3.1-8B-Fireplace2-Q4_K_M-GGUF

Text Generation • Updated Jul 27 • 61

mradermacher/Configurable-Llama-3.1-8B-Instruct-GGUF

Updated Jul 29 • 157

OpenBuddy/openbuddy-llama3.1-8b-v22.2-131k

Text Generation • Updated Aug 11 • 353 • 2

mradermacher/openbuddy-llama3.1-8b-v22.1-131k-GGUF

Updated Jul 29 • 256

mradermacher/openbuddy-llama3.1-8b-v22.2-131k-GGUF

Updated Jul 28 • 203

hugging-quants/Meta-Llama-3.1-405B-BNB-NF4-BF16

Text Generation • Updated Sep 16 • 1.12k • 2

hugging-quants/Meta-Llama-3.1-8B-BNB-NF4-BF16

Text Generation • Updated Jul 28 • 964

hugging-quants/Meta-Llama-3.1-70B-BNB-NF4-BF16

Text Generation • Updated Aug 8 • 988 • 2

mradermacher/openbuddy-llama3.1-8b-v22.2-131k-i1-GGUF

Updated Aug 2 • 333 • 1

mradermacher/openbuddy-llama3.1-8b-v22.1-131k-i1-GGUF

Updated Aug 2 • 629

Cran-May/openbuddy-llama3.1-8b-v22.2-131k-Q4_K_M-GGUF

Text Generation • Updated Jul 29 • 10 • 1

mradermacher/Configurable-Llama-3.1-8B-Instruct-i1-GGUF

Updated Aug 2 • 372

ModelCloud/Meta-Llama-3.1-405B-Instruct-gptq-4bit

Text Generation • Updated Jul 30 • 8 • 2

Kalei/Meta-Llama-3.1-70B-Instruct-AWQ-INT4-Custom

Text Generation • Updated Jul 31 • 9

hierholzer/Llama-3.1-70B-Instruct-GGUF

Text Generation • Updated Aug 19 • 236 • 3

adrlau/Llama3.1-8B-Fireplace2-Q4_K_M-GGUF

Text Generation • Updated Aug 2 • 8

anhbn/Meta-Llama-3.1-70B-Instruct-AWQ-INT4

Text Generation • Updated Aug 7 • 6

DimensionSTP/Llama-3.1-8B-Instruct-open-Korean

Text Generation • Updated Aug 7 • 15