Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

1,403

Full-text search

Active filters: instruct

Enderchef/ICONN

Question Answering • Updated Aug 18

mradermacher/Einstein-v4-7B-GGUF

Updated Jul 19 • 102

mradermacher/Einstein-v4-7B-i1-GGUF

Updated Aug 2 • 291

mradermacher/Conn-1.0-4K-Chat-GGUF

Updated Jul 20 • 178

pek111/llama-3-typhoon-v1.5-8b-instruct-GGUF

Text Generation • Updated Jul 24 • 130

pbatralx/Hermes-2-Theta-Llama-3-8B-GGUF

Text Generation • Updated Jul 23

ModelCloud/Meta-Llama-3.1-8B-Instruct-gptq-4bit

Text Generation • Updated Jul 29 • 162 • 3

ModelCloud/Meta-Llama-3.1-70B-Instruct-gptq-4bit

Text Generation • Updated Jul 27 • 238 • 4

ValiantLabs/Llama3.1-8B-Fireplace2

Text Generation • Updated Sep 1 • 557 • 6

Gryphe/Pantheon-RP-1.5-12b-Nemo

Text Generation • Updated Aug 5 • 44 • 27

ModelCloud/Mistral-Large-Instruct-2407-gptq-4bit

Text Generation • Updated Jul 26 • 537 • 1

mradermacher/Mistral-Syndicate-7B-GGUF

Updated Jul 27 • 73

mradermacher/Mistral-Syndicate-7B-i1-GGUF

Updated Aug 2 • 81

mudler/Llama3.1-8B-Fireplace2-Q4_K_M-GGUF

Text Generation • Updated Jul 27 • 61

artificialguybr/Meta-Llama-3.1-8B-openhermes-2.5

Text Generation • Updated Aug 2 • 528 • 5

DarkClaw42/Llama-3-Translation-8B-v0.180-Q4_K_M-GGUF

Text Generation • Updated Jul 28 • 19

DarkClaw42/Llama-3-Translation-8B-v0.180-Q5_K_M-GGUF

Text Generation • Updated Jul 28 • 14

GPT4All-Community/Hermes-2-Pro-Llama-3-8B-GGUF

Updated Aug 12 • 1.21k • 1

genevera/Medical-Llama3-8B-Q5_K_M-GGUF

Updated Jul 30 • 4

genevera/Medical-Llama3-8B-Q6_K-GGUF

Updated Jul 30 • 23

ModelCloud/Meta-Llama-3.1-405B-Instruct-gptq-4bit

Text Generation • Updated Jul 30 • 12 • 2

justinthelaw/Hermes-2-Pro-Mistral-7B-4bit-32g-GPTQ

Text Generation • Updated Aug 2 • 13 • 1

monsterapi/Llama-3_1-8B-Instruct-orca-ORPO

Updated Aug 9 • 18 • 1

darkshapes/pygmalion-2-7b-gguf

Text Generation • Updated Aug 4 • 27

pszemraj/nanoT5-mid-2k-instruct

Text2Text Generation • Updated Aug 9 • 6

adrlau/Llama3.1-8B-Fireplace2-Q4_K_M-GGUF

Text Generation • Updated Aug 2 • 6

bartowski/Palmyra-Med-70B-32K-GGUF

Text Generation • Updated Aug 5 • 267 • 1

defenseunicorns/Hermes-2-Pro-Mistral-7B-4bit-32g-GPTQ

Text Generation • Updated Aug 2 • 14

bartowski/Palmyra-Fin-70B-32K-GGUF

Text Generation • Updated Aug 5 • 567 • 2

mlx-community/Writer-Palmyra-Fin-70B-32K

Updated Aug 4 • 7 • 1