Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

Mixture of Experts

8-bit precision

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

474

Full-text search

Active filters: DPO

blockblockblock/Hermes-2-Pro-Llama-3-8B-bpw4-exl2

Text Generation • Updated May 3 • 8

blockblockblock/Hermes-2-Pro-Llama-3-8B-bpw4.2-exl2

Text Generation • Updated May 3 • 3

blockblockblock/Hermes-2-Pro-Llama-3-8B-bpw4.4-exl2

Text Generation • Updated May 3 • 6

blockblockblock/Hermes-2-Pro-Llama-3-8B-bpw4.6-exl2

Text Generation • Updated May 3 • 11

blockblockblock/Hermes-2-Pro-Llama-3-8B-bpw4.8-exl2

Text Generation • Updated May 3 • 8

blockblockblock/Hermes-2-Pro-Llama-3-8B-bpw5-exl2

Text Generation • Updated May 3 • 6

blockblockblock/Hermes-2-Pro-Llama-3-8B-bpw5.5-exl2

Text Generation • Updated May 3 • 6

blockblockblock/Hermes-2-Pro-Llama-3-8B-bpw6-exl2

Text Generation • Updated May 3 • 7

batmac/Hermes-2-Pro-Llama-3-8B-mlx-4bit

Updated May 3 • 1

QuantFactory/Hermes-2-Pro-Llama-3-8B-GGUF

Text Generation • Updated May 4 • 377

alejandrovil/llama3-AWQ

Text Generation • Updated May 23 • 8

MoMonir/Hermes-2-Pro-Llama-3-8B-GGUF

Updated May 3 • 13 • 1

MoMonir/Llama3-OpenBioLLM-8B-GGUF

Updated May 4 • 152 • 1

blockblockblock/Llama3-OpenBioLLM-70B-bpw4-exl2

Text Generation • Updated May 4 • 13

LiteLLMs/Hermes-2-Pro-Llama-3-8B-GGUF

Updated May 6 • 215

NicholasJohn/OpenBioLLM-Llama3-8B-Q5_K_M.gguf

Updated May 7 • 4 • 1

alexcovo/Hermes-2-Pro-Llama-3-8B-Q4_0-GGUF

Updated May 8 • 49

fakezeta/Llama3-OpenBioLLM-8B-ov-int8

Text Generation • Updated May 10 • 6

quanthunter/Hermes-2-Pro-Mistral-7B-Q8_0-GGUF

Updated May 10 • 6

quanthunter/Hermes-2-Pro-Mistral-7B-Q6_K-GGUF

Updated May 10 • 3

quanthunter/Hermes-2-Pro-Mistral-7B-Q5_K_M-GGUF

Updated May 10 • 6

quanthunter/Hermes-2-Pro-Mistral-7B-Q4_K_M-GGUF

Updated May 10 • 3

tinybiggames/Hermes-2-Pro-Llama-3-8B-Q4_K_M-GGUF

Updated Jun 6 • 11 • 1

quanthunter/Hermes-2-Pro-Llama-3-8B-Q8_0-GGUF

Updated May 14 • 6

quanthunter/Hermes-2-Pro-Llama-3-8B-Q6_K-GGUF

Updated May 14 • 9

quanthunter/Hermes-2-Pro-Llama-3-8B-Q5_K_M-GGUF

Updated May 14 • 4

quanthunter/Hermes-2-Pro-Llama-3-8B-Q4_K_M-GGUF

Updated May 14 • 4

newsletter/DiscoLM_German_7b_v1-Q6_K-GGUF

Updated Jun 6 • 11

bartowski/Hermes-2-Theta-Llama-3-8B-exl2

Text Generation • Updated May 15 • 6 • 2

typealias/Hermes-2-Theta-Llama-3-8B-mlx-4bit

Updated May 16 • 3