Edit Models filters

Inference status

Misc

AutoTrain Compatible

text-generation-inference

Inference Endpoints

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

1,425

Full-text search

Active filters: 5-bit

LoneStriker/Qwen2.5-14B-Instruct-5.0bpw-h6-exl2

Text Generation • Updated Sep 19 • 11

LoneStriker/Qwen2.5-32B-Instruct-5.0bpw-h6-exl2

Text Generation • Updated Sep 19 • 18

Zoyd/Qwen_Qwen2.5-14B-Instruct-5_0bpw_exl2

Text Generation • Updated Sep 19 • 6

DrNicefellow/Qwen2.5-32B-Instruct-5.0bpw-exl2

Updated Sep 19 • 9

NobodySpecial/Qwen2.5-72B-exl2-5.0bpw

Text Generation • Updated Sep 20 • 103 • 2

DrNicefellow/Qwen2.5-7B-Instruct-5.0bpw-exl2

Updated Sep 20 • 3

DrNicefellow/Qwen2.5-14B-Instruct-5.0bpw-exl2

Updated Sep 21 • 4

DrNicefellow/Qwen2.5-Coder-7B-Instruct-5.0bpw-exl2

Updated Sep 21 • 8

DrNicefellow/Qwen2.5-Math-7B-Instruct-5.0bpw-exl2

Updated Sep 21 • 5

MikeRoz/ArliAI_Llama-3.1-70B-ArliAI-RPMax-v1.1-5.0bpw-h6-exl2

Updated Sep 27 • 3

BigHuggyD/gghfez_SmartMaid-123b_exl2_5.0bpw_h6

Updated Sep 28 • 3

riveRiPH/Lyra4-Gutenberg2-12B-5bpw-h6-exl2

Text Generation • Updated Sep 30 • 8

SicariusSicariiStuff/Impish_LLAMA_3B-EXL2-5.0bpw

Updated Oct 1 • 1

Kotokin/Magnum-v1-72b-Qwen2.5-5bpw

Updated Oct 4 • 7

altomek/Llama-3.1-70B-Instruct-5bpw-EXL2

Text Generation • Updated Oct 10 • 5

MikeRoz/TheDrummer_Behemoth-123B-v1-5.0bpw-h6-exl2

Updated Oct 10 • 41 • 3

schnapper79/lumikabra-behemoth-123b-exl2-5.0bpw

Text Generation • Updated Oct 11 • 22

BigHuggyD/TheDrummer_Behemoth-123B-v1_exl2_5.0bpw_h6

Updated Oct 11 • 2

SicariusSicariiStuff/LLAMA-3_8B_Unaligned_BETA_EXL2-5.0-bpw

Updated Oct 11 • 5

Ya211/llamaEXL

Text Generation • Updated Oct 13 • 6

schnapper79/lumikabra_behemoth_195b-exl2-5.0bpw

Text Generation • Updated Oct 14 • 6

schnapper79/lumikabra_behemoth_195B_v2-exl2-5.0bpw

Text Generation • Updated Oct 16 • 11 • 1

MaziyarPanahi/Llama-3.1-Nemotron-70B-Instruct-HF-GGUF

Text Generation • Updated Oct 17 • 772 • 3

softwareweaver/Twilight-Large-123B-EXL2-5bpw

Text Generation • Updated Oct 17 • 14 • 1

BigHuggyD/schnapper79_lumikabra-195B_v0.3_exl2_5.0bpw_h6

Text Generation • Updated Oct 18 • 6

MaziyarPanahi/Chocolatine-3B-Instruct-DPO-Revised-GGUF

Text Generation • Updated Oct 20 • 50

MaziyarPanahi/Chocolatine-3B-Instruct-DPO-v1.2-GGUF

Text Generation • Updated Oct 20 • 188

MaziyarPanahi/Phi-3-mini-4K-instruct-cpo-simpo-GGUF

Text Generation • Updated Oct 20 • 85

MaziyarPanahi/Nemotron-Mini-4B-Instruct-GGUF

Text Generation • Updated Oct 20 • 447 • 1

Proverbial1/magnum-v4-123b_exl2_5.0bpw_h8

Text Generation • Updated Oct 21 • 17