Edit Models filters

Inference status

Misc

4-bit precision

8-bit precision

text-generation-inference

AutoTrain Compatible

Inference Endpoints

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

1,733

Full-text search

Active filters: quantized

MaziyarPanahi/granite-3.0-8b-instruct-GGUF

Text Generation • Updated Oct 24 • 758 • 1

MaziyarPanahi/L3-Nymeria-8B-GGUF

Text Generation • Updated 26 days ago • 317 • 3

MaziyarPanahi/DarkIdol-Llama-3.1-8B-Instruct-1.1-Uncensored-GGUF

Text Generation • Updated 26 days ago • 257 • 2

joshmiller656/Llama-3.1-Nemotron-70B-Instruct-AWQ-INT4

Text Generation • Updated 18 days ago • 2.91k • 2

MaziyarPanahi/cybertron-v4-qw7B-MGS-GGUF

Text Generation • Updated 25 days ago • 270 • 1

MaziyarPanahi/Qwen2.5-Coder-7B-Instruct-abliterated-GGUF

Text Generation • Updated 25 days ago • 281 • 1

MaziyarPanahi/Qwen2.5-7B-Instruct-abliterated-v2-GGUF

Text Generation • Updated 24 days ago • 305 • 1

MaziyarPanahi/uncertain_mistral_7b-GGUF

Text Generation • Updated 23 days ago • 102 • 1

MaziyarPanahi/SmolLM2-1.7B-Instruct-GGUF

Text Generation • Updated 20 days ago • 764k • 3

MaziyarPanahi/Llama-3.2-3B-Apex-GGUF

Text Generation • Updated 22 days ago • 165 • 3

MaziyarPanahi/L3.2-Rogue-Creative-Instruct-Uncensored-Abliterated-7B-GGUF

Text Generation • Updated 22 days ago • 444 • 1

MaziyarPanahi/L3.1-Promissum_Mane-8B-Della-1.5-calc-GGUF

Text Generation • Updated 22 days ago • 137 • 1

MaziyarPanahi/uncertain_llama3_8b-GGUF

Text Generation • Updated 22 days ago • 128 • 1

MaziyarPanahi/Llama-3.2-3B-bf16-GGUF

Text Generation • Updated 21 days ago • 229 • 1

MaziyarPanahi/EZO-Llama-3.2-3B-Instruct-dpoE-GGUF

Text Generation • Updated 21 days ago • 132 • 1

MaziyarPanahi/Llama-3-8B-Stroganoff-4.0-GGUF

Text Generation • Updated 21 days ago • 128 • 1

MaziyarPanahi/Llama-3.1-8B-Instruct-Fei-v1-Uncensored-GGUF

Text Generation • Updated 21 days ago • 295 • 1

MaziyarPanahi/SmolLM2-360M-Instruct-GGUF

Text Generation • Updated 20 days ago • 307k • 2

MaziyarPanahi/BioMistral-Clinical-7B-GGUF

Text Generation • Updated 17 days ago • 685 • 1

MaziyarPanahi/Mistral-Crab-DPO-GGUF

Text Generation • Updated 17 days ago • 167 • 2

MaziyarPanahi/MN-Tiramisu-12B-GGUF

Text Generation • Updated 16 days ago • 161 • 1

MaziyarPanahi/calme-3.1-instruct-3b-GGUF

Text Generation • Updated 8 days ago • 15.2k • 1

MaziyarPanahi/calme-3.3-instruct-3b-GGUF

Text Generation • Updated 8 days ago • 15.2k • 1

MaziyarPanahi/calme-3.1-qwenloi-3b-GGUF

Text Generation • Updated 8 days ago • 15k • 1

MaziyarPanahi/calme-3.2-llamaloi-3b-GGUF

Text Generation • Updated 8 days ago • 15.1k • 1

shreyasmeher/ConflLlama

Text Classification • Updated 9 days ago • 372 • 1

AstroMLab/AstroSage-8B-GGUF

Text Generation • Updated 7 days ago • 218 • 1

MaziyarPanahi/Mistral-Large-Instruct-2411-GGUF

Text Generation • Updated 3 days ago • 17.5k • 1

Lewdiculous/InfinityRP-v1-7B-GGUF-IQ-Imatrix

Updated May 4 • 638 • 42

ravenscroftj/CodeGen-350M-multi-ggml-quant

Text Generation • Updated Apr 24, 2023 • 2