Edit Models filters

Inference status

Misc

text-generation-inference

AutoTrain Compatible

Inference Endpoints

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

1,266

Full-text search

Active filters: 6-bit

MaziyarPanahi/Llama-3.2-3B-Instruct-GGUF

Text Generation • Updated 7 days ago • 298 • 3

Statuo/NemoMix-Unleashed-EXL2-6bpw

Text Generation • Updated Aug 23 • 62 • 3

MaziyarPanahi/dolphin-2.5-mixtral-8x7b-GGUF

Text Generation • Updated Feb 4 • 361 • 4

MaziyarPanahi/BioMistral-7B-GGUF

Text Generation • Updated Feb 19 • 968 • 44

MaziyarPanahi/WizardLM-2-8x22B-GGUF

Text Generation • Updated Apr 16 • 1.12k • 117

MaziyarPanahi/DeepSeek-V2.5-GGUF

Text Generation • Updated 21 days ago • 401 • 3

riveRiPH/MN-12B-Lyra-v4-6bpw-h8-exl2

Updated 23 days ago • 14 • 2

MaziyarPanahi/solar-pro-preview-instruct-GGUF

Text Generation • Updated 19 days ago • 8.77k • 16

Statuo/MS-Cydonia-22b-6bpw

Updated 14 days ago • 23 • 1

LoneStriker/Qwen2.5-32B-Instruct-6.0bpw-h6-exl2

Text Generation • Updated 13 days ago • 11 • 1

LoneStriker/Qwen2.5-72B-Instruct-6.0bpw-h6-exl2

Text Generation • Updated 13 days ago • 22 • 3

MaziyarPanahi/Llama-3.2-1B-Instruct-GGUF

Text Generation • Updated 7 days ago • 16.1k • 1

MikeRoz/ArliAI_Mistral-Small-22B-ArliAI-RPMax-v1.1-6.0bpw-h6-exl2

Updated 6 days ago • 45 • 1

NeoChen1024/gemma-2-9B-it-advanced-v2.1-exl2-6.0bpw-h8

Text Generation • Updated 6 days ago • 6 • 1

Kotokin/Replete-LLM-V2.5-Qwen-72b-exl2-6bpw

Text Generation • Updated about 22 hours ago • 5 • 1

LoneStriker/Yi-6B-200K-6.0bpw-h6-exl2

Text Generation • Updated Mar 16 • 7 • 1

MaziyarPanahi/phi-2-GGUF

Text Generation • Updated Jan 26 • 382 • 6

MaziyarPanahi/Tess-XS-v1-3-yarn-128K-Mistral-7B-Instruct-v0.1-GGUF

Text Generation • Updated Jan 26 • 221 • 6

MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.1-GGUF

Text Generation • Updated Jan 26 • 277 • 4

MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.2-GGUF

Text Generation • Updated Jan 30 • 281 • 5

MaziyarPanahi/NeuralPipe-7B-slerp-GGUF

Text Generation • Updated Jan 26 • 171 • 3

MaziyarPanahi/NeuralPipe-7B-slerp-v0.2-GGUF

Text Generation • Updated Jan 26 • 227 • 2

MaziyarPanahi/Mistral-7B-Instruct-v0.1-16k-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • Updated Jan 26 • 226 • 2

MaziyarPanahi/rfp_instruct_model-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • Updated Jan 26 • 181 • 2

MaziyarPanahi/Mistral-7B-Instruct-SQL-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • Updated Jan 26 • 227 • 1

MaziyarPanahi/mistral-7B-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • Updated Jan 26 • 257 • 1

MaziyarPanahi/tiledfloor-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • Updated Jan 26 • 144 • 1

MaziyarPanahi/Mistral-11B-Instruct-v0.2-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • Updated Jan 26 • 184 • 1

MaziyarPanahi/Commonsense-QA-Mistral-7B-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • Updated Jan 26 • 206 • 1

MaziyarPanahi/BASH-Coder-Mistral-7B-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • Updated Jan 26 • 230 • 2