Edit Models filters

Inference status

Misc

4-bit precision

8-bit precision

text-generation-inference

AutoTrain Compatible

Inference Endpoints

Mixture of Experts

Carbon Emissions

text-embeddings-inference

Models

1,734

Full-text search

Active filters: quantized

afrideva/TinyLlama-haiku-dpo-v.0.1-GGUF

Text Generation • Updated Jan 19 • 114

MaziyarPanahi/Breeze-7B-Instruct-v0_1-GPTQ

Text Generation • Updated Jan 19 • 6 • 2

afrideva/tinyllama-python-GGUF

Text Generation • Updated Jan 20 • 128

afrideva/phi-2-psy-GGUF

Text Generation • Updated Jan 20 • 33 • 6

afrideva/beecoder-220M-python-GGUF

Text Generation • Updated Jan 20 • 87

afrideva/smol_llama-220M-openhermes-GGUF

Text Generation • Updated Jan 20 • 112

afrideva/TinyLlama-3T-1.1bee-GGUF

Text Generation • Updated Jan 20 • 64 • 1

afrideva/smol_llama-220M-bees-internal-GGUF

Text Generation • Updated Jan 20 • 72

afrideva/smol_llama-220M-open_instruct-GGUF

Text Generation • Updated Jan 20 • 50

afrideva/zephyr-220m-sft-full-GGUF

Text Generation • Updated Jan 20 • 125

afrideva/zephyr-220m-dpo-full-GGUF

Text Generation • Updated Jan 20 • 62

MaziyarPanahi/MoMo-72B-lora-1.8.7-DPO-GPTQ

Text Generation • Updated Jan 22 • 18 • 7

afrideva/stablelm-2-1_6b-GGUF

Text Generation • Updated Jan 22 • 222 • 3

afrideva/stablelm-2-zephyr-1_6b-GGUF

Text Generation • Updated Jan 22 • 64 • 3

solidrust/WestLake-7B-v2-AWQ

Text Generation • Updated Feb 29 • 18 • 4

MaziyarPanahi/phi-2-GGUF

Text Generation • Updated Jan 26 • 145 • 6

MaziyarPanahi/Tess-XS-v1-3-yarn-128K-Mistral-7B-Instruct-v0.1-GGUF

Text Generation • Updated Jan 26 • 103 • 6

MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.1-GGUF

Text Generation • Updated Jan 26 • 48 • 4

MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.2-GGUF

Text Generation • Updated Jan 30 • 74 • 5

MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.2-GPTQ

Text Generation • Updated Jan 23 • 8

MaziyarPanahi/zephyr-7b-beta-Mistral-7B-Instruct-v0.1-GPTQ

Text Generation • Updated Jan 23 • 5

MaziyarPanahi/NeuralPipe-7B-slerp-GGUF

Text Generation • Updated Jan 26 • 74 • 3

MaziyarPanahi/NeuralPipe-7B-slerp-v0.2-GGUF

Text Generation • Updated Jan 26 • 61 • 2

MaziyarPanahi/Mistral-7B-Instruct-v0.1-16k-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • Updated Jan 26 • 114 • 2

MaziyarPanahi/rfp_instruct_model-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • Updated Jan 26 • 120 • 2

MaziyarPanahi/Mistral-7B-Instruct-SQL-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • Updated Jan 26 • 113 • 1

MaziyarPanahi/mistral-7B-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • Updated Jan 26 • 49 • 1

MaziyarPanahi/tiledfloor-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • Updated Jan 26 • 53 • 1

MaziyarPanahi/Mistral-11B-Instruct-v0.2-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • Updated Jan 26 • 100 • 1

MaziyarPanahi/Commonsense-QA-Mistral-7B-Mistral-7B-Instruct-v0.2-slerp-GGUF

Text Generation • Updated Jan 26 • 72 • 1