Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

111

Full-text search

Active filters: autoquant

jcorenday/Daredevil-8B-GPTQ

Text Generation • Updated Jul 10 • 10

cowWhySo/NeuralDaredevil-7B-5.0bpw-exl2

mlabonne/NeuralDaredevil-8B-abliterated-4.5bpw-exl2

mlabonne/NeuralDaredevil-8B-abliterated-AWQ

Text Generation • Updated Jul 28 • 33

Pushpendra817/SDXL-Captioner-GGUF

Image-Text-to-Text • Updated Aug 1 • 1

iqbalamo93/Meta-Llama-3.1-8B-Instruct-GPTQ-Q_8

Text Generation • Updated Sep 14 • 720 • 3

jeremierostan/gemma-2-2b-it-GGUF

Text Generation • Updated Aug 3 • 11

jeremierostan/Meta-Llama-3.1-8B-Instruct-GGUF

Text Generation • Updated Aug 3 • 39

jeremierostan/Meta-Llama-3.1-8B-GGUF

Text Generation • Updated Aug 3 • 38

neifuisan/gemma-2b-it-GGUF

Updated Aug 5 • 20

Corianas/mistral-7b-expert-iteration-iter3-GPTQ

Corianas/mistral-7b-expert-iteration-iter3-GGUF

Updated Aug 19 • 9

hassu619/Llama-2-7b-chat-finetune_UNI-GGML

Question Answering • Updated Aug 20 • 1

Corianas/gpt-j-6B-Dolly-GGUF

bebechien/gemma-2-2b-GGUF

Text Generation • Updated Aug 21 • 47

bebechien/gemma-2-2b-GPTQ

Text Generation • Updated Aug 21 • 14

bebechien/gemma-2-2b-4.5bpw-exl2

Text Generation • Updated Aug 21

Mardiyyah/Llama3-OpenBioLLM-8B-GGUF

Updated Aug 22 • 60 • 1

Corianas/Llama-3-Instruct-8B-SPPO-Iter3-8-32-GPTQ

Text Generation • Updated Aug 25 • 9

Corianas/Mistral7B-PairRM-SPPO-Iter3-4-32-GPTQ

Text Generation • Updated Aug 25 • 7

Corianas/Mistral7B-PairRM-SPPO-Iter3-4-64-GPTQ

Text Generation • Updated Aug 25 • 8

Corianas/Mistral7B-PairRM-SPPO-Iter3-4-128-GPTQ

Text Generation • Updated Aug 25 • 5

Corianas/Mistral7B-PairRM-SPPO-Iter3-8-32-GPTQ

Text Generation • Updated Aug 25 • 9

Corianas/Mistral7B-PairRM-SPPO-Iter3-8bit-64GSize-GPTQ

Text Generation • Updated Aug 25 • 8

Corianas/Mistral7B-PairRM-SPPO-Iter3-8-128-GPTQ

Text Generation • Updated Aug 25 • 7

Corianas/Llama-3-Instruct-8B-SPPO-Iter3-4-32-GPTQ

Text Generation • Updated Aug 25 • 12

Corianas/Llama-3-Instruct-8B-SPPO-Iter3-4-64-GPTQ

Text Generation • Updated Aug 25 • 10

speakleash/Bielik-11B-v2.2-Instruct-onnx-fp16

Text Generation • Updated Oct 7 • 39 • 1

pansophic/pansophic-1-preview-LLaMA3.1-8b-GPTQ

Text Generation • Updated Sep 5 • 15 • 1

Kukedlc/NeuralGemma-2B-Slerp-GGUF

Updated Sep 5 • 27