Edit Models filters

Inference status

Misc

8-bit precision

AutoTrain Compatible

Inference Endpoints

text-generation-inference

4-bit precision

Mixture of Experts

text-embeddings-inference

Misc with no match

Carbon Emissions

Models

5,747

Full-text search

Active filters: 8-bit

MaziyarPanahi/mergekit-slerp-xlkdlta-GGUF

Text Generation • Updated Jun 18 • 92 • 1

MaziyarPanahi/mergekit-slerp-ksadkxl-GGUF

Text Generation • Updated Jun 18 • 71 • 1

MaziyarPanahi/mergekit-slerp-qcerglv-GGUF

Text Generation • Updated Jun 18 • 72 • 1

AndrewDOrlov/LLaMA-v2-merged-8b

Text Generation • Updated Jun 18 • 9

MaziyarPanahi/llama-world-GGUF

Text Generation • Updated Jun 18 • 82 • 1

MaziyarPanahi/gemma-gemma-GGUF

Text Generation • Updated Jun 18 • 45

MaziyarPanahi/LWM-14b-Text-Chat-1M-GGUF

Text Generation • Updated Jun 18 • 82

MaziyarPanahi/mergekit-slerp-ozbsicw-GGUF

Text Generation • Updated Jun 18 • 179

MaziyarPanahi/mergekit-slerp-jeyctse-GGUF

Text Generation • Updated Jun 18 • 44

MaziyarPanahi/mergekit-ties-kkhkcqw-GGUF

Text Generation • Updated Jun 18 • 83

MaziyarPanahi/mergekit-slerp-kxzcrwh-GGUF

Text Generation • Updated Jun 18 • 41 • 1

MaziyarPanahi/mergekit-slerp-zzizhry-GGUF

Text Generation • Updated Jun 18 • 66 • 1

MaziyarPanahi/mergekit-slerp-fcxoywi-GGUF

Text Generation • Updated Jun 18 • 13 • 1

MaziyarPanahi/mergekit-slerp-gpprpds-GGUF

Text Generation • Updated Jun 18 • 59 • 1

RyanJT/quantized-granite-3b-code-instruct

Text Generation • Updated Jun 19 • 4

MaziyarPanahi/firefunction-v2-GGUF

Text Generation • Updated Jun 20 • 1.83M • 14

BigHuggyD/BigHuggyD-Grey-WizardLM-2-8x22B_exl2_8.0bpw_h8

Text Generation • Updated Jun 19 • 3

lucyknada/alpindale-magnum-72b-v1-8.0bpw

Text Generation • Updated Jun 19 • 8 • 1

RyanJT/quantized-granite-8bit-3b-code-instruct

Text Generation • Updated Jun 19 • 5

IEITYuan/Yuan2-M32-hf-int8

Text Generation • Updated Jun 20 • 10

ismailpubg5/v2_model

Text Generation • Updated Jun 20 • 5

bullerwins/L3-8B-Stheno-v3.2-exl2_8.0bpw

Text Generation • Updated Jun 20 • 33

booksouls/summarization-endpoint

Text2Text Generation • Updated Jun 26

Manu1507/Llama-2-7b-quantize

Text Generation • Updated Jun 21 • 11

SotiriosKastanas/lmsys-vicuna-7b-v1.5-8-bit-bnb

Text Generation • Updated Jun 21 • 7

SotiriosKastanas/lmsys-vicuna-13b-v1.5-8-bit-bnb

Text Generation • Updated Jun 21 • 5

ByteForge/Llama_3_8b_Instruct_Text2Sql_Finetuned

Text Generation • Updated Jun 21 • 8

NimaZahedinameghi/nimaAxolotl

Updated Jun 21 • 28

RyanJT/quantized-tinyllama-8bit-1.1b-chat2

Text Generation • Updated Jun 22 • 6

RyanJT/quantized-4bit-TinyLlama-1.1B-Chat-v1.0

Text Generation • Updated Jun 22 • 6