Edit Models filters

Inference status

Misc

Inference Endpoints

4-bit precision

8-bit precision

text-generation-inference

AutoTrain Compatible

Mixture of Experts

Carbon Emissions

Misc with no match

text-embeddings-inference

Models

3,059

Full-text search

Active filters: GGUF

tsunemoto/MiniChat-1.5-3B-GGUF

Updated Dec 18, 2023 • 66 • 2

luxadev/based-30b-GGUF

Updated Dec 18, 2023

tsunemoto/Metis-0.3-GGUF

Updated Dec 18, 2023 • 80 • 1

tsunemoto/GEITje-7B-chat-GGUF

Updated Dec 18, 2023 • 33

tsunemoto/LLaMAntino-2-chat-13b-hf-ITA-GGUF

Updated Dec 18, 2023 • 192 • 3

tsunemoto/mistral-ft-optimized-1218-GGUF

Updated Dec 19, 2023 • 66 • 3

tsunemoto/WizardMath-7B-V1.1-GGUF

Updated Dec 19, 2023 • 71 • 2

tsunemoto/Metis-0.4-GGUF

Updated Dec 19, 2023 • 31

LiteLLMs/Mistral-7B-Merge-14-v0.1-GGUF

Text Generation • Updated Jan 24 • 183

tsunemoto/Nous-Hermes-2-Yi-34B-GGUF

Updated Dec 26, 2023 • 112

andrijdavid/Mistral-T5-7B-v1-GGUF

Text Generation • Updated Dec 27, 2023 • 6

andrijdavid/Marcoroni-7B-v3-GGUF

Text Generation • Updated Dec 27, 2023 • 53

andrijdavid/mindy-7b-v2-GGUF

Text Generation • Updated Dec 27, 2023 • 40

andrijdavid/supermario-v2-GGUF

Text Generation • Updated Dec 27, 2023 • 37

andrijdavid/CatPPT-base-GGUF

Text Generation • Updated Dec 27, 2023 • 77 • 1

andrijdavid/LMCocktail-10.7B-v1-GGUF

Text Generation • Updated Dec 27, 2023 • 57 • 1

andrijdavid/Sakura-SOLAR-Instruct-GGUF

Text Generation • Updated Dec 28, 2023 • 67 • 1

tsunemoto/TinyLlama-1.1B-Chat-v0.6-x8-MoE-GGUF

Updated Dec 29, 2023 • 187 • 6

andrijdavid/CarbonVillain-en-10.7B-v2-GGUF

Text Generation • Updated Jan 1 • 20

andrijdavid/StopCarbon-10.7B-v5-GGUF

Text Generation • Updated Jan 1 • 63 • 1

LiteLLMs/CarbonVillain-en-10.7B-v3-GGUF

Text Generation • Updated Jan 1 • 46

yargpt/vicuna-13b-v1.5-gguf

Text Generation • Updated Jan 2 • 1 • 1

andrijdavid/TinyLlama-1.1B-Chat-v1.0-GGUF

Text Generation • Updated Jan 19 • 179 • 1

andrijdavid/finance-chat-GGUF

Text Generation • Updated Jan 19 • 176 • 1

andrijdavid/TinyLlama-1.1B-32k-GGUF

Text Generation • Updated Jan 2 • 46

andrijdavid/MobileLLaMA-1.4B-Base-GGUF

Text Generation • Updated Jan 2 • 211 • 1

andrijdavid/tinyfrank-1.4B-GGUF

Text Generation • Updated Jan 2 • 55

andrijdavid/MiniMA-2-3B-GGUF

Text Generation • Updated Jan 2 • 77

Trelis/Tiny

Text Generation • Updated Feb 22 • 7

tsunemoto/FlatDolphinMaid-8x7B-GGUF

Updated Jan 4 • 58