Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

414

Full-text search

Active filters: pretrained

MaziyarPanahi/Mistral-7B-v0.2-GGUF

Text Generation • Updated Mar 28 • 65 • 3

FriendliAI/Mistral-7B-Instruct-v0.2-fp8

Text Generation • Updated Apr 18 • 12 • 11

ProCreations/Qwen1.5-0.5B-Q4_K_M-GGUF

Text Generation • Updated Mar 29 • 8

ProCreations/Qwen1.5-4B-Q5_0-GGUF

Text Generation • Updated Mar 29 • 4

mlx-community/Qwen1.5-MoE-A2.7B-4bit

Text Generation • Updated Apr 2 • 5

Qwen/Qwen1.5-32B

Text Generation • Updated Apr 5 • 13k • 81

mlx-community/Qwen1.5-MoE-A2.7B-Chat-4bit

Text Generation • Updated Apr 2 • 10 • 5

jesusoctavioas/wikisql-4bit-1k

Text Generation • Updated Apr 3 • 10

Tweeties/tweety-7b-italian-v24a

Text Generation • Updated May 13 • 19 • 2

MarsupialAI/Qwen1.5-32B_iMatrix_GGUF

Text Generation • Updated May 11 • 68 • 1

mlx-community/Qwen1.5-32B-4bit

Text Generation • Updated Apr 5 • 4 • 1

mlx-community/Qwen1.5-32B-8bit

Text Generation • Updated Apr 5 • 7

LoneStriker/Qwen1.5-32B-3.0bpw-h6-exl2

Text Generation • Updated Apr 6

LoneStriker/Qwen1.5-32B-4.0bpw-h6-exl2

Text Generation • Updated Apr 6

LoneStriker/Qwen1.5-32B-4.65bpw-h6-exl2

Text Generation • Updated Apr 6 • 2

LoneStriker/Qwen1.5-32B-5.0bpw-h6-exl2

Text Generation • Updated Apr 6

LoneStriker/Qwen1.5-32B-6.0bpw-h6-exl2

Text Generation • Updated Apr 6

LoneStriker/Qwen1.5-32B-8.0bpw-h8-exl2

Text Generation • Updated Apr 6

teneriffa/Qwen1.5-32B-Q4_0-GGUF

Text Generation • Updated Apr 6 • 11

mlx-community/Qwen1.5-0.5B-4bit

Text Generation • Updated Apr 8 • 3

CryogenicPlanet/mistral-jax

Text Generation • Updated Apr 9

pere/mistral-maxtext-export-test

Text Generation • Updated Apr 12 • 10

jeremy02au/Qwen1.5-1.8B-GPTQ

Text Generation • Updated Apr 11

dicta-il/dictalm2.0-AWQ

Text Generation • Updated Jul 10 • 95

dicta-il/dictalm2.0-GPTQ

Text Generation • Updated Jul 10 • 99

mlx-community/Qwen1.5-72B-4bit

Text Generation • Updated Apr 13 • 4

RaphaelMourad/Mistral-DNA-v1-138M-bacteria

Text Generation • Updated Aug 4 • 414 • 3

DavidAU/roleplay-model-v2-Q6_K-GGUF

Updated Apr 16 • 9

NikolayKozloff/tweety-7b-italian-GGUF

Text Generation • Updated Apr 16 • 7 • 1

NikolayKozloff/CodeQwen1.5-7B-Q8_0-GGUF

Text Generation • Updated Apr 16 • 1 • 4