Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
Edit Models filters
Tasks
Libraries
Datasets
Languages
Licenses
Other
1
Inference status
Reset Inference status
Warm
Cold
Frozen
Misc
Reset Misc
vllm
Inference Endpoints
AutoTrain Compatible
text-generation-inference
4-bit precision
Merge
custom_code
8-bit precision
Misc with no match
Eval Results
text-embeddings-inference
Carbon Emissions
Mixture of Experts
Apply filters
Models
182
Full-text search
Edit filters
Sort: Trending
Active filters:
vllm
Clear all
cmshin96/MN-12B-Lyra-v1-awq
Text Generation
•
Updated
Sep 7
•
9
cmshin96/MN-12B-Lyra-v4-awq
Text Generation
•
Updated
Sep 14
•
9
LlamaFinetuneBase/Pixtral-12B-2409
Updated
Sep 20
nm-testing/Meta-Llama-3.1-8B-Instruct-FP8-hf
Text Generation
•
Updated
Sep 24
•
16
neuralmagic/Llama-3.2-1B-Instruct-FP8-dynamic
Text Generation
•
Updated
Oct 9
•
1.3k
•
2
soprasteria/Mixtral-8x7B-Instruct-v0.1-FP8
Updated
Sep 27
•
8
mlx-community/Ministral-8B-Instruct-2410-8bit
Updated
Oct 17
•
65
•
1
TouchNight/Ministral-8B-Instruct-2410-HF
Updated
Oct 18
•
82
TouchNight/Ministral-8B-Instruct-2410-HF-Q5_K_M-GGUF
Updated
Oct 18
•
17
ijohn07/Ministral-8B-Instruct-2410-HF-Q8_0-GGUF
Updated
Oct 19
•
49
adriabama06/reader-lm-1.5b-AWQ
Text Generation
•
Updated
21 days ago
•
55
•
1
sasha0552/Ministral-8B-Instruct-2410
Updated
Oct 20
QuantFactory/TouchNight-Ministral-8B-Instruct-2410-HF-GGUF
Updated
Oct 20
•
647
•
2
GrimsenClory/Ministral-8B-Instruct-2410-Q6_K-GGUF
Updated
Oct 21
•
447
gphorvath/Ministral-8B-Instruct-2410-Q4_K_M-GGUF
Updated
27 days ago
•
163
Gleisson1/Ministral-8B-Instruct-2410-HF-4bit
Updated
27 days ago
•
11
paultimothymooney/Ministral-8B-Instruct-2410-Q8_0-GGUF
Updated
25 days ago
•
124
paultimothymooney/Ministral-8B-Instruct-2410-Q4_K_M-GGUF
Updated
25 days ago
•
12
LouiSeHU/Mistral-Small-Instruct-2409-Q4_0-GGUF
Updated
24 days ago
•
74
yejingfu/nmagic-Meta-Llama-3.1-8B-Instruct-FP8
Text Generation
•
Updated
22 days ago
•
11
Ritvik19/Ministral-8B-Instruct-2410-Q4_K_M-GGUF
Updated
20 days ago
•
57
Gustav0-Freind/missmall
Updated
17 days ago
•
12
yejingfu/nmagic-Meta-Llama-3.1-70B-Instruct-FP8
Text Generation
•
Updated
17 days ago
•
11
neuralmagic/Sparse-Llama-3.1-8B-gsm8k-2of4
Text Generation
•
Updated
about 15 hours ago
•
72
SicariusSicariiStuff/DeepSeek-Coder-V2-Instruct-FP8
Updated
14 days ago
•
34
yejingfu/nmagic-Meta-Llama-3-70B-Instruct-FP8
Updated
7 days ago
•
6
Model-SafeTensors/Meta-Llama-3-8B-Instruct-FP8
Updated
Jul 18
•
168
mgoin/Pixtral-Large-Instruct-2411
Updated
4 days ago
ijohn07/Ministral-8B-Instruct-2410-Q8_0-GGUF
Updated
3 days ago
•
24
MikeRoz/mistralai_Mistral-Large-Instruct-2411-8.0bpw-h8-exl2
Updated
3 days ago
•
15
Previous
1
...
3
4
5
6
7
Next