Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Edit Models filters
Tasks
Libraries
Datasets
Languages
Licenses
Other
1
Inference status
Reset Inference status
Warm
Cold
Frozen
Misc
Reset Misc
quantization
Inference Endpoints
AutoTrain Compatible
text-generation-inference
4-bit precision
8-bit precision
custom_code
Eval Results
Misc with no match
Merge
text-embeddings-inference
Carbon Emissions
Mixture of Experts
Apply filters
Models
166
Full-text search
Edit filters
Sort: Trending
Active filters:
quantization
Clear all
legraphista/Reflection-Llama-3.1-70B-IMat-GGUF
Text Generation
•
Updated
4 days ago
•
2.54k
•
9
legraphista/DeepSeek-V2.5-IMat-GGUF
Text Generation
•
Updated
5 days ago
•
221
•
4
legraphista/DeepSeek-Coder-V2-Instruct-0724-IMat-GGUF
Text Generation
•
Updated
4 days ago
•
282
•
2
clibrain/Llama-2-7b-ft-instruct-es-gptq-4bit
Text Generation
•
Updated
Sep 1, 2023
•
52
•
9
SweatyCrayfish/llama-3-8b-quantized
Text Generation
•
Updated
Apr 20
•
45.6k
•
9
nics-efc/MixDQ
Text-to-Image
•
Updated
Jun 4
•
10
legraphista/DeepSeek-V2-Lite-Chat-IMat-GGUF
Text Generation
•
Updated
May 26
•
1.66k
•
6
legraphista/Qwen2-1.5B-Instruct-IMat-GGUF
Text Generation
•
Updated
Jun 6
•
6.9k
•
1
legraphista/glm-4-9b-chat-GGUF
Text Generation
•
Updated
Jun 20
•
5.19k
•
17
legraphista/RoLlama3-8b-Instruct-IMat-GGUF
Text Generation
•
Updated
Jun 23
•
353
•
2
legraphista/gemma-2-27b-it-IMat-GGUF
Text Generation
•
Updated
Jun 30
•
2.27k
•
20
legraphista/Meta-Llama-3.1-8B-Instruct-IMat-GGUF
Text Generation
•
Updated
Jul 27
•
723
•
4
legraphista/Meta-Llama-3.1-70B-Instruct-IMat-GGUF
Text Generation
•
Updated
Jul 27
•
2.4k
•
9
chatpdflocal/llama3.1-8b-gguf
Updated
20 days ago
•
7.75k
•
26
legraphista/Mistral-Large-Instruct-2407-IMat-GGUF
Text Generation
•
Updated
Jul 25
•
1.81k
•
26
legraphista/shieldgemma-27b-IMat-GGUF
Text Generation
•
Updated
Aug 5
•
18
•
1
chatpdflocal/mistral-nemo-instruct-gguf
Updated
20 days ago
•
265
•
5
legraphista/Llama-3.1-Minitron-4B-Width-Base-GGUF
Text Generation
•
Updated
27 days ago
•
5.18k
•
13
legraphista/Minitron-8B-Base-GGUF
Text Generation
•
Updated
25 days ago
•
865
•
1
alexwww94/glm-4v-9b-gptq-4bit
Updated
4 days ago
•
834
•
2
legraphista/c4ai-command-r-plus-08-2024-IMat-GGUF
Text Generation
•
Updated
13 days ago
•
711
•
5
legraphista/xLAM-8x7b-r-IMat-GGUF
Text Generation
•
Updated
13 days ago
•
402
•
1
legraphista/Yi-Coder-9B-Chat-IMat-GGUF
Text Generation
•
Updated
8 days ago
•
214
•
1
legraphista/Llama-3.1-SuperNova-Lite-IMat-GGUF
Text Generation
•
Updated
2 days ago
•
820
•
1
ethzanalytics/gpt-j-6B-8bit-sharded
Text Generation
•
Updated
Nov 27, 2022
•
9
•
7
ethzanalytics/gpt-j-8bit-daily_dialogues
Text Generation
•
Updated
Nov 27, 2022
•
8
•
4
ethzanalytics/gpt-j-8bit-KILT_WoW_10k_steps
Text Generation
•
Updated
Nov 27, 2022
•
8
leumastai/t5-large-quantized
Text2Text Generation
•
Updated
Mar 16, 2023
•
11
•
1
pszemraj/stablelm-7b-sft-v7e3-autogptq-4bit-128g
Text Generation
•
Updated
Jun 2, 2023
•
4
•
3
limcheekin/flan-t5-small-ct2
Updated
May 24, 2023
•
1
Previous
1
2
3
...
6
Next