Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Edit Models filters
Tasks
Libraries
Datasets
Languages
Licenses
Other
1
Inference status
Reset Inference status
Warm
Cold
Frozen
Misc
Reset Misc
quantization
Inference Endpoints
AutoTrain Compatible
text-generation-inference
Eval Results
4-bit precision
Merge
custom_code
text-embeddings-inference
8-bit precision
Carbon Emissions
Mixture of Experts
Apply filters
Models
148
Full-text search
Edit filters
Sort: Trending
Active filters:
quantization
Clear all
legraphista/Llama-3.1-Minitron-4B-Width-Base-GGUF
Text Generation
•
Updated
8 days ago
•
2.53k
•
8
legraphista/Mistral-Large-Instruct-2407-IMat-GGUF
Text Generation
•
Updated
Jul 25
•
5.65k
•
26
SweatyCrayfish/llama-3-8b-quantized
Text Generation
•
Updated
Apr 20
•
43.2k
•
7
nics-efc/MixDQ
Text-to-Image
•
Updated
Jun 4
•
9
legraphista/Qwen2-1.5B-Instruct-IMat-GGUF
Text Generation
•
Updated
Jun 6
•
4.88k
•
1
legraphista/glm-4-9b-chat-GGUF
Text Generation
•
Updated
Jun 20
•
7.72k
•
15
legraphista/gemma-2-27b-it-IMat-GGUF
Text Generation
•
Updated
Jun 30
•
5.35k
•
19
chatpdflocal/llama3.1-8b-gguf
Updated
2 days ago
•
16.5k
•
26
chatpdflocal/mistral-nemo-instruct-gguf
Updated
2 days ago
•
245
•
5
legraphista/Minitron-8B-Base-GGUF
Text Generation
•
Updated
7 days ago
•
799
•
1
ethzanalytics/gpt-j-6B-8bit-sharded
Text Generation
•
Updated
Nov 27, 2022
•
17
•
7
ethzanalytics/gpt-j-8bit-daily_dialogues
Text Generation
•
Updated
Nov 27, 2022
•
20
•
4
ethzanalytics/gpt-j-8bit-KILT_WoW_10k_steps
Text Generation
•
Updated
Nov 27, 2022
•
17
leumastai/t5-large-quantized
Text2Text Generation
•
Updated
Mar 16, 2023
•
15
•
1
pszemraj/stablelm-7b-sft-v7e3-autogptq-4bit-128g
Text Generation
•
Updated
Jun 2, 2023
•
17
•
3
limcheekin/flan-t5-small-ct2
Updated
May 24, 2023
•
5
limcheekin/flan-t5-xl-ct2
Updated
Jun 3, 2023
•
3
•
1
limcheekin/flan-t5-xxl-ct2
Updated
May 30, 2023
•
3
•
1
limcheekin/fastchat-t5-3b-ct2
Text2Text Generation
•
Updated
Jun 28, 2023
•
26
•
2
limcheekin/flan-alpaca-gpt4-xl-ct2
Updated
Jun 4, 2023
•
3
limcheekin/mpt-7b-storywriter-ct2
Updated
Jun 27, 2023
•
5
limcheekin/falcon-7b-instruct-ct2
Updated
Jun 19, 2023
•
5
•
1
limcheekin/mpt-7b-instruct-ct2
Updated
Jun 19, 2023
•
4
limcheekin/redpajama-chat-7b-ct2
Updated
Jun 9, 2023
•
4
seonglae/wizardlm-7b-uncensored-gptq
Text Generation
•
Updated
Jul 19, 2023
•
14
seonglae/llama-2-7b-chat-hf-gptq
Text Generation
•
Updated
Jul 20, 2023
•
15
seonglae/llama-2-13b-chat-hf-gptq
Text Generation
•
Updated
Jul 20, 2023
•
16
clibrain/Llama-2-7b-ft-instruct-es-gptq-4bit
Text Generation
•
Updated
Sep 1, 2023
•
35
•
8
clibrain/Llama-2-13b-ft-instruct-es-gptq-4bit
Text Generation
•
Updated
Sep 4, 2023
•
42
•
3
edumunozsala/llama-2-7b-int4-GPTQ-python-code-20k
Text Generation
•
Updated
Sep 4, 2023
•
19
Previous
1
2
3
...
5
Next