Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Edit Models filters
Tasks
Libraries
Datasets
Languages
Licenses
Other
1
Inference status
Reset Inference status
Warm
Cold
Frozen
Misc
Reset Misc
8bit
AutoTrain Compatible
text-generation-inference
8-bit precision
Inference Endpoints
custom_code
Eval Results
Misc with no match
4-bit precision
Merge
text-embeddings-inference
Carbon Emissions
Mixture of Experts
Apply filters
Models
116
Full-text search
Edit filters
Sort: Trending
Active filters:
8bit
Clear all
legraphista/Reflection-Llama-3.1-70B-IMat-GGUF
Text Generation
•
Updated
4 days ago
•
2.54k
•
9
legraphista/DeepSeek-V2.5-IMat-GGUF
Text Generation
•
Updated
5 days ago
•
221
•
4
speakleash/Bielik-11B-v2.2-Instruct-Quanto-8bit
Text Generation
•
Updated
16 days ago
•
42
•
3
speakleash/Bielik-11B-v2.2-Instruct-FP8
Text Generation
•
Updated
16 days ago
•
285
•
3
speakleash/Bielik-11B-v2.2-Instruct-W8A8
Text Generation
•
Updated
16 days ago
•
32
•
3
legraphista/DeepSeek-Coder-V2-Instruct-0724-IMat-GGUF
Text Generation
•
Updated
4 days ago
•
282
•
2
alokabhishek/Mistral-7B-Instruct-v0.2-bnb-8bit
Text Generation
•
Updated
Apr 2
•
14
•
2
legraphista/Qwen2-1.5B-Instruct-IMat-GGUF
Text Generation
•
Updated
Jun 6
•
6.9k
•
1
legraphista/glm-4-9b-chat-GGUF
Text Generation
•
Updated
Jun 20
•
5.19k
•
17
legraphista/RoLlama3-8b-Instruct-IMat-GGUF
Text Generation
•
Updated
Jun 23
•
353
•
2
legraphista/gemma-2-27b-it-IMat-GGUF
Text Generation
•
Updated
Jun 30
•
2.27k
•
20
legraphista/Meta-Llama-3.1-8B-Instruct-IMat-GGUF
Text Generation
•
Updated
Jul 27
•
723
•
4
legraphista/Meta-Llama-3.1-70B-Instruct-IMat-GGUF
Text Generation
•
Updated
Jul 27
•
2.4k
•
9
legraphista/Mistral-Large-Instruct-2407-IMat-GGUF
Text Generation
•
Updated
Jul 25
•
1.81k
•
26
legraphista/shieldgemma-27b-IMat-GGUF
Text Generation
•
Updated
Aug 5
•
18
•
1
legraphista/Llama-3.1-Minitron-4B-Width-Base-GGUF
Text Generation
•
Updated
27 days ago
•
5.18k
•
13
legraphista/Minitron-8B-Base-GGUF
Text Generation
•
Updated
25 days ago
•
865
•
1
legraphista/c4ai-command-r-plus-08-2024-IMat-GGUF
Text Generation
•
Updated
13 days ago
•
711
•
5
legraphista/xLAM-8x7b-r-IMat-GGUF
Text Generation
•
Updated
13 days ago
•
402
•
1
legraphista/Yi-Coder-9B-Chat-IMat-GGUF
Text Generation
•
Updated
8 days ago
•
214
•
1
legraphista/Llama-3.1-SuperNova-Lite-IMat-GGUF
Text Generation
•
Updated
2 days ago
•
820
•
1
crumb/gpt-j-6b-finetune-super-glue
Text Generation
•
Updated
Jul 17, 2022
•
7
ethzanalytics/gpt-j-6B-8bit-sharded
Text Generation
•
Updated
Nov 27, 2022
•
9
•
7
ethzanalytics/gpt-j-8bit-daily_dialogues
Text Generation
•
Updated
Nov 27, 2022
•
8
•
4
ethzanalytics/gpt-j-8bit-KILT_WoW_10k_steps
Text Generation
•
Updated
Nov 27, 2022
•
8
ethzanalytics/dolly-v2-12b-sharded-8bit
Text Generation
•
Updated
Apr 29, 2023
•
2
•
4
pszemraj/long-t5-tglobal-xl-16384-book-summary-8bit
Summarization
•
Updated
May 5, 2023
•
7
ethzanalytics/open_llama_13b-sharded-8bit
Text Generation
•
Updated
Jul 2, 2023
•
5
richardr1126/spider-skeleton-wizard-coder-8bit
Text Generation
•
Updated
Jul 26, 2023
•
7
•
1
Trelis/Llama-2-7b-chat-hf-hosted-inference-8bit
Text Generation
•
Updated
Nov 9, 2023
•
28
•
6
Previous
1
2
3
4
Next