Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
Edit Models filters
Tasks
Libraries
Datasets
Languages
Licenses
Other
1
Inference status
Reset Inference status
Warm
Cold
Frozen
Misc
Reset Misc
fp8
AutoTrain Compatible
text-generation-inference
Inference Endpoints
custom_code
Merge
Mixture of Experts
Misc with no match
Eval Results
4-bit precision
text-embeddings-inference
8-bit precision
Carbon Emissions
Apply filters
Models
230
Full-text search
Edit filters
Sort: Trending
Active filters:
fp8
Clear all
nm-testing/opt-125m-fp8-static-kv
Text Generation
•
Updated
Jun 14
•
1
neuralmagic/Qwen2-1.5B-Instruct-FP8
Text Generation
•
Updated
Jul 18
•
76
anyisalin/L3-70B-Euryale-v2.1-FP8
Text Generation
•
Updated
Jun 18
•
1.22k
nm-testing/Qwen2-0.5B-Instruct-FP8-KV
Text Generation
•
Updated
Jun 18
•
1
kuotient/llama3-instrucTrans-enko-8b-FP8
Text Generation
•
Updated
Jun 20
•
25
•
2
nm-testing/SparseLlama-3-8B-pruned_50.2of4-FP8
Text Generation
•
Updated
Jun 25
•
2
FlorianJc/Hermes-2-Pro-Mistral-7B-vllm-fp8
Text Generation
•
Updated
Jul 17
•
6
FlorianJc/openchat-3.6-8b-20240522-vllm-fp8
Text Generation
•
Updated
Jul 17
•
3
FlorianJc/Llama3-ChatQA-1.5-8B-vllm-fp8
Text Generation
•
Updated
Jul 17
•
3
TechxGenus/Codestral-22B-v0.1-FP8
Text Generation
•
Updated
Jun 21
•
154
Model-SafeTensors/Meta-Llama-3-70B-FP8-Dynamic
Text Generation
•
Updated
Jun 23
•
715
Model-SafeTensors/Qwen-Qwen2-72B-FP8-Dynamic
Text Generation
•
Updated
10 days ago
•
476
Rallio67/magnum-72B-FP8
Text Generation
•
Updated
Jun 26
•
7
nm-testing/Qwen2-1.5B-Instruct-FP8-KV
Text Generation
•
Updated
Jun 26
•
2
neuralmagic/Meta-Llama-3-70B-Instruct-FP8-KV
Text Generation
•
Updated
Jun 26
•
234
•
2
neuralmagic/Mistral-7B-Instruct-v0.3-FP8
Text Generation
•
Updated
Jul 18
•
301
•
2
neuralmagic/Llama-2-7b-chat-hf-FP8
Text Generation
•
Updated
Jul 18
•
215
neuralmagic/Phi-3-mini-128k-instruct-FP8
Text Generation
•
Updated
Aug 12
•
344
Rallio67/llama-3-70B-test-FP8
Text Generation
•
Updated
Jun 27
•
1
Rallio67/llama-3-70B-actions-FP8
Text Generation
•
Updated
Jun 27
nm-testing/gemma-2-27b-it-FP8
Text Generation
•
Updated
Jun 27
•
5.21k
•
1
nerdylive/Meta-Llama-3-8B-Instruct-FP8
Text Generation
•
Updated
Jul 1
•
1
nm-testing/Qwen2-57B-A14B-Instruct-FP8-KV
Text Generation
•
Updated
Jul 3
•
8
nm-testing/dbrx-instruct-FP8
Text Generation
•
Updated
Jul 3
•
1
FlorianJc/google-gemma-2-9b-it-vllm-fp8
Text Generation
•
Updated
Jul 17
•
27
tranhoangnguyen03/Gemma-2-9B-It-SPPO-Iter3_Q8
Text Generation
•
Updated
Jul 7
•
2
Model-SafeTensors/mistralai-Mixtral-8x7B-v0.1
Text Generation
•
Updated
Jul 7
•
2
Model-SafeTensors/mistralai-Mixtral-8x22B
Text Generation
•
Updated
Jul 7
•
2
FlorianJc/Llama3-ChatQA-1.5-8B-v2-vllm-fp8
Text Generation
•
Updated
Jul 17
•
2
FlorianJc/MegaBeam-Mistral-7B-300k-vllm-fp8
Text Generation
•
Updated
Jul 17
•
2
Previous
1
2
3
4
5
...
8
Next