Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

text-embeddings-inference

8-bit precision

4-bit precision

Misc with no match

Carbon Emissions

Mixture of Experts

Models

234

Full-text search

Active filters: int8

Anthonyg5005/L3-8B-Stheno-v3.1-int8-ct2

Text Generation • Updated Jun 17 • 9

Anthonyg5005/turbcat-instruct-8b-int8-ct2

Text Generation • Updated Jun 20 • 10

angeloc1/llama3dot1SimilarProcesses8

Text Generation • Updated Jul 27 • 8

angeloc1/llama3dot1DifferentProcesses8

Text Generation • Updated Jul 27 • 9

FriendliAI/Meta-Llama-3-8B-int8

Text Generation • Updated Aug 1 • 32 • 1

neuralmagic/Meta-Llama-3.1-8B-quantized.w8a16

Text Generation • Updated Oct 9 • 456 • 1

neuralmagic/Meta-Llama-3.1-8B-quantized.w8a8

Text Generation • Updated 29 days ago • 617 • 1

neuralmagic/gemma-2-9b-it-quantized.w8a16

Text Generation • Updated Oct 9 • 2.84k • 1

neuralmagic/gemma-2-2b-it-quantized.w8a16

Text Generation • Updated Oct 9 • 55 • 1

neuralmagic/gemma-2-2b-quantized.w8a16

Text Generation • Updated Oct 9 • 40

neuralmagic/SmolLM-1.7B-Instruct-quantized.w8a16

Text Generation • Updated Oct 9 • 20

neuralmagic/gemma-2-2b-it-quantized.w8a8

Text Generation • Updated Oct 9 • 958

neuralmagic/gemma-2-9b-it-quantized.w8a8

Text Generation • Updated Oct 9 • 176 • 2

angeloc1/llama3dot1FoodDel8v02

Text Generation • Updated Aug 18 • 13

neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w8a16

Text Generation • Updated Oct 9 • 512 • 2

neuralmagic/SmolLM-360M-Instruct-quantized.w8a8

Text Generation • Updated Oct 9 • 13

neuralmagic/SmolLM-135M-Instruct-quantized.w8a8

Text Generation • Updated Oct 9 • 697

neuralmagic/SmolLM-1.7B-Instruct-quantized.w8a8

Text Generation • Updated Oct 9 • 16

zzzmahesh/Meta-Llama-3-8B-Instruct-quantized.w8a8

Text Generation • Updated Sep 7 • 5

FriendliAI/Meta-Llama-3.1-8B-Instruct-int8

Text Generation • Updated Sep 9 • 20 • 1

FriendliAI/Meta-Llama-3.1-70B-Instruct-int8

Text Generation • Updated Sep 9 • 12

avans06/Meta-Llama-3.1-8B-Instruct-ct2-int8_float16

Text Generation • Updated Oct 10 • 16

avans06/Meta-Llama-3.2-8B-Instruct-ct2-int8_float16

Text Generation • Updated Oct 13 • 42

SteveTran/T5-small-query-expansion-INT8

Text2Text Generation • Updated 5 days ago • 201