Edit Models filters

Inference status

Misc

8-bit precision

AutoTrain Compatible

Inference Endpoints

text-generation-inference

4-bit precision

Mixture of Experts

text-embeddings-inference

Misc with no match

Carbon Emissions

Models

5,769

Full-text search

Active filters: 8-bit

rere84/renne2

Text Generation • Updated Jun 16, 2023 • 23

inarikami/falcon-40b-instruct-8bit

Text Generation • Updated Jun 23, 2023 • 14

hugger111/BlenderBot_400M_distill_falcon_redefined_first10krows

Text2Text Generation • Updated Sep 14, 2023 • 10

rahuldshetty/minotaur-15b-8bit

Text Generation • Updated Jun 20, 2023 • 14

TANUKImao/mpt7b-text-summ

Text Generation • Updated Jun 22, 2023 • 6

alup/agrimi-7.5B-dolly

Text Generation • Updated Jul 8, 2023 • 1

rahuldshetty/open-llama-13b-open-instruct-8bit

Text Generation • Updated Jun 27, 2023 • 6

uf-aice-lab/Llama_Lora

Question Answering • Updated Jun 30, 2023 • 14

shaileshp/trained-test-model-1-merged-new

Text Generation • Updated Jun 28, 2023 • 20

ybelkada/gpt2-xl-8bit

Text Generation • Updated Apr 4 • 511

substratusai/falcon-40b-8bit

Text Generation • Updated Jul 2, 2023 • 15 • 1

rahuldshetty/vmw-open-llama-13b-open-instruct-ntk4k-8bit

Text Generation • Updated Jun 29, 2023 • 9

Abzu/mpt-30b-instruct-q8

Text Generation • Updated Jul 6, 2023 • 15 • 5

sboughorbel/bloomz-8bit

Text Generation • Updated Jul 1, 2023 • 106

cambioml/falcon-7b-8bit

Text Generation • Updated Jul 1, 2023 • 5 • 2

sboughorbel/BLOOMChat-176B-v1-8bit

Text Generation • Updated Jul 1, 2023 • 17 • 2

osiria/prime-6.6b

Text Generation • Updated Jul 6, 2023 • 24

ethzanalytics/open_llama_13b-sharded-8bit

Text Generation • Updated Jul 2, 2023 • 7

vivekraina/bloom-560m-8bit

Text Generation • Updated Jul 4, 2023 • 14

vivekraina/falcon-7b-8bit

Text Generation • Updated Jul 4, 2023 • 6

vivekraina/falcon-7b-Instruct-8bit

Text Generation • Updated Jul 4, 2023 • 4

anejaisha/output2

Text2Text Generation • Updated Jul 5, 2023 • 3

avaassadi/bloom-1b1-alpaca-fine

Text Generation • Updated Jul 6, 2023 • 13

vivekraina/Falcon-instruct-8bit-test

Text Generation • Updated Jul 6, 2023 • 15

Abzu/mpt-7b-q8

Text Generation • Updated Jul 6, 2023 • 15 • 1

Abzu/mpt-7b-instruct-q8

Text Generation • Updated Jul 7, 2023 • 15 • 2

Abzu/mpt-7b-chat-q8

Text Generation • Updated Jul 7, 2023 • 16 • 1

Abzu/mpt-7b-storywriter-q8

Text Generation • Updated Jul 7, 2023 • 15 • 2

Abzu/mpt-30b-q8

Text Generation • Updated Jul 7, 2023 • 14 • 3

Abzu/mpt-30b-chat-q8

Text Generation • Updated Jul 7, 2023 • 16 • 1