Edit Models filters

Inference status

Misc

Inference Endpoints

AutoTrain Compatible

text-generation-inference

text-embeddings-inference

8-bit precision

4-bit precision

Misc with no match

Carbon Emissions

Mixture of Experts

Models

234

Full-text search

Active filters: int8

Intel/vit-base-patch16-224-int8-static-inc

Image Classification • Updated Sep 6, 2022 • 50 • 1

Intel/t5-small-xsum-int8-dynamic-inc

Text2Text Generation • Updated Mar 21 • 3.09k • 1

Intel/t5-small-finetuned-cnn-news-int8-dynamic-inc

Text2Text Generation • Updated Oct 6, 2023 • 27

AlexKoff88/bert_nm_mnli_sparse_quantized_90

Text Classification • Updated Nov 25, 2022 • 11

echarlaix/vit-food101-int8

Image Classification • Updated Nov 22, 2022 • 12

Intel/t5-large-finetuned-xsum-cnn-int8-dynamic-inc

Text2Text Generation • Updated Mar 21 • 5

Intel/t5-base-cnn-dm-int8-dynamic-inc

Text2Text Generation • Updated Mar 21 • 7

Intel/bart-large-cnn-int8-dynamic-inc

Text2Text Generation • Updated Mar 22 • 5 • 1

Intel/distilbart-cnn-12-6-int8-dynamic-inc

Text2Text Generation • Updated Mar 22 • 41 • 2

Intel/roberta-base-mrpc-int8-dynamic-inc

Text Classification • Updated Dec 28, 2022 • 3

Intel/xlm-roberta-base-mrpc-int8-dynamic-inc

Text Classification • Updated Jun 27, 2023 • 10

Intel/albert-base-v2-sst2-int8-dynamic-inc

Text Classification • Updated Jun 27, 2023 • 9

Intel/MiniLM-L12-H384-uncased-mrpc-int8-dynamic-inc

Text Classification • Updated Dec 28, 2022 • 7

Intel/gpt-j-6B-int8-dynamic-inc

Text Generation • Updated Apr 19, 2023 • 27 • 16

Intel/gpt-j-6B-int8-static-inc

Text Generation • Updated Apr 19, 2023 • 32 • 9

DataAgent/llama-7b-alpaca-zh-20k

Updated Apr 8, 2023

ENOT-AutoDL/gpt-j-6B-tensorrt-int8

Text Generation • Updated Jun 8, 2023 • 7

Intel/gpt-j-6B-pytorch-int8-static-inc

Text Generation • Updated Jan 18 • 26

DataAgent/llama-7b-alpaca-zh-120k

Updated Apr 8, 2023 • 1

Intel/gpt-neox-japanese-2.7b-int8-inc

Text Generation • Updated Mar 21

michaelfeil/ct2fast-gpt-j-6b

Updated May 19, 2023 • 10 • 1

michaelfeil/ct2fast-pythia-12b

Updated May 21, 2023 • 10

michaelfeil/ct2fast-pythia-160m

Updated May 19, 2023 • 12 • 1

michaelfeil/ct2fast-gpt-neox-20b

Updated May 19, 2023 • 15

michaelfeil/ct2fast-Pythia-Chat-Base-7B

Updated May 21, 2023 • 1 • 1

michaelfeil/ct2fast-pythia-2.8b

Updated May 19, 2023 • 9 • 1

michaelfeil/ct2fast-pythia-6.9b

Updated May 19, 2023 • 10 • 1

michaelfeil/ct2fast-stablelm-7b-sft-v7-epoch-3

Text Generation • Updated Jun 2, 2023 • 11

michaelfeil/ct2fast-stablelm-tuned-alpha-7b

Updated May 22, 2023 • 9

michaelfeil/ct2fast-stablelm-base-alpha-3b

Updated May 22, 2023 • 10