Edit Models filters

Inference status

Misc

arxiv: 2009.03300

Inference Endpoints

AutoTrain Compatible

text-generation-inference

4-bit precision

8-bit precision

Mixture of Experts

Misc with no match

text-embeddings-inference

Carbon Emissions

Models

453

Full-text search

Active filters: 2009.03300

openerotica/Qwen-7B-GPTQ

Text Generation • Updated Aug 9, 2023 • 17 • 2

openerotica/Qwen-7B-Chat-GPTQ

Text Generation • Updated Aug 9, 2023 • 23 • 4

openerotica/Qwen-7B-Chat-128g-4bit

Text Generation • Updated Aug 9, 2023 • 17 • 1

TheBloke/GodziLLa2-70B-GGML

Text Generation • Updated Sep 27, 2023 • 21 • 9

TheBloke/GodziLLa2-70B-GPTQ

Text Generation • Updated Sep 27, 2023 • 26 • 4

TheBloke/GodziLLa2-70B-GGUF

Text Generation • Updated Nov 14, 2023 • 253 • 10

jackaduma/Baichuan2-7B-Chat-8bits

Text Generation • Updated Sep 19, 2023 • 8

NewstaR/Starlight-7B

Text Generation • Updated Nov 18, 2023 • 1.47k • 1

pipyp/iamqwen7bee

Text Generation • Updated Sep 13, 2023 • 18 • 1

tangger/Qwen-7B-Chat

Text Generation • Updated Sep 15, 2023 • 21 • 28

pipyp/qwendebug

Text Generation • Updated Sep 14, 2023 • 18

bibimbap/Qwen-7B-Chat

Text Generation • Updated Sep 14, 2023 • 13 • 9

bibimbap/Qwen-7B

Text Generation • Updated Sep 14, 2023 • 13 • 1

bibimbap/Qwen-7B-Chat-Int4

Text Generation • Updated Sep 14, 2023 • 15 • 2

TheBloke/GodziLLa2-70B-AWQ

Text Generation • Updated Nov 9, 2023 • 10 • 4

Qwen/Qwen-14B-Chat-Int4

Text Generation • Updated Dec 13, 2023 • 1.21k • 100

xverse/XVERSE-7B-Chat

Text Generation • Updated Nov 6, 2023 • 424 • 8

xverse/XVERSE-7B

Text Generation • Updated Nov 6, 2023 • 484 • 6

4bit/Qwen-14B-Chat-Int4

Text Generation • Updated Sep 25, 2023 • 33 • 2

pleisto/yuren-13b-chatml

Text Generation • Updated Mar 5 • 72 • 3

Qwen/Qwen-7B-Chat-Int8

Text Generation • Updated Dec 13, 2023 • 763 • 8

Qwen/Qwen-14B-Chat-Int8

Text Generation • Updated Dec 13, 2023 • 670 • 5

OpenNLPLab/TransNormerLLM-385M

Text Generation • Updated Feb 26 • 8 • 8

OpenNLPLab/TransNormerLLM-1B

Text Generation • Updated Feb 26 • 58 • 12

SeaLLMs/SeaLLM-13B-Chat

Updated Feb 2 • 60

OpenNLPLab/TransNormerLLM-7B

Text Generation • Updated Feb 26 • 14 • 17

TheBloke/TransNormerLLM-7B-GPTQ

Text Generation • Updated Nov 14, 2023 • 10 • 5

TheBloke/Qwen-7B-Chat-GPTQ

Text Generation • Updated Nov 21, 2023 • 100 • 2

TheBloke/Qwen-7B-Chat-AWQ

Text Generation • Updated Nov 21, 2023 • 192 • 8

TheBloke/Qwen-14B-Chat-AWQ

Text Generation • Updated Nov 21, 2023 • 30 • 11