Edit Models filters

Inference status

Misc

AutoTrain Compatible

text-generation-inference

Inference Endpoints

Misc with no match

4-bit precision

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

7

Full-text search

Active filters: 3.0bpw

llmixer/Xwinter-120b-3.0bpw-h8-exl2

Text Generation • Updated Jan 17 • 4

llmixer/BigLiz-120b-3.0bpw-h8-exl2

Text Generation • Updated Jan 17 • 3

llmixer/BigAurelian-v0.5-120b-32k-3.0bpw-h8-exl2

Text Generation • Updated Jan 17 • 1

llmixer/BigWeave-v6-90b-3.0bpw-h8-exl2

Text Generation • Updated Jan 22 • 2

llmixer/Midnight-Rose-103B-v2.0.3-3.0bpw-h6-exl2

Text Generation • Updated Feb 16 • 2

llmixer/BigWeave-v7.1-124b-3.0bpw-h6-exl2

Text Generation • Updated Feb 20 • 2

TheVisitorX/InfinityRP-v1-7B-3.0bpw-exl2

Text Generation • Updated Apr 1 • 2