Edit Models filters

Inference status

Misc

Inference Endpoints

4-bit precision

AutoTrain Compatible

text-generation-inference

Misc with no match

text-embeddings-inference

8-bit precision

Carbon Emissions

Mixture of Experts

Models

63

Full-text search

Active filters: Quantization

VPTQ-community/Llama-3.1-Nemotron-70B-Instruct-HF-v16-k65536-16384-woft

Updated 4 days ago • 35

VPTQ-community/Llama-3.1-Nemotron-70B-Instruct-HF-v16-k65536-256-woft

Updated 4 days ago • 82 • 1

Puhaha/gemma-2-9b-it-SimPO_q4_k_m

Updated 6 days ago • 19