xriminact
/

SmolLM-1.7B-Instruct-GGUF

Inference Endpoints

Model card Files Files and versions Community

Edit model card

Model Sources

https://huggingface.co/HuggingFaceTB/SmolLM-1.7B-Instruct

Uses

v v small model for running on edge with :fire: TTFT & Throughput

Direct Use

Use llama.cpp to inference the model

Downloads last month: 94

GGUF

Model size

1.71B params

Architecture

llama

16-bit

Inference API

Unable to determine this model's library. Check the docs .