xriminact
/

SmolLM-360M-Instruct-GGUF

Inference Endpoints

Model card Files Files and versions Community

SmolLM-360M-Instruct-GGUF / README.md

xriminact's picture

Update README.md

604dce5 verified 4 months ago

|

history blame contribute delete

235 Bytes

metadata

license: apache-2.0

Model Sources

https://huggingface.co/HuggingFaceTB/SmolLM-360M-Instruct

Uses

v v small model for running on edge with :fire: TTFT & Throughput

Direct Use

Use llama.cpp to inference the model