smpanaro
/

Llama-2-7b-coreml

Model card Files Files and versions Community

Edit model card

CoreML conversion of Llama 2 7B from smpanaro/Llama-2-7b-NuGPTQ.

Use this CLI to download and run inference. macOS 14 (Sonoma) is required.

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference API

Unable to determine this model's library. Check the docs .

Model tree for smpanaro/Llama-2-7b-coreml

Base model

meta-llama/Llama-2-7b-hf

Finetuned

(589)

this model

Collection including smpanaro/Llama-2-7b-coreml

Apple Neural Engine LLMs

CoreML LLMs optimized for Apple Neural Engine. • 3 items • Updated 8 days ago • 1