meta-llama

/

Llama-3.1-8B-Instruct

like 3.01k

Follow

Meta Llama 7,575

Ollama let's you download GGUF files directly

We have connectivity challenges in our remote schools, so i need to download llama3.1 8B , to gguf format then use ollama to install using the model file command, kindly help with how to download in this format

Do you mean install the file elsewhere with better connectivity, then launch the existing GGUF using model file?

try using kobold.cpp, allows you to boot up a single gguf much easier.