--- license: mit tags: - ollama --- Convert and Quantized of [TinyLlama-1.1B-intermediate-step-1431k-3T](https://huggingface.co/TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T/tree/main) using llama.cpp ## Guide to replicate [Convert and Quantize model to GGUF](https://medium.com/@sarinsuriyakoon/convert-pytorch-model-to-quantize-gguf-to-run-on-ollama-5c5dbc458208) ## Description This is for my own experiment with Ollama, because Ollama usually put chat fine-tuning in their library. It would be hard to know if my fine-tuning LoRA Adapter works if I don't use base/pretrain model version ## Ollama - Model Page https://ollama.com/pacozaa/tinyllama - `ollama run pacozaa/tinyllama`