--- license: llama3 model_name: Llama-3-Taiwan-70B-Instruct base_model: yentinglin/Llama-3-Taiwan-70B-Instruct inference: false pipeline_tag: text-generation quantized_by: Second State Inc. library_name: transformers language: - zh - en tags: - zhtw --- # Llama-3-Taiwan-70B-Instruct-GGUF ## Original Model [yentinglin/Llama-3-Taiwan-70B-Instruct](https://huggingface.co/yentinglin/Llama-3-Taiwan-70B-Instruct) ## Run with Gaianet **Prompt template** prompt template: `llama-3-chat` **Context size** chat_ctx_size: `4096` **Run with GaiaNet** - Quick start: https://docs.gaianet.ai/node-guide/quick-start - Customize your node: https://docs.gaianet.ai/node-guide/customize *Quantized with llama.cpp b3613*