--- license: apache-2.0 license_link: https://huggingface.co/Qwen/Qwen2.5-14B-Instruct/blob/main/LICENSE language: - en pipeline_tag: text-generation base_model: Qwen/Qwen2.5-14B tags: - chat library_name: transformers quantized_by: pipilok --- Original model: https://huggingface.co/Qwen/Qwen2.5-14B-Instruct Tested on Snapdragon X Elite with LM Studio 0.3.2 ARM64 Technology Preview https://lmstudio.ai/snapdragon Avg answer Speed: 9.5 tok/s ## LM Studio Settings: ``` Before System: <|im_start|>system\n After System: <|im_end|>\n Before User: <|im_start|>user\n After User: <|im_end|>\n Before Assistant: <|im_start|>assistant\n After Assistant: <|im_end|>\n ```