Chat template
#1
by
Yuma42
- opened
Is this model really using chatml as stated here?: https://huggingface.co/bartowski/Replete-LLM-V2.5-Qwen-7b-GGUF
I did some tests and chatml seems to work best but different templates change the output a lot (one I improvised changed the output into Chinese).
Qwen-2.5 has its own custom chat template but its essentially just a fancy chatml that has function calling support