Do we need the template?
Hi, downloading now, with big hopes. I'm curious what is this 4GB template file? I'm familiar with changing a template for ChatML, or Gemma2 or Mistral, but those are small text things, not a multi-gigabyte file?
If we do need to download both files, where does that 2nd file go? Just drop it in the same models folder?
Thanks!
The template is to show what the structure looks like (it's only supposed to contain KV data). You don't need to download it, but if you're curious you can open up the file in the HF viewer and peek inside. It's mostly just something I did to help me keep track of the model metadata when doing tensor operations. Hope this helps!
Ah, great to know. I've already got it working but hopefully this helps anyone else who might be hesitant to download such a large file.
It passed my usual set of questions, with a perfect 38/38 score, but so did the standard Instruct. It seems a little more chatty and was a pleasure to test.