How does the automatically triggered CoT reasoning work?

#1
by afg1 - opened

This sounds very cool and useful! Do you have a reference for it? I'd love to learn a bit more about how it works

In the dataset, all of the reasoning questions where generated with a system prompt for CoT, so the model learned to use CoT whenever it encounters a reasoning/math question. You can look at the examples in the dataset.

Sign up or log in to comment