Techniques to improve reliability
Source: Large Language Models are Zero-Shot Reasoners by Takeshi Kojima et al. (2022).

Results
Applying this simple trick to the MultiArith math dataset, the authors found Let's think step by step quadrupled the accuracy, from 18% to 79%!

zero-shot reasoning example