While large language models perform few-shot in-context learning via prompting, they are still limited in reasoning tasks. In order to explore the potential reasoning ability of large language models, one standard approach is to provide different forms of thoughts in demonstrations.