🚀NEW LABGetting Started with Claude AgentsStart lab
Reasoning

To CoT or not to CoT?

First page
To CoT or not to CoT?
Paper summary

investigates what kinds of tasks benefit the most from chain-of-thought (CoT) prompting; after a meta-analysis on 100+ papers and several evaluations, it finds that CoT produces strong performance benefits primarily on tasks involving math and logic; they find that most of the CoT gain comes from improving symbolic execution, but a symbolic solver outperforms it.

Ask this paper

Every Monday
Get next week’s papers.
Subscribe on Substack