Self-Check
First page
Paper summary
Explores LLM capacity for self-checking on complex reasoning tasks requiring multi-step and non-linear thinking.
Ask this paper
01
Zero-shot verification: Proposes a zero-shot verification scheme that recognizes errors in its own reasoning without external tools or references.
02
Weighted voting improvement: Applying self-check scores as weights in majority voting improves QA performance over standard CoT self-consistency.
03
Math word problems: Demonstrates improved accuracy on math word problems - tasks that benefit most from catching intermediate-step errors.
04
Self-critique groundwork: An early contribution to the self-critique literature that would mature through 2024 into Constitutional AI-style and debate-style methods.