GPT Solves Math Problems Without a Calculator
Free while signed in. Answers cite the passages they came from.
Demonstrates that with sufficient training data, even a small language model can perform accurate multi-digit arithmetic.
2B model, 100% arithmetic: A 2B language model performs multi-digit arithmetic operations with 100% accuracy, without data leakage or calculator tools.
GLM-10B on Chinese math: A GLM-10B fine-tuned on multi-step arithmetic and detailed math problems is competitive with GPT-4 on a 5K-sample Chinese math problem test set.
Data-centric argument: Suggests arithmetic "weakness" in LLMs is largely a data-coverage issue rather than a fundamental architectural limit.
Tool-free reasoning: Pushes back on the common view that LLMs can never do reliable arithmetic without tool use, with implications for tool-use-vs-internal-computation design choices.
Get next week’s papers.
The same picks and the same summaries, in your inbox. Free, and 176 issues deep.
Subscribe on Substack