AlphaCodium
Free while signed in. Answers cite the passages they came from.
AlphaCodium is a test-based, iterative "flow" that turns off-the-shelf LLMs into strong competitive-programming solvers without model training.
Test-based iteration: Instead of a single-shot prompt, AlphaCodium runs a staged pipeline - problem self-reflection, public-test enrichment, iterative code generation, and test-driven refinement.
Public test enrichment: AI-generated additional tests expand the usually thin public-test set, giving the iterative loop more signal for verification.
CodeContests gains: On CodeContests validation, GPT-4 pass@5 jumps from 19% with a well-crafted single prompt to 44% using the AlphaCodium flow.
4 orders of magnitude fewer calls: Outperforms DeepMind's AlphaCode while using roughly 10,000x fewer LLM calls, highlighting how structured test-driven flows dominate brute-force sampling.
Get next week’s papers.
The same picks and the same summaries, in your inbox. Free, and 176 issues deep.
Subscribe on Substack