AI Papers of the Week
Every paper worth reading in AI, hand-picked one week at a time.
Mathematical Exploration and Discovery at Scale
Google DeepMind, Princeton, Brown, and Terence Tao apply AlphaEvolve, an AI system using LLM-guided evolutionary search to autonomously discover mathematical constructions across analysis, combinatorics, geometry, and number theory. Across 67 problems, AlphaEvolve rediscovered best-known solutions, improved several problems, and extended finite solutions into general formulas with significantly reduced computation time.
Petri Dish Neural Cellular Automata
Sakana AI researchers introduce PD-NCA, a differentiable artificial life framework where multiple independent agents continuously update their parameters through gradient descent during simulation, enabling within-lifetime learning and open-ended behavioral change. The system exhibits emergent phenomena, including rock-paper-scissors dynamics, cyclic interactions, and spontaneous cooperation despite purely competitive optimization objectives.
Unlocking the Power of Multi-Agent LLM for Reasoning
Researchers from Penn State, Harvard, Microsoft, and collaborators introduce Dr. MAMR, addressing the “lazy agent” problem in multi-agent LLM reasoning through Shapley-inspired causal influence measurement and verifiable restart mechanisms. The framework achieves 78.6% on MATH500 (+4.2% over ReMA), 20.0% on AIME24, and maintains balanced agent contributions where baseline approaches collapse into single-agent dominance.
AgentFold
AgentFold introduces proactive context management for long-horizon web agents, addressing context saturation through dynamic “folding” operations that balance detail preservation with efficient compression. The 30B parameter model outperforms dramatically larger competitors while achieving state-of-the-art results on web browsing benchmarks.
Introspective Awareness
Anthropic research demonstrates that contemporary LLMs possess limited but functional introspective capabilities, the ability to recognize and accurately report on their own internal states. Using activation steering to inject known concepts into model activations, the study measures whether models can detect these manipulations through self-report, revealing that introspection remains highly unreliable and context-dependent.
Multi-Agent Evolve
Multi-Agent Evolve (MAE) enables LLMs to self-improve their reasoning capabilities without human-annotated data through a co-evolving multi-agent framework. Three interacting agents (Proposer, Solver, Judge) instantiated from a single LLM undergo reinforcement learning optimization together, creating a scalable self-improving system that extends beyond game-based environments to general reasoning domains.
SmolLM2
SmolLM2 demonstrates that strategic data curation beats scale through a 1.7B parameter model trained on 11 trillion tokens using iterative data mixing optimization. The data-centric approach introduces three specialized datasets (FineMath, Stack-Edu, SmolTalk) and dynamically refines composition across training stages, achieving superior performance over Qwen2.5-1.5B and Llama3.2-1B while enabling practical on-device deployment.
Global PIQA
Global PIQA extends physical commonsense reasoning evaluation to 100+ languages and cultural contexts, revealing how language models handle everyday practical scenarios across diverse linguistic communities. The benchmark goes beyond translation to include culturally-contextualized scenarios, uncovering significant performance variations that challenge assumptions about universal physical understanding in AI systems.
GAP
GAP introduces graph-based agent planning with parallel tool execution and reinforcement learning, enabling AI agents to coordinate multiple specialized capabilities simultaneously rather than sequentially. The framework significantly accelerates task completion and improves success rates on complex multi-step problems through optimized tool selection and execution ordering.
Stress-Testing Model Specs
This research examines how well large language models adhere to their stated behavioral guidelines by stress-testing AI constitutional specifications through value-tradeoff scenarios. Testing twelve frontier LLMs from major providers revealed over 70,000 cases of significant behavioral divergence, exposing logical inconsistencies, coverage gaps, and interpretive ambiguities in current specification frameworks.
Agent Data Protocol
Agent Data Protocol introduces a standardized format to unify fragmented agent training datasets across different tools and interfaces, enabling more efficient fine-tuning of LLM agents. By converting 13 existing datasets into this protocol and training on consolidated data, the work achieved ~20% performance improvements over baseline models while reaching state-of-the-art results on coding, browsing, and tool-use benchmarks. The protocol and datasets are publicly released to facilitate reproducible, scalable agent training across diverse domains.
Kimi Linear
Kimi Linear introduces a hybrid linear attention architecture combining Kimi Delta Attention (KDA) with periodic full attention layers at a 3:1 ratio, achieving superior performance over full attention while reducing KV cache by 75% and delivering 6× faster decoding at 1M context. KDA extends Gated DeltaNet with fine-grained channel-wise gating and specialized Diagonal-Plus-Low-Rank matrices, enabling more effective RNN memory management while maintaining hardware efficiency through optimized chunkwise algorithms that substantially reduce computation versus general DPLR formulations.
Precision-RL
Reinforcement learning fine-tuning of LLMs suffers from a critical numerical mismatch between training and inference engines, causing training instability and collapse. This work reveals that simply switching from BF16 to FP16 precision virtually eliminates this mismatch - achieving faster convergence, higher stability, and superior performance across diverse models, frameworks, and algorithms without any algorithmic changes or architectural modifications.
DeepSeek-OCR
DeepSeek-OCR explores compressing long text contexts into visual representations using a novel vision encoder architecture (DeepEncoder) that achieves 10-20x compression ratios while maintaining high OCR accuracy.
Continual Learning via Sparse Memory Finetuning
Meta AI researchers address catastrophic forgetting in language models through sparse memory finetuning, updating only memory slots most activated by new knowledge while achieving 89% less performance degradation than standard finetuning.
When Models Manipulate Manifolds
Anthropic researchers investigate how Claude 3.5 Haiku learns to predict line breaks in fixed-width text, revealing geometric representations analogous to biological place cells and boundary cells in biological brains.
Bayesian Influence Functions for Hessian-Free Data Attribution
Classical influence functions struggle with deep neural networks due to non-invertible Hessians and high-dimensional parameter spaces. This work introduces the local Bayesian influence function (BIF), which replaces Hessian inversion with loss landscape statistics estimated via stochastic-gradient MCMC sampling.
Reasoning with Sampling
Base language models achieve reasoning performance matching or exceeding RL-posttraining through inference-time power distribution sampling, using MCMC techniques that require no training, datasets, or verifiers.
Lookahead Routing for LLMs
Lookahead is a response-aware LLM routing framework that predicts latent representations of potential model outputs to enable more informed routing decisions without full inference.
Ring-1T
Ring-1T is the first open-source thinking model with 1 trillion parameters (~50B active per token), achieving breakthrough results through three innovations for trillion-scale RL training.
ColorAgent
ColorAgent is a mobile OS agent combining step-wise RL and self-evolving training with a multi-agent framework for personalized user engagement. It achieves 77.2% success on AndroidWorld and 50.7% on AndroidLab (SOTA among open models), while scoring 58.66% on MobileIAR for personalized intent alignment and 68.98% on VeriOS-Bench for trustworthiness.
Prompt-MII
CMU researchers propose Prompt-MII, an RL framework that meta-learns instruction induction across 3,000+ HuggingFace datasets, achieving 4-9 F1 point improvements on 90 unseen tasks while requiring 3-13x fewer tokens than in-context learning. Unlike APE (2000 LLM calls) and GEPA (150 calls), it generates compact instructions in a single forward pass and is training-free at test time.
Enterprise Deep Research
Salesforce AI researchers present EDR, a transparent multi-agent framework for enterprise deep research with human-in-the-loop steering via todo-driven task management and steerable context engineering. It achieves SOTA on DeepResearch Bench (49.86), 71.57% win rate on DeepConsult, and 68.5% on ResearchQA while consuming 4x fewer tokens than LangChain’s open deep research.
Cell2Sentence-Scale 27B
C2S-Scale extends Cell2Sentence by converting gene expression into “cell sentences” and training LLMs on 50M+ cells plus biological text. Models scale to 27B params and unify prediction, generation, and NL interpretation. A dual-context virtual screen then led to a wet-lab validated finding: silmitasertib acts as an interferon-conditional amplifier of MHC-I antigen presentation.