AI Papers of the Week
Every paper worth reading in AI, hand-picked one week at a time.
Discover and explore top AI papers withClaude CodeCodex
npx @dair-ai/mcp setup
CodeGen2.5
Salesforce's new 7B code LLM trained on 1.5T tokens and optimized for fast sampling.
Elastic Decision Transformer
An advance over Decision Transformers that enables trajectory stitching at inference time.
Robots That Ask for Help
A framework for calibrating LLM-based robot planners so they ask for help when uncertain.
Physics-based Motion Retargeting in Real-Time
Uses RL to retarget motions from sparse human sensor data to characters of various morphologies.
Scaling Transformer to 1 Billion Tokens (LongNet)
Microsoft's Transformer variant scaling sequence length past 1B tokens.
InterCode
A framework treating interactive coding as a reinforcement learning environment.
LeanDojo
An open-source Lean playground consisting of toolkits, data, models, and benchmarks for theorem proving.
Extending Context Window of LLMs (PI)
Position Interpolation extends LLaMA's context to 32K with minimal fine-tuning (within 1000 steps).
Computer Vision Through the Lens of Natural Language
A modular approach solving CV problems by routing through LLM reasoning.
Visual Navigation Transformer (ViNT)
A foundation model for vision-based robotic navigation built on flexible Transformers.
Generative AI for Programming Education
Evaluates GPT-4 and ChatGPT on programming education scenarios versus human tutors.
DragDiffusion
Extends interactive point-based image editing to diffusion models.
Understanding Theory-of-Mind in LLMs with LLMs
A framework for procedurally generating ToM evaluations using LLMs themselves.
Evaluations with No Labels
Self-supervised evaluation of LLMs via sensitivity/invariance to input transformations.
Long-range Language Modeling with Self-Retrieval
Jointly trains a retrieval-augmented LM from scratch for long-range modeling.
Scaling MLPs: A Tale of Inductive Bias
Shows MLPs scale with compute despite their lack of inductive bias.
Textbooks Are All You Need (phi-1)
Introduces a 1.3B parameter code LLM trained on textbook-quality data.
RoboCat
DeepMind's self-improving foundation agent that operates different robotic arms from as few as 100 demonstrations.
ClinicalGPT
A language model optimized through extensive and diverse medical data and multi-turn dialogue.
An Overview of Catastrophic AI Risks
Dan Hendrycks' comprehensive overview of catastrophic AI risk categories.
LOMO
A memory-efficient optimizer that combines gradient computation and parameter update in one step.
SequenceMatch
Formulates sequence generation as imitation learning, enabling backtracking via a backspace action.
LMFlow
An extensible and lightweight toolkit for fine-tuning and inference of large foundation models.
MotionGPT
Generates consecutive human motions from multimodal control signals via LLM instructions.