Textbooks Are All You Need II (phi-1.5)
Microsoft's phi-1.5 demonstrates that a 1.3B model trained on "textbook-quality" synthetic data rivals much larger models on reasoning.
The Rise and Potential of LLM-Based Agents
A comprehensive survey of LLM-based agents covering construction, capability, and societal implications.
EvoDiff
Microsoft's EvoDiff combines evolutionary-scale protein data with diffusion models for controllable protein generation in sequence space.
Rewindable Auto-regressive INference (RAIN)
Shows that unaligned LLMs can produce aligned responses at inference time via self-evaluation and rewinding.
Robot Parkour Learning
Stanford's Robot Parkour system learns end-to-end vision-based parkour policies that transfer to a quadrupedal robot.
Hallucination Survey (Early)
Classifies hallucination phenomena in LLMs and catalogs evaluation criteria and mitigation strategies.
Agents Library
An open-source library for building autonomous language agents with first-class support for planning, memory, tools, and multi-agent communication.
Radiology-Llama 2
A Llama 2-based LLM specialized for radiology report generation.
ChatDev (Communicative Agents for Software Development)
ChatDev is a virtual chat-powered software company where LLM agents take on roles in a waterfall-model dev process.
MAmmoTH
An open-source LLM family specialized for general mathematical problem solving.
Get next week’s papers.
The same picks and the same summaries, in your inbox. Free, and 176 issues deep.
Subscribe on Substack