Textbooks Are All You Need II (phi-1.5)
Microsoft's phi-1.5 demonstrates that a 1.3B model trained on "textbook-quality" synthetic data rivals much larger models on reasoning.
The Rise and Potential of LLM-Based Agents
A comprehensive survey of LLM-based agents covering construction, capability, and societal implications.
EvoDiff
Microsoft's EvoDiff combines evolutionary-scale protein data with diffusion models for controllable protein generation in sequence space.
Rewindable Auto-regressive INference (RAIN)
Shows that unaligned LLMs can produce aligned responses at inference time via self-evaluation and rewinding.
Robot Parkour Learning
Stanford's Robot Parkour system learns end-to-end vision-based parkour policies that transfer to a quadrupedal robot.
Hallucination Survey (Early)
Classifies hallucination phenomena in LLMs and catalogs evaluation criteria and mitigation strategies.
Agents Library
An open-source library for building autonomous language agents with first-class support for planning, memory, tools, and multi-agent communication.
Radiology-Llama 2
A Llama 2-based LLM specialized for radiology report generation.
ChatDev (Communicative Agents for Software Development)
ChatDev is a virtual chat-powered software company where LLM agents take on roles in a waterfall-model dev process.
MAmmoTH
An open-source LLM family specialized for general mathematical problem solving.