Textbooks Are All You Need (phi-1)
Introduces a 1.3B parameter code LLM trained on textbook-quality data.
RoboCat
DeepMind's self-improving foundation agent that operates different robotic arms from as few as 100 demonstrations.
ClinicalGPT
A language model optimized through extensive and diverse medical data and multi-turn dialogue.
An Overview of Catastrophic AI Risks
Dan Hendrycks' comprehensive overview of catastrophic AI risk categories.
LOMO
A memory-efficient optimizer that combines gradient computation and parameter update in one step.
SequenceMatch
Formulates sequence generation as imitation learning, enabling backtracking via a backspace action.
LMFlow
An extensible and lightweight toolkit for fine-tuning and inference of large foundation models.
MotionGPT
Generates consecutive human motions from multimodal control signals via LLM instructions.
Wanda
A simple, effective pruning approach for LLMs requiring no retraining.
AudioPaLM
Fuses PaLM-2 and AudioLM into a multimodal architecture supporting speech understanding and generation.
Get next week’s papers.
The same picks and the same summaries, in your inbox. Free, and 176 issues deep.
Subscribe on Substack