🚀NEW LABGetting Started with Claude AgentsStart lab
← All papersIssue 37 of 182

The week of Dec 11 – Dec 17, 2023

10 papers, hand-picked and summarised.

FunSearch

FunSearch

DeepMind's FunSearch uses LLMs as a mutation operator in an evolutionary loop to discover genuinely new mathematical knowledge.

01Safety
Weak-to-Strong Generalization

Weak-to-Strong Generalization

OpenAI's superalignment team shows that weak supervisors can still elicit capabilities from much stronger models - a first empirical signal for scalable oversight.

02Training
Audiobox

Audiobox

Meta's Audiobox is a unified flow-matching audio model that generates speech, sound effects, and music from natural-language and example prompts.

03Multimodal
Mathematical LLMs Survey

Mathematical LLMs Survey

A survey on the progress of LLMs on mathematical reasoning tasks, covering methods, benchmarks, and open problems.

04Reasoning
LLM360

LLM360

LLM360 is a framework for fully transparent open-source LLM development, with everything from data to training dynamics released.

05Training
LLMs in Medicine

LLMs in Medicine

A comprehensive survey (300+ papers) of LLMs applied to medicine, from clinical tasks to biomedical research.

06Evaluation
Beyond Human Data (ReST-EM)

Beyond Human Data (ReST-EM)

DeepMind's ReST-EM shows that model-generated data plus a reward function can substantially reduce dependence on human-generated data.

07Data
Gaussian-SLAM

Gaussian-SLAM

A neural RGBD SLAM method that extends 3D Gaussian Splatting to achieve photorealistic scene reconstruction without sacrificing speed.

08Training
Pearl

Pearl

Meta's Pearl is a production-ready reinforcement learning agent package designed for real-world deployment constraints.

09Agents
QuIP#

QuIP#

Cornell's QuIP# is a 2-bit LLM quantization scheme that combines lattice codebooks with incoherence processing to close the quality gap to FP16.

10Efficiency
Every Monday
Get next week’s papers.
Subscribe on Substack