
LeanDojo
An open-source Lean playground consisting of toolkits, data, models, and benchmarks for theorem proving.

Extending Context Window of LLMs (PI)
Position Interpolation extends LLaMA's context to 32K with minimal fine-tuning (within 1000 steps).

Computer Vision Through the Lens of Natural Language
A modular approach solving CV problems by routing through LLM reasoning.

Visual Navigation Transformer (ViNT)
A foundation model for vision-based robotic navigation built on flexible Transformers.

Generative AI for Programming Education
Evaluates GPT-4 and ChatGPT on programming education scenarios versus human tutors.

DragDiffusion
Extends interactive point-based image editing to diffusion models.

Understanding Theory-of-Mind in LLMs with LLMs
A framework for procedurally generating ToM evaluations using LLMs themselves.

Evaluations with No Labels
Self-supervised evaluation of LLMs via sensitivity/invariance to input transformations.

Long-range Language Modeling with Self-Retrieval
Jointly trains a retrieval-augmented LM from scratch for long-range modeling.

Scaling MLPs: A Tale of Inductive Bias
Shows MLPs scale with compute despite their lack of inductive bias.
Get next week’s papers.
The same picks and the same summaries, in your inbox. Free, and 176 issues deep.
Subscribe on Substack