
LeanDojo
An open-source Lean playground consisting of toolkits, data, models, and benchmarks for theorem proving.

Extending Context Window of LLMs (PI)
Position Interpolation extends LLaMA's context to 32K with minimal fine-tuning (within 1000 steps).

Computer Vision Through the Lens of Natural Language
A modular approach solving CV problems by routing through LLM reasoning.

Visual Navigation Transformer (ViNT)
A foundation model for vision-based robotic navigation built on flexible Transformers.

Generative AI for Programming Education
Evaluates GPT-4 and ChatGPT on programming education scenarios versus human tutors.

DragDiffusion
Extends interactive point-based image editing to diffusion models.

Understanding Theory-of-Mind in LLMs with LLMs
A framework for procedurally generating ToM evaluations using LLMs themselves.

Evaluations with No Labels
Self-supervised evaluation of LLMs via sensitivity/invariance to input transformations.

Long-range Language Modeling with Self-Retrieval
Jointly trains a retrieval-augmented LM from scratch for long-range modeling.

Scaling MLPs: A Tale of Inductive Bias
Shows MLPs scale with compute despite their lack of inductive bias.