Drag Your GAN (DragGAN)
Interactive point-based image manipulation on the generative image manifold.
Evidence of Meaning in Language Models Trained on Programs
Argues LMs learn meaning despite only next-token prediction.
Towards Expert-Level Medical Question Answering (Med-PaLM 2)
Google's second-generation medical LLM.
MEGABYTE
Multiscale Transformers for predicting million-byte sequences.
StructGPT
A general framework for LLM reasoning over structured data.
TinyStories
Explores how small LMs can be and still speak coherent English.
DoReMi
Optimizes data mixtures for faster language model pretraining.
CodeT5+
An open code LLM family for code understanding and generation.
Symbol tuning
Fine-tunes LMs on in-context input-label pairs with natural-language labels replaced by arbitrary symbols.
Incidental Bilingualism in PaLM's Translation Capability
Explores where PaLM's translation ability actually comes from.
Every Monday
Get next week’s papers.
The same picks and the same summaries, in your inbox. Free, and 176 issues deep.
Subscribe on Substack