Drag Your GAN (DragGAN)
Interactive point-based image manipulation on the generative image manifold.
Evidence of Meaning in Language Models Trained on Programs
Argues LMs learn meaning despite only next-token prediction.
Towards Expert-Level Medical Question Answering (Med-PaLM 2)
Google's second-generation medical LLM.
MEGABYTE
Multiscale Transformers for predicting million-byte sequences.
StructGPT
A general framework for LLM reasoning over structured data.
TinyStories
Explores how small LMs can be and still speak coherent English.
DoReMi
Optimizes data mixtures for faster language model pretraining.
CodeT5+
An open code LLM family for code understanding and generation.
Symbol tuning
Fine-tunes LMs on in-context input-label pairs with natural-language labels replaced by arbitrary symbols.
Incidental Bilingualism in PaLM's Translation Capability
Explores where PaLM's translation ability actually comes from.