AI Papers of the Week
Every paper worth reading in AI, hand-picked one week at a time.
PMC-LLaMA
A LLaMA model fine-tuned on 4.8 million medical papers.
Distilling Step-by-Step!
A mechanism to train smaller models that outperform larger LLMs using fewer examples.
Poisoning Language Models During Instruction Tuning
Shows adversaries can poison LLMs via instruction tuning data.
Unlimiformer
Long-range Transformers with unlimited length input via external datastores.
A Cookbook of Self-Supervised Learning
A comprehensive overview of SSL techniques and practical considerations.
ChatGPT for Information Extraction
A deeper assessment of ChatGPT on information extraction tasks.
DINOv2
Meta's self-supervised vision foundation model producing robust features without labels.
Visual Instruction Tuning (LLaVA)
Uses language-only GPT-4 to generate multimodal instruction-following data.
ChatGPT: Applications, Opportunities, and Threats
A comprehensive overview of ChatGPT's applications and risks.
Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fields
Combines mip-NeRF 360 with grid-based models for 22x faster training.
Automatic Gradient Descent: Deep Learning without Hyperparameters
A hyperparameter-free first-order optimizer that leverages architecture.
One Small Step for Generative AI, One Giant Leap for AGI
A complete survey on ChatGPT and GPT-4.
Instruction Tuning with GPT-4
Uses GPT-4 to generate instruction-following data for LLM fine-tuning.
A Survey of Large Language Models
A 50-page comprehensive survey on LLMs.
Baize: An Open-Source Chat Model with Self-Chat Data
An open chat model fine-tuned with LoRA on self-chat dialogs.
Better Language Models of Code through Self-Improvement
Self-improving code LLMs via pseudo-data generation.
Summary of ChatGPT/GPT-4 Research
An overview of ChatGPT and GPT-4 applications based on 194 papers.
Pythia
EleutherAI's suite for analyzing LLMs across training and scaling.