AI Papers of the Week
Every paper worth reading in AI, hand-picked one week at a time.
Rewindable Auto-regressive INference (RAIN)
Shows that unaligned LLMs can produce aligned responses at inference time via self-evaluation and rewinding.
Hallucination Survey (Early)
Classifies hallucination phenomena in LLMs and catalogs evaluation criteria and mitigation strategies.
Radiology-Llama 2
A Llama 2-based LLM specialized for radiology report generation.
Transformers as Support Vector Machines
A theoretical paper establishing a formal connection between self-attention optimization and hard-margin SVM problems.
RLAIF (Scaling RLHF with AI Feedback)
Google compares RLHF with RLAIF (Reinforcement Learning from AI Feedback) to test whether AI preferences can replace human preferences.
GPT Solves Math Problems Without a Calculator
Demonstrates that with sufficient training data, even a small language model can perform accurate multi-digit arithmetic.
Explaining Grokking
DeepMind advances our understanding of grokking, predicting and confirming two novel phenomena that test their theory.
FLM-101B
A 101B parameter open LLM trainable on a $100K budget through a growth-based training strategy.
LLaSM (Large Language and Speech Model)
A combined language-and-speech model trained with cross-modal conversational abilities.
SAM-Med2D
Adapts the Segment Anything Model (SAM) to 2D medical imaging through large-scale medical fine-tuning.
Graph of Thoughts (GoT)
Generalizes Chain-of-Thought and Tree-of-Thought by modeling LLM reasoning as an arbitrary graph.
MVDream
ByteDance's MVDream is a multi-view diffusion model that generates geometrically consistent images from multiple viewpoints given a text prompt.
FaceChain
Alibaba's FaceChain is a personalized portrait generation framework that produces identity-preserving portraits from just a handful of input photos.
Survey on Instruction Tuning for LLMs
A comprehensive survey of instruction tuning covering methodology, dataset construction, and applications.
Giraffe
A family of context-extended Llama and Llama 2 models, along with an empirical study of context-extension techniques.
Prompt2Model
CMU's Prompt2Model automates the path from a natural-language task description to a deployable small special-purpose model.
Humpback (Self-Alignment with Instruction Backtranslation)
Meta's Humpback automatically generates instruction-tuning data by back-translating web text into plausible instructions.
Platypus
Platypus is a family of fine-tuned and merged LLMs that topped the Open LLM Leaderboard in August 2023.
Model Compression for LLMs Survey
A survey of recent model-compression techniques applied specifically to LLMs.
Shepherd
Meta's Shepherd is a 7B language model specifically tuned to critique model outputs and suggest refinements.
Teach LLMs to Personalize
A multitask-learning approach for personalized text generation without relying on predefined user attributes.
Political Biases in NLP Models
Develops methods to measure political and media biases in LLMs and their downstream effects.
AgentBench
Tsinghua's AgentBench is a multidimensional benchmark for LLM-as-Agent reasoning and decision-making across 8 environments.
SynJax
DeepMind's SynJax is a JAX-based library for efficient vectorized inference in structured distributions.