AI Papers of the Week
Every paper worth reading in AI, hand-picked one week at a time.
Discover and explore top AI papers withClaude CodeCodex
npx @dair-ai/mcp setup
Llama 2
Meta's open-weight foundation model family with chat-tuned variants ranging from 7B to 70B parameters.
How is ChatGPT's Behavior Changing Over Time?
Evaluates GPT-3.5 and GPT-4 over months to show significant behavioral drift in deployed systems.
FlashAttention-2
Tri Dao's follow-up to FlashAttention, dramatically improving attention throughput on modern GPUs.
Measuring Faithfulness in Chain-of-Thought Reasoning
Anthropic's investigation into whether CoT reasoning actually reflects the model's internal decision process.
Generative TV & Showrunner Agents
Fable Studio's approach to generate episodic TV content using LLMs and multi-agent simulation.
Challenges & Application of LLMs
A comprehensive enumeration of open challenges and application domains for LLMs.
Retentive Network (RetNet)
Microsoft's proposed foundation architecture aiming to replace Transformer attention for LLMs.
Meta-Transformer
A unified framework performing learning across 12 different modalities with a shared backbone.
Retrieve In-Context Examples for LLMs
A framework to iteratively train dense retrievers that identify high-quality in-context examples.
FLASK
Proposes fine-grained evaluation of LLMs decomposed into 12 alignment skill sets.
CM3Leon
Meta's retrieval-augmented multi-modal language model that generates both text and images.
Claude 2
Anthropic's second-generation LLM with a detailed model card on safety, alignment, and capabilities.
Secrets of RLHF in LLMs
A deep investigation into RLHF with a focus on the inner workings of PPO, including open-source code.
LongLLaMA
Extends LLaMA's context length using a contrastive training process that reshapes the (key, value) space.
Patch n' Pack: NaViT
A vision transformer handling any aspect ratio and resolution through sequence packing.
LLMs as General Pattern Machines
Demonstrates LLMs serve as general sequence modelers without additional training.
HyperDreamBooth
A smaller, faster, and more efficient version of DreamBooth for personalizing text-to-image models.
Teaching Arithmetic to Small Transformers
Trains small transformers on chain-of-thought style data for arithmetic with large gains.
AnimateDiff
Animates frozen text-to-image diffusion models via a plug-in motion modeling module.
Generative Pretraining in Multimodality (Emu)
A transformer-based multimodal foundation model for generating images and text.
A Survey on Evaluation of LLMs
A comprehensive overview of evaluation methods covering what, where, and how to evaluate LLMs.
How Language Models Use Long Contexts (Lost-in-the-Middle)
Shows LLM performance drops when relevant information is in the middle of a long context.
LLMs as Effective Text Rankers
A prompting technique that enables open-source LLMs to perform SOTA text ranking.
Multimodal Generation with Frozen LLMs
Maps images to LLM token space enabling models like PaLM and GPT-4 to handle visual tasks without parameter updates.