AI Papers of the Week
Every paper worth reading in AI, hand-picked one week at a time.
OpenFlamingo
An open-source family of autoregressive vision-language models spanning 3B to 9B parameters.
Self-Check
Explores LLM capacity for self-checking on complex reasoning tasks requiring multi-step and non-linear thinking.
Med-PaLM Multimodal
Introduces a generalist biomedical AI system and a new multimodal biomedical benchmark with 14 tasks.
Foundation Models in Vision
A comprehensive survey on foundational models for computer vision and their open research directions.
L-Eval
A standardized evaluation suite for long-context language models.
Survey of Aligned LLMs
A comprehensive overview of alignment approaches covering data, training, and evaluation.
FacTool
A task- and domain-agnostic framework for factuality detection of LLM-generated text.
How is ChatGPT's Behavior Changing Over Time?
Evaluates GPT-3.5 and GPT-4 over months to show significant behavioral drift in deployed systems.
Challenges & Application of LLMs
A comprehensive enumeration of open challenges and application domains for LLMs.
Retrieve In-Context Examples for LLMs
A framework to iteratively train dense retrievers that identify high-quality in-context examples.
FLASK
Proposes fine-grained evaluation of LLMs decomposed into 12 alignment skill sets.
CM3Leon
Meta's retrieval-augmented multi-modal language model that generates both text and images.
Claude 2
Anthropic's second-generation LLM with a detailed model card on safety, alignment, and capabilities.
LongLLaMA
Extends LLaMA's context length using a contrastive training process that reshapes the (key, value) space.
LLMs as General Pattern Machines
Demonstrates LLMs serve as general sequence modelers without additional training.
A Survey on Evaluation of LLMs
A comprehensive overview of evaluation methods covering what, where, and how to evaluate LLMs.
How Language Models Use Long Contexts (Lost-in-the-Middle)
Shows LLM performance drops when relevant information is in the middle of a long context.
LLMs as Effective Text Rankers
A prompting technique that enables open-source LLMs to perform SOTA text ranking.
Elastic Decision Transformer
An advance over Decision Transformers that enables trajectory stitching at inference time.
InterCode
A framework treating interactive coding as a reinforcement learning environment.
LeanDojo
An open-source Lean playground consisting of toolkits, data, models, and benchmarks for theorem proving.
Extending Context Window of LLMs (PI)
Position Interpolation extends LLaMA's context to 32K with minimal fine-tuning (within 1000 steps).
Understanding Theory-of-Mind in LLMs with LLMs
A framework for procedurally generating ToM evaluations using LLMs themselves.
Evaluations with No Labels
Self-supervised evaluation of LLMs via sensitivity/invariance to input transformations.