Active Retrieval Augmented LLMs (FLARE)

Dynamic retrieval: Retrieves only when the model's next-token confidence drops - not at fixed intervals.

Anticipated content retrieval: Retrieves based on what the model is about to generate, not just the current context.

Long-form knowledge-intensive tasks: Demonstrates superior or competitive performance on long-form knowledge-intensive generation tasks.

Adaptive RAG: Established a research direction on adaptive/active retrieval that matured in 2024 with tools like Self-RAG and RankRAG.