🚀NEW LABGetting Started with Claude AgentsStart lab
Retrieval

RAG for Long-Form QA

First page
RAG for Long-Form QA
Paper summary

Explores retrieval-augmented LMs specifically on long-form question answering, where RAG failures are more subtle.

Ask this paper

Key points
01

Retrieval is necessary: Confirms that retrieval is an important component for long-form QA, but that evidence documents must be carefully curated and ordered.

02

Attribution errors: Documents attribution errors - where the model cites passages that don't actually support its claims - and shows these spike when retrieved docs lack sufficient evidence.

03

Document ordering: Demonstrates that document order within the context substantially affects long-form QA attribution accuracy.

04

Practical guidelines: Offers concrete guidelines for document selection, ordering, and prompting to reduce hallucination in long-form RAG outputs.

Every Monday
Get next week’s papers.
Subscribe on Substack