RAG for Long-Form QA
First page

Paper summary
Explores retrieval-augmented LMs specifically on long-form question answering, where RAG failures are more subtle.
Ask this paper
01
Retrieval is necessary: Confirms that retrieval is an important component for long-form QA, but that evidence documents must be carefully curated and ordered.
02
Attribution errors: Documents attribution errors - where the model cites passages that don't actually support its claims - and shows these spike when retrieved docs lack sufficient evidence.
03
Document ordering: Demonstrates that document order within the context substantially affects long-form QA attribution accuracy.
04
Practical guidelines: Offers concrete guidelines for document selection, ordering, and prompting to reduce hallucination in long-form RAG outputs.