Learning to Filter Context for RAG (FILCO)
First page

Paper summary
CMU's FILCO improves RAG by training a dedicated model to filter retrieved contexts before they reach the generator.
Ask this paper
01
Useful-context identification: Uses lexical and information-theoretic signals to identify genuinely useful portions of retrieved documents, rather than passing everything through.
02
Context-filter training: Trains a separate filtering model whose only job is to retain useful context at inference time.
03
Extractive QA wins: Outperforms prior RAG approaches on extractive QA benchmarks, a clean demonstration that context filtering is a high-leverage component.
04
Modular addition: Slots in between retrieval and generation, making it compatible with any retriever/generator pairing.