🚀NEW LABGetting Started with Claude AgentsStart lab
Retrieval

Learning to Filter Context for RAG (FILCO)

First page
Learning to Filter Context for RAG (FILCO)
Paper summary

CMU's FILCO improves RAG by training a dedicated model to filter retrieved contexts before they reach the generator.

Ask this paper

Key points
01

Useful-context identification: Uses lexical and information-theoretic signals to identify genuinely useful portions of retrieved documents, rather than passing everything through.

02

Context-filter training: Trains a separate filtering model whose only job is to retain useful context at inference time.

03

Extractive QA wins: Outperforms prior RAG approaches on extractive QA benchmarks, a clean demonstration that context filtering is a high-leverage component.

04

Modular addition: Slots in between retrieval and generation, making it compatible with any retriever/generator pairing.

Every Monday
Get next week’s papers.
Subscribe on Substack