LLMs as Effective Text Rankers
First page

Paper summary
A prompting technique that enables open-source LLMs to perform SOTA text ranking.
Ask this paper
01
Pairwise ranking prompt: Uses pairwise prompting (A vs. B) rather than pointwise scoring, which aligns better with LLM reasoning strengths.
02
Open-source SOTA: Achieves state-of-the-art text ranking on standard benchmarks using only open-weight LLMs - no proprietary API required.
03
Retrieval pipeline fit: Designed to slot into existing retrieval pipelines as a re-ranker stage.
04
RAG infrastructure: Influenced 2024's RAG reranker ecosystem, with LLM-based reranking becoming standard in production retrieval stacks.