RankZephyr
Free while signed in. Answers cite the passages they came from.
RankZephyr is an open-source LLM for listwise zero-shot reranking that bridges the effectiveness gap with GPT-4.
Listwise zero-shot: Reranks a full candidate list in a single shot rather than doing pairwise or pointwise scoring, matching the paradigm GPT-4 uses most effectively.
Open-source: Based on the open Zephyr chat model, releasing a fully reproducible stack for high-quality reranking.
Matches/beats GPT-4: Competitive with GPT-4 on standard reranking benchmarks and outperforms GPT-4 on NovelEval, a post-training-cutoff benchmark resistant to contamination.
Contamination-free win: The NovelEval advantage is particularly meaningful because it addresses the concern that GPT-4's strong reranking numbers are partly driven by memorization of benchmark queries.
Get next week’s papers.
The same picks and the same summaries, in your inbox. Free, and 176 issues deep.
Subscribe on Substack