GenBench
Free while signed in. Answers cite the passages they came from.
A Nature Machine Intelligence paper framework for characterizing and understanding generalization research in NLP.
Meta-analysis: Reviews 543 papers on generalization in NLP, mapping what "generalization" actually means across different research threads.
Generalization taxonomy: Organizes generalization into compositional, structural, cross-lingual, cross-task, and cross-domain generalization types.
Evaluation taxonomy: Provides tools for classifying generalization studies by the kind of distribution shift and evaluation protocol they test.
Research infrastructure: Ships with tools to help researchers classify and compare generalization work, aiming to reduce conceptual fragmentation in the field.
Get next week’s papers.
The same picks and the same summaries, in your inbox. Free, and 176 issues deep.
Subscribe on Substack