TÜLU 2
Allen AI's TÜLU 2 is a suite of improved open instruction-tuned LLMs and an accompanying study of adaptation best practices.
Ask this paper
Open suite: Releases open models that match or exceed GPT-3.5-turbo-0301 on several benchmarks, a meaningful milestone for the open ecosystem at the time.
Post-training recipe: The paper doubles as a practical recipe, documenting how instruction data curation, mixing ratios, and DPO-based preference training interact.
UltraFeedback preference data: Uses UltraFeedback for preference optimization, validating that openly released preference datasets are sufficient to close much of the gap to commercial post-training pipelines.
Adaptation research platform: Explicitly positioned as a platform for studying open adaptation techniques, informing the TÜLU 3 release that would follow in 2024.