LMSYS-Chat-1M
First page
Paper summary
LMSYS releases a large-scale dataset of 1 million real-world LLM conversations collected from the Vicuna demo and Chatbot Arena.
Ask this paper
01
1M conversations: Comprises 1 million real-world conversations across 25 state-of-the-art LLMs, a uniquely broad snapshot of how people actually use chat models.
02
210K unique users: Collected from 210K unique IP addresses, giving a diverse user sample rather than a curated research group.
03
Real-world use cases: Captures natural usage patterns - coding help, writing, exploration, role-play - across many topics and languages.
04
Research resource: Opens up research directions in LLM evaluation, preference modeling, and usage-pattern analysis that were previously gated by data scarcity.