Crowd Workers Widely Use LLMs for Text Production

LLM-generated contamination: Estimates that a third to almost half of crowd-worker text production involved LLMs - a massive data quality issue.

Benchmark contamination risk: Implications for NLP datasets produced via crowdsourcing, potentially invalidating many "human baseline" numbers.

Methodology: Uses statistical analysis comparing completion times, stylistic features, and output consistency to estimate LLM usage.

Community wake-up: Sparked widespread discussion about the future of human-generated data and the need for AI-usage detection.