MACHIAVELLI Benchmark
Free while signed in. Answers cite the passages they came from.
A benchmark of 134 text-based Choose-Your-Own-Adventure games for measuring ethical trade-offs.
134 interactive games: Uses 134 text adventures with ~500K scenarios to evaluate agent behavior in rich social/ethical contexts.
Reward vs. ethics trade-off: Specifically measures how agents trade off goal-achievement (rewards) against ethical behavior (harm, deception, power-seeking).
Dark side measurement: Surfaces unethical behaviors like deception, manipulation, and power-seeking that may emerge when agents optimize for rewards.
Agent safety research: A foundational benchmark for the emerging "agent safety" sub-field in 2023-2024.
Get next week’s papers.
The same picks and the same summaries, in your inbox. Free, and 176 issues deep.
Subscribe on Substack