Safety

An Overview of Catastrophic AI Risks

First page

Paper summary

Dan Hendrycks' comprehensive overview of catastrophic AI risk categories.

Ask this paper

Key points

Four risk categories: Organizes catastrophic AI risks into malicious use, AI race dynamics, organizational risks, and rogue AIs.

Policy-relevant framing: Written for researchers, policymakers, and the broader public - influenced AI governance discussions through 2023-2024.

Risk concretization: Grounds abstract risk discussions in specific, plausible scenarios that can be analyzed and mitigated.

Governance reference: Widely cited in AI policy proposals, UK AI Safety Summit materials, and national AI strategies.

Every Monday