🚀NEW LABGetting Started with Claude AgentsStart lab
Evaluation

Humor in ChatGPT

First page
Humor in ChatGPT
Paper summary

Explores ChatGPT's capabilities to grasp and reproduce humor.

Ask this paper

Key points
01

Joke repetition: Over 90% of 1,008 generated jokes were the same 25 jokes - revealing extreme mode collapse in humor generation.

02

Structural overfitting: ChatGPT is overfit to particular joke structures (e.g., "Why did X? Because Y") and struggles with diverse humor styles.

03

Humor comprehension: While generation is limited, ChatGPT can explain joke structure and recognize humor - showing a partial understanding.

04

Creativity evaluation: An influential paper in the creativity-evaluation literature, documenting specific failures of LLM creative generation.

Every Monday
Get next week’s papers.
Subscribe on Substack