LLMs Represent Space and Time

Linear geographic representations: Activations contain linear representations of coordinates (latitude, longitude) of real-world entities, detectable via probes.

Multi-scale time: Similar linear representations exist for time at multiple scales (historical year, news date, etc.), suggesting a structured temporal axis.

Robust across prompts: The representations are robust to prompt variations and unified across different entity types (cities, events, people).

World-model evidence: Provides empirical support for the claim that LLMs build literal world models, not just surface-statistics imitators - a live debate in interpretability.