Multimodal

Tracking Everything Everywhere All at Once (OmniMotion)

Free while signed in. Answers cite the passages they came from.

First page

The curator’s take

Test-time optimization for dense, long-range motion estimation.

Key points

Per-pixel motion: Estimates motion for every pixel across every frame of a video, producing dense long-range trajectories.

Test-time optimization: Optimizes a quasi-3D representation per video at test time, producing coherent long-range correspondences.

Through occlusions: Maintains point tracking even through long occlusions and complex camera motion - prior methods struggled with both.

Video understanding primitive: A foundational capability that enables downstream video editing, object removal, and 3D reconstruction applications.

Every Monday

The same picks and the same summaries, in your inbox. Free, and 176 issues deep.