Multimodal

Tracking Everything Everywhere All at Once (OmniMotion)

First page

Paper summary

Test-time optimization for dense, long-range motion estimation.

Ask this paper

Key points

Per-pixel motion: Estimates motion for every pixel across every frame of a video, producing dense long-range trajectories.

Test-time optimization: Optimizes a quasi-3D representation per video at test time, producing coherent long-range correspondences.

Through occlusions: Maintains point tracking even through long occlusions and complex camera motion - prior methods struggled with both.

Video understanding primitive: A foundational capability that enables downstream video editing, object removal, and 3D reconstruction applications.

Every Monday