TAPIR
Free while signed in. Answers cite the passages they came from.
Tracks any queried point on any physical surface throughout a video sequence faster than real-time.
Any-point tracking: Generalizes object tracking to arbitrary query points, handling occlusions and re-appearances robustly.
Faster than real-time: On modern GPUs, tracks points faster than real-time on long, high-resolution videos - practical for real-world applications.
SOTA across benchmarks: Outperforms all prior baselines on standard point-tracking benchmarks.
Video understanding building block: Point tracking is a fundamental primitive for video understanding, editing, and robotics - TAPIR made it practical.
Get next week’s papers.
The same picks and the same summaries, in your inbox. Free, and 176 issues deep.
Subscribe on Substack