Computer Vision Through the Lens of Natural Language

Modular CV pipeline: Uses LLMs to reason over outputs from independent, descriptive vision modules that each provide partial information about an image.

Interpretable intermediate: Intermediate language descriptions are human-readable, improving debugability versus end-to-end VLMs.

Tool-augmented vision: Part of the broader "LLM as cognitive core" research direction where LLMs orchestrate specialized tools.

VLM alternative: Offers a complementary paradigm to end-to-end VLM training, trading compute for modularity and interpretability.