Computer Vision Through the Lens of Natural Language
Free while signed in. Answers cite the passages they came from.
A modular approach solving CV problems by routing through LLM reasoning.
Modular CV pipeline: Uses LLMs to reason over outputs from independent, descriptive vision modules that each provide partial information about an image.
Interpretable intermediate: Intermediate language descriptions are human-readable, improving debugability versus end-to-end VLMs.
Tool-augmented vision: Part of the broader "LLM as cognitive core" research direction where LLMs orchestrate specialized tools.
VLM alternative: Offers a complementary paradigm to end-to-end VLM training, trading compute for modularity and interpretability.
Get next week’s papers.
The same picks and the same summaries, in your inbox. Free, and 176 issues deep.
Subscribe on Substack