CogAgent
Free while signed in. Answers cite the passages they came from.
Tsinghua's CogAgent is an 18B-parameter visual-language model purpose-built for GUI understanding and navigation, with unusually high input resolution.
High-res GUI input: Supports 1120x1120 input resolution via a dedicated high-res cross-module, letting it read small fonts and dense UI elements that typical VLMs blur out.
Dual-tower vision: Combines a low-res general vision encoder with a high-res cross-module, balancing context understanding with fine-grained icon/text perception.
Broad capabilities: Handles visual Q&A, visual grounding, and end-to-end GUI agent tasks on web and desktop, positioning as a general GUI backbone.
SoTA VQA: Achieves state-of-the-art on 5 text-rich (e.g., OCR-heavy) and 4 general VQA benchmarks, covering document, chart, and scene understanding.
Get next week’s papers.
The same picks and the same summaries, in your inbox. Free, and 176 issues deep.
Subscribe on Substack