CogAgent
Tsinghua's CogAgent is an 18B-parameter visual-language model purpose-built for GUI understanding and navigation, with unusually high input resolution.
Ask this paper
High-res GUI input: Supports 1120x1120 input resolution via a dedicated high-res cross-module, letting it read small fonts and dense UI elements that typical VLMs blur out.
Dual-tower vision: Combines a low-res general vision encoder with a high-res cross-module, balancing context understanding with fine-grained icon/text perception.
Broad capabilities: Handles visual Q&A, visual grounding, and end-to-end GUI agent tasks on web and desktop, positioning as a general GUI backbone.
SoTA VQA: Achieves state-of-the-art on 5 text-rich (e.g., OCR-heavy) and 4 general VQA benchmarks, covering document, chart, and scene understanding.