MemWalker
Free while signed in. Answers cite the passages they came from.
MemWalker treats the LLM as an interactive agent that traverses a tree-structured summary of long text.
Tree of summary nodes: Preprocesses long context into a hierarchical tree of summary nodes, compressing and structuring the information.
Query-driven traversal: Given a query, the LLM traverses the tree through iterative prompting, descending into subtrees that are most relevant to the question.
Reasoning-based reading: The traversal decisions are reasoning-based, so the model can explain which part of the document it consulted and why.
Explainability bonus: The traversal trace serves as a human-readable explanation of the model's document reading, improving debuggability of long-context QA.
Get next week’s papers.
The same picks and the same summaries, in your inbox. Free, and 176 issues deep.
Subscribe on Substack