JARVIS-1
Free while signed in. Answers cite the passages they came from.
An open-world multimodal agent for Minecraft that combines perception, planning, and memory into a self-improving system.
Multimodal perception: Processes visual Minecraft observations and natural-language instructions through a unified multimodal input pipeline.
Memory-augmented planning: Maintains a multimodal memory store of past observations and plans, enabling lifelong self-improvement across episodes.
Strong task coverage: Completes 200+ diverse Minecraft tasks with competitive success rates, including long-horizon tasks like diamond collection.
Open-world blueprint: An influential example of combining foundation models, memory, and explicit planning into an agent, foreshadowing many 2024 agent architectures.
Get next week’s papers.
The same picks and the same summaries, in your inbox. Free, and 176 issues deep.
Subscribe on Substack