🚀NEW LABGetting Started with Claude AgentsStart lab
Agents · Robotics

Compositional Foundation Models (HiP)

First page
Compositional Foundation Models (HiP)
Paper summary

Proposes foundation models that compose multiple expert foundation models trained on different modalities to solve long-horizon goals.

Ask this paper

Key points
01

Hierarchical planning: Uses separate foundation models for language (high-level plans), vision (grounding), and action (execution) that compose into a hierarchical planner.

02

Long-horizon goals: Targets goals requiring dozens of subgoals - a regime where monolithic policies typically fail.

03

Training-free composition: Composes existing pretrained models at inference time without joint training, dramatically reducing the compute cost of long-horizon agents.

04

Robotics relevance: Demonstrates the approach on robotic manipulation tasks, pointing toward practical long-horizon embodied-AI systems.

Every Monday
Get next week’s papers.
Subscribe on Substack