Compositional Foundation Models (HiP)
First page

Paper summary
Proposes foundation models that compose multiple expert foundation models trained on different modalities to solve long-horizon goals.
Ask this paper
01
Hierarchical planning: Uses separate foundation models for language (high-level plans), vision (grounding), and action (execution) that compose into a hierarchical planner.
02
Long-horizon goals: Targets goals requiring dozens of subgoals - a regime where monolithic policies typically fail.
03
Training-free composition: Composes existing pretrained models at inference time without joint training, dramatically reducing the compute cost of long-horizon agents.
04
Robotics relevance: Demonstrates the approach on robotic manipulation tasks, pointing toward practical long-horizon embodied-AI systems.