🚀NEW LABGetting Started with Claude AgentsStart lab
Multimodal

Diffuse to Choose

First page
Diffuse to Choose
Paper summary

Amazon's Diffuse to Choose is a diffusion-based image-conditioned inpainting model built for "virtual try-on" scenarios where product images must be placed naturally into user scenes.

Ask this paper

Key points
01

Image-conditioned inpainting: Balances fast inference with high-fidelity product identity preservation, a trade-off that pure text-conditioned inpainting struggles with.

02

Accurate semantic manipulation: Successfully inserts reference products into masked regions while respecting scene lighting, perspective, and interactions with surrounding objects.

03

Zero-shot strength: Outperforms existing zero-shot diffusion inpainting methods on both automatic metrics and user studies for product-insertion tasks.

04

Beats few-shot personalization: Surpasses even few-shot personalization methods like DreamPaint without requiring per-product fine-tuning, making it practical at catalog scale.

Every Monday
Get next week’s papers.
Subscribe on Substack