Multimodal

Generative Disco: Text-to-Video Generation for Music Visualization

First page

Paper summary

An LLM + T2I system for music visualization.

Ask this paper

Key points

LLM+T2I composition: Uses LLMs to interpret music and generate scene descriptions that text-to-image models then visualize.

Music-video generation: Produces music-driven video visualizations - an early text-to-video adjacent capability.

Creative tool direction: Part of the 2023 wave of creative AI tools targeting content creators and music producers.

HCI contribution: Notable for its focus on user experience and creative workflow rather than pure model capability.

Every Monday