WavJourney
Free while signed in. Answers cite the passages they came from.
Leverages LLMs to orchestrate audio generation models for compositional storytelling.
LLM as composer: Uses an LLM to plan scene-level audio scripts, then dispatches sub-prompts to specialized TTS, music, and sound-effect models.
Explainable structure: Produces intermediate audio scripts that users can inspect and edit, giving creative control rather than opaque end-to-end generation.
Storytelling workflow: Demonstrates long-form coherent audio stories with speech, music, and ambient sound combined into unified scenes.
Agentic audio precursor: An early example of LLM-as-orchestrator for multimedia generation - a pattern that matured in 2024 multi-modal agent frameworks.
Get next week’s papers.
The same picks and the same summaries, in your inbox. Free, and 176 issues deep.
Subscribe on Substack