AnimateDiff
Free while signed in. Answers cite the passages they came from.
Animates frozen text-to-image diffusion models via a plug-in motion modeling module.
Motion module: Adds a motion modeling module on top of frozen T2I models that learns to produce temporally coherent frame sequences.
Model-agnostic: Works with any personalized T2I checkpoint (LoRAs, DreamBooth fine-tunes) without retraining - animating existing Stable Diffusion models.
Community adoption: Became the dominant open-source video generation tool in late 2023, powering countless community animations on ComfyUI and WebUI.
Open video generation: Established the architectural pattern (frozen image model + learned motion module) that many subsequent open video models followed.
Get next week’s papers.
The same picks and the same summaries, in your inbox. Free, and 176 issues deep.
Subscribe on Substack