Mirasol3B

Decoupled autoregressive modeling: Separates audio/video processing from text processing into focused autoregressive components that communicate through learned cross-modal interfaces.

Handles longer videos: The decoupled design lets the model handle longer video inputs than typical end-to-end multimodal models constrained by sequence length.

Modality-specific processing: Inputs are processed according to their modalities with appropriate tokenization rather than forcing a one-size-fits-all tokenizer.

SoTA on video benchmarks: Outperforms prior methods on video QA, long-video QA, and audio-video-text benchmarks, validating the decoupled approach.