SeamlessM4T
Free while signed in. Answers cite the passages they came from.
Meta's SeamlessM4T is a unified multilingual and multimodal machine-translation system that handles five translation tasks in one model.
Five tasks, one model: Handles ASR, text-to-text, speech-to-text, text-to-speech, and speech-to-speech translation in a unified architecture.
100+ languages: Covers ~100 languages for text and ~36 for speech, dramatically broadening the set of supported language pairs compared to prior systems.
Unified training: Avoids the cascade of per-task models typical in translation pipelines, reducing error accumulation and improving multilingual generalization.
Open release: Releases model weights and evaluation code, providing a strong open baseline for multilingual multimodal translation research.
Get next week’s papers.
The same picks and the same summaries, in your inbox. Free, and 176 issues deep.
Subscribe on Substack