Seamless
Meta's Seamless is a family of models for end-to-end expressive, streaming cross-lingual speech communication.
Ask this paper
SeamlessExpressive: Preserves the speaker's expressive characteristics (pitch, emotion, pauses) across translation rather than flattening them into neutral speech.
SeamlessStreaming: Produces translated speech in a streaming fashion with low latency, enabling near-real-time conversational translation.
Low-resource coverage: An improved SeamlessM4T is trained on more low-resource language data, broadening the language coverage meaningfully beyond the original M4T.
Safety red-teaming: Meta applies a red-teaming effort specifically for multimodal translation safety, a recognition that MT systems can amplify harmful content across languages.