Seamless
Free while signed in. Answers cite the passages they came from.
Meta's Seamless is a family of models for end-to-end expressive, streaming cross-lingual speech communication.
SeamlessExpressive: Preserves the speaker's expressive characteristics (pitch, emotion, pauses) across translation rather than flattening them into neutral speech.
SeamlessStreaming: Produces translated speech in a streaming fashion with low latency, enabling near-real-time conversational translation.
Low-resource coverage: An improved SeamlessM4T is trained on more low-resource language data, broadening the language coverage meaningfully beyond the original M4T.
Safety red-teaming: Meta applies a red-teaming effort specifically for multimodal translation safety, a recognition that MT systems can amplify harmful content across languages.
Get next week’s papers.
The same picks and the same summaries, in your inbox. Free, and 176 issues deep.
Subscribe on Substack