Massively Multilingual Translation: Machine Learning Model Trained to Translate 1,000 Languages
Transformer

Massively Multilingual Translation: Machine Learning Model Trained to Translate 1,000 Languages

Recent work showed that models for multilingual machine translation can increase the number of languages they translate by scraping the web for pairs of equivalent sentences in different languages. A new study radically expanded the language repertoire through training on untranslated web text.

November 2, 20223 min read
Massively Multilingual Translation: Machine Learning Model Trained to Translate 1,000 Languages
Transformer

Massively Multilingual Translation: Machine Learning Model Trained to Translate 1,000 Languages

Recent work showed that models for multilingual machine translation can increase the number of languages they translate by scraping the web for pairs of equivalent sentences in different languages. A new study radically expanded the language repertoire through training on untranslated web text.

November 2, 20223 min read
The Net Speaks in Many Tongues: NLP Model Translates 200 Different Languages
Transformer

The Net Speaks in Many Tongues: NLP Model Translates 200 Different Languages

Sentence pairs that have equivalent meanings in different languages — typically used to train machine translation systems — have been available in sufficient quantities for only around 100 languages. New work doubled that number and produced a more capable model.

October 19, 20224 min read
The Net Speaks in Many Tongues: NLP Model Translates 200 Different Languages
Transformer

The Net Speaks in Many Tongues: NLP Model Translates 200 Different Languages

Sentence pairs that have equivalent meanings in different languages — typically used to train machine translation systems — have been available in sufficient quantities for only around 100 languages. New work doubled that number and produced a more capable model.

October 19, 20224 min read
Long-Form Videos from Text Stories: Google's Phenaki Generates Long-Form Video from Text
Transformer

Long-Form Videos from Text Stories: Google's Phenaki Generates Long-Form Video from Text

Only a week ago, researchers unveiled a system that generates a few seconds of video based on a text prompt. New work enables a text-to-video system to produce an entire visual narrative from several sentences of text.

October 12, 20223 min read
Long-Form Videos from Text Stories: Google's Phenaki Generates Long-Form Video from Text
Transformer

Long-Form Videos from Text Stories: Google's Phenaki Generates Long-Form Video from Text

Only a week ago, researchers unveiled a system that generates a few seconds of video based on a text prompt. New work enables a text-to-video system to produce an entire visual narrative from several sentences of text.

October 12, 20223 min read
The Sound of Conversation: AI Learns to Mimic Conversational Pauses and Interruptions
Transformer

The Sound of Conversation: AI Learns to Mimic Conversational Pauses and Interruptions

In spoken conversation, people naturally take turns amid interjections and other patterns that aren’t strictly verbal. A new approach generated natural-sounding audio dialogs without training on text transcriptions that mark when one party should stop speaking and the other should chime in.

October 6, 20222 min read
The Sound of Conversation: AI Learns to Mimic Conversational Pauses and Interruptions
Transformer

The Sound of Conversation: AI Learns to Mimic Conversational Pauses and Interruptions

In spoken conversation, people naturally take turns amid interjections and other patterns that aren’t strictly verbal. A new approach generated natural-sounding audio dialogs without training on text transcriptions that mark when one party should stop speaking and the other should chime in.

October 6, 20222 min read
Text to Video Without Text-Video Training Data: Make-A-Video, an AI System from Meta, Generates Video from Text
Transformer

Text to Video Without Text-Video Training Data: Make-A-Video, an AI System from Meta, Generates Video from Text

Text-to-image generators like DALL·E 2, Midjourney, and Stable Diffusion are winning art contests and worrying artists. A new approach brings the magic of text-to-image generation to video.

October 5, 20222 min read
Text to Video Without Text-Video Training Data: Make-A-Video, an AI System from Meta, Generates Video from Text
Transformer

Text to Video Without Text-Video Training Data: Make-A-Video, an AI System from Meta, Generates Video from Text

Text-to-image generators like DALL·E 2, Midjourney, and Stable Diffusion are winning art contests and worrying artists. A new approach brings the magic of text-to-image generation to video.

October 5, 20222 min read
Cookbook for Vision Transformers: A Formula for Training Vision Transformers
Transformer

Cookbook for Vision Transformers: A Formula for Training Vision Transformers

Vision Transformers (ViTs) are overtaking convolutional neural networks (CNN) in many vision tasks, but procedures for training them are still tailored for CNNs. New research investigated how various training ingredients affect ViT performance.

September 28, 20222 min read
Cookbook for Vision Transformers: A Formula for Training Vision Transformers
Transformer

Cookbook for Vision Transformers: A Formula for Training Vision Transformers

Vision Transformers (ViTs) are overtaking convolutional neural networks (CNN) in many vision tasks, but procedures for training them are still tailored for CNNs. New research investigated how various training ingredients affect ViT performance.

September 28, 20222 min read
Parsing Commands Into Actions: NLP Helps Google Robot Understand Spoken Instructions
Transformer

Parsing Commands Into Actions: NLP Helps Google Robot Understand Spoken Instructions

A new method enables robots to respond helpfully to verbal commands by pairing a natural language model with a repertoire of existing skills.

September 28, 20222 min read
Parsing Commands Into Actions: NLP Helps Google Robot Understand Spoken Instructions
Transformer

Parsing Commands Into Actions: NLP Helps Google Robot Understand Spoken Instructions

A new method enables robots to respond helpfully to verbal commands by pairing a natural language model with a repertoire of existing skills.

September 28, 20222 min read
Chipmaker Boosts AI as a Service: Nvidia Launches Cloud Service for NLP Models
Transformer

Chipmaker Boosts AI as a Service: Nvidia Launches Cloud Service for NLP Models

Nvidia, known for chips designed to process AI systems, is providing access to large language models. Nvidia announced early access to NeMo LLM and BioNeMo, cloud-computing services that enable developers to generate text and biological sequences respectively.

September 28, 20222 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox