Translating a Mostly Oral Language: How Meta Trained an NLP Model to Translate Hokkein
Meta

Translating a Mostly Oral Language: How Meta Trained an NLP Model to Translate Hokkein

Most speech-to-speech translation systems use text as an intermediate mode. So how do you build an automated translator for a language that has no standard written form? A new approach trained neural networks to translate a primarily oral language.

November 30, 20223 min read
Translating a Mostly Oral Language: How Meta Trained an NLP Model to Translate Hokkein
Meta

Translating a Mostly Oral Language: How Meta Trained an NLP Model to Translate Hokkein

Most speech-to-speech translation systems use text as an intermediate mode. So how do you build an automated translator for a language that has no standard written form? A new approach trained neural networks to translate a primarily oral language.

November 30, 20223 min read
The Net Speaks in Many Tongues: NLP Model Translates 200 Different Languages
Meta

The Net Speaks in Many Tongues: NLP Model Translates 200 Different Languages

Sentence pairs that have equivalent meanings in different languages — typically used to train machine translation systems — have been available in sufficient quantities for only around 100 languages. New work doubled that number and produced a more capable model.

October 19, 20224 min read
The Net Speaks in Many Tongues: NLP Model Translates 200 Different Languages
Meta

The Net Speaks in Many Tongues: NLP Model Translates 200 Different Languages

Sentence pairs that have equivalent meanings in different languages — typically used to train machine translation systems — have been available in sufficient quantities for only around 100 languages. New work doubled that number and produced a more capable model.

October 19, 20224 min read
The Sound of Conversation: AI Learns to Mimic Conversational Pauses and Interruptions
Meta

The Sound of Conversation: AI Learns to Mimic Conversational Pauses and Interruptions

In spoken conversation, people naturally take turns amid interjections and other patterns that aren’t strictly verbal. A new approach generated natural-sounding audio dialogs without training on text transcriptions that mark when one party should stop speaking and the other should chime in.

October 6, 20222 min read
The Sound of Conversation: AI Learns to Mimic Conversational Pauses and Interruptions
Meta

The Sound of Conversation: AI Learns to Mimic Conversational Pauses and Interruptions

In spoken conversation, people naturally take turns amid interjections and other patterns that aren’t strictly verbal. A new approach generated natural-sounding audio dialogs without training on text transcriptions that mark when one party should stop speaking and the other should chime in.

October 6, 20222 min read
Text to Video Without Text-Video Training Data: Make-A-Video, an AI System from Meta, Generates Video from Text
Meta

Text to Video Without Text-Video Training Data: Make-A-Video, an AI System from Meta, Generates Video from Text

Text-to-image generators like DALL·E 2, Midjourney, and Stable Diffusion are winning art contests and worrying artists. A new approach brings the magic of text-to-image generation to video.

October 5, 20222 min read
Text to Video Without Text-Video Training Data: Make-A-Video, an AI System from Meta, Generates Video from Text
Meta

Text to Video Without Text-Video Training Data: Make-A-Video, an AI System from Meta, Generates Video from Text

Text-to-image generators like DALL·E 2, Midjourney, and Stable Diffusion are winning art contests and worrying artists. A new approach brings the magic of text-to-image generation to video.

October 5, 20222 min read
Cookbook for Vision Transformers: A Formula for Training Vision Transformers
Meta

Cookbook for Vision Transformers: A Formula for Training Vision Transformers

Vision Transformers (ViTs) are overtaking convolutional neural networks (CNN) in many vision tasks, but procedures for training them are still tailored for CNNs. New research investigated how various training ingredients affect ViT performance.

September 28, 20222 min read
Cookbook for Vision Transformers: A Formula for Training Vision Transformers
Meta

Cookbook for Vision Transformers: A Formula for Training Vision Transformers

Vision Transformers (ViTs) are overtaking convolutional neural networks (CNN) in many vision tasks, but procedures for training them are still tailored for CNNs. New research investigated how various training ingredients affect ViT performance.

September 28, 20222 min read
Ensemble Models Simplified: New Machine Learning Research Simplifies Ensembles
Meta

Ensemble Models Simplified: New Machine Learning Research Simplifies Ensembles

A CLIP model whose weights were the mean of an ensemble of fine-tuned models performed as well as the ensemble and better than its best-performing constituent.

August 17, 20222 min read
Ensemble Models Simplified: New Machine Learning Research Simplifies Ensembles
Meta

Ensemble Models Simplified: New Machine Learning Research Simplifies Ensembles

A CLIP model whose weights were the mean of an ensemble of fine-tuned models performed as well as the ensemble and better than its best-performing constituent.

August 17, 20222 min read
Tradeoffs for Higher Accuracy: Data Augmentation Plus Weight Decay can Boost Some AI Models
Meta

Tradeoffs for Higher Accuracy: Data Augmentation Plus Weight Decay can Boost Some AI Models

Vision models can be improved by training them on several altered versions of the same image and also by encouraging their weights to be close to zero. Recent research showed that both can have adverse effects that may be difficult to detect.

July 13, 20222 min read
Tradeoffs for Higher Accuracy: Data Augmentation Plus Weight Decay can Boost Some AI Models
Meta

Tradeoffs for Higher Accuracy: Data Augmentation Plus Weight Decay can Boost Some AI Models

Vision models can be improved by training them on several altered versions of the same image and also by encouraging their weights to be close to zero. Recent research showed that both can have adverse effects that may be difficult to detect.

July 13, 20222 min read
U.S. Acts Against Algorithmic Bias: Meta Removes Bias from its Ad Algorithms
Meta

U.S. Acts Against Algorithmic Bias: Meta Removes Bias from its Ad Algorithms

Regulators are forcing Meta (formerly Facebook) to display certain advertisements more evenly across its membership. The United States government compelled Meta to revise its ad-placement system to deliver ads for housing to members regardless of their age, gender, or ethnicity.

June 29, 20222 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox