The Transformation Continues: Technique boosts transformer performance on long sequences.
Recurrent Neural Network (RNN)

The Transformation Continues: Technique boosts transformer performance on long sequences.

Transformer networks are gaining popularity as a high-accuracy alternative to recurrent neural networks. But they can run slowly when they’re applied to long sequences.

September 2, 20202 min read
Listening to the Brain: NLP researchers used RNNs to translate brain waves into text.
Recurrent Neural Network (RNN)

Listening to the Brain: NLP researchers used RNNs to translate brain waves into text.

AI has added an unlikely language to its catalog of translation capabilities: brain waves. Joseph Makin led a group from the University of California San Francisco to render a person’s neural signals as English text while the person while the person read a sentence aloud.

May 13, 20202 min read
Listening to the Brain: NLP researchers used RNNs to translate brain waves into text.
Recurrent Neural Network (RNN)

Listening to the Brain: NLP researchers used RNNs to translate brain waves into text.

AI has added an unlikely language to its catalog of translation capabilities: brain waves. Joseph Makin led a group from the University of California San Francisco to render a person’s neural signals as English text while the person while the person read a sentence aloud.

May 13, 20202 min read
(Science) Community Outreach: A survey of machine learning from Eric Schmidt
Recurrent Neural Network (RNN)

(Science) Community Outreach: A survey of machine learning from Eric Schmidt

Are your scientist friends intimidated by machine learning? They might be inspired by a primer from one of the world’s premier tech titans. Former Google CEO Eric Schmidt and Cornell PhD candidate Maithra Raghu school scientists in machine learning in a sprawling overview.

April 8, 20201 min read
(Science) Community Outreach: A survey of machine learning from Eric Schmidt
Recurrent Neural Network (RNN)

(Science) Community Outreach: A survey of machine learning from Eric Schmidt

Are your scientist friends intimidated by machine learning? They might be inspired by a primer from one of the world’s premier tech titans. Former Google CEO Eric Schmidt and Cornell PhD candidate Maithra Raghu school scientists in machine learning in a sprawling overview.

April 8, 20201 min read
Silent Snacking: AI removes background noise from video conferencing.
Recurrent Neural Network (RNN)

Silent Snacking: AI removes background noise from video conferencing.

As working from home becomes the new normal, AI may protect you from the sound of coworkers munching while they chat. No more smacking lips and rustling chip bags! Microsoft’s online collaboration platform Teams announced a feature that removes extraneous sounds from videoconferences.

March 25, 20201 min read
Silent Snacking: AI removes background noise from video conferencing.
Recurrent Neural Network (RNN)

Silent Snacking: AI removes background noise from video conferencing.

As working from home becomes the new normal, AI may protect you from the sound of coworkers munching while they chat. No more smacking lips and rustling chip bags! Microsoft’s online collaboration platform Teams announced a feature that removes extraneous sounds from videoconferences.

March 25, 20201 min read
Language Modeling on One GPU: Single-headed attention competes with transformers.
Recurrent Neural Network (RNN)

Language Modeling on One GPU: Single-headed attention competes with transformers.

The latest large, pretrained language models rely on trendy layers based on transformer networks. New research shows that these newfangled layers may not be necessary.

January 8, 20202 min read
Language Modeling on One GPU: Single-headed attention competes with transformers.
Recurrent Neural Network (RNN)

Language Modeling on One GPU: Single-headed attention competes with transformers.

The latest large, pretrained language models rely on trendy layers based on transformer networks. New research shows that these newfangled layers may not be necessary.

January 8, 20202 min read
Simulation Substitutes for Data: When simulation works wonders with deep learning
Recurrent Neural Network (RNN)

Simulation Substitutes for Data: When simulation works wonders with deep learning

The future of machine learning may depend less on amassing ground-truth data than simulating the environment in which a model will operate. Deep learning works like magic with enough high-quality data. When examples are scarce, though, researchers are using simulation to fill the gap.

December 24, 20191 min read
Simulation Substitutes for Data: When simulation works wonders with deep learning
Recurrent Neural Network (RNN)

Simulation Substitutes for Data: When simulation works wonders with deep learning

The future of machine learning may depend less on amassing ground-truth data than simulating the environment in which a model will operate. Deep learning works like magic with enough high-quality data. When examples are scarce, though, researchers are using simulation to fill the gap.

December 24, 20191 min read
Different Skills From Different Demos: Implicit reinforcement without interaction at scale, explained
Recurrent Neural Network (RNN)

Different Skills From Different Demos: Implicit reinforcement without interaction at scale, explained

Reinforcement learning trains models by trial and error. In batch reinforcement learning (BRL), models learn by observing many demonstrations by a variety of actors. But what if one doctor is handier with a scalpel while another excels at suturing?

December 18, 20192 min read
Different Skills From Different Demos: Implicit reinforcement without interaction at scale, explained
Recurrent Neural Network (RNN)

Different Skills From Different Demos: Implicit reinforcement without interaction at scale, explained

Reinforcement learning trains models by trial and error. In batch reinforcement learning (BRL), models learn by observing many demonstrations by a variety of actors. But what if one doctor is handier with a scalpel while another excels at suturing?

December 18, 20192 min read
Who’s Minding the Store?
Recurrent Neural Network (RNN)

Who’s Minding the Store?

Amazon, watch your back. There’s a new player in the book business and, unlike Jeff Bezos, it doesn’t need eight hours of sleep a night. The online bookstore Booksby.ai is run entirely by AI. Neural networks write the books, create the cover art, price the merchandise, even write the reviews.

November 6, 20191 min read
Who’s Minding the Store?
Recurrent Neural Network (RNN)

Who’s Minding the Store?

Amazon, watch your back. There’s a new player in the book business and, unlike Jeff Bezos, it doesn’t need eight hours of sleep a night. The online bookstore Booksby.ai is run entirely by AI. Neural networks write the books, create the cover art, price the merchandise, even write the reviews.

November 6, 20191 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox