Pictures From Words and Gestures: AI model generates captions as users mouse over images.
Language

Pictures From Words and Gestures: AI model generates captions as users mouse over images.

A new system combines verbal descriptions and crude lines to visualize complex scenes. Google researchers led by Jing Yu Koh proposed Tag-Retrieve-Compose-Synthesize (TReCS), a system that generates photorealistic images by describing what they want to see while mousing around on a blank screen.

March 31, 20212 min read
Vision Models Get Some Attention: Researchers add self-attention to convolutional neural nets.
Language

Vision Models Get Some Attention: Researchers add self-attention to convolutional neural nets.

Self-attention is a key element in state-of-the-art language models, but it struggles to process images because its memory requirement rises rapidly with the size of the input. New research addresses the issue with a simple twist on a convolutional neural network.

March 31, 20212 min read
Star Trek, The Videobot Generation: William Shatner creates his own deepfake.
Language

Star Trek, The Videobot Generation: William Shatner creates his own deepfake.

A digital doppelgänger of Star Trek’s original star will let fans chat with him — possibly well beyond his lifetime. AI startup StoryFile built a lifelike videobot of actor William Shatner, best known for playing Captain James T. Kirk on Star Trek.

March 31, 20211 min read
Vision Models Get Some Attention: Researchers add self-attention to convolutional neural nets.
Language

Vision Models Get Some Attention: Researchers add self-attention to convolutional neural nets.

Self-attention is a key element in state-of-the-art language models, but it struggles to process images because its memory requirement rises rapidly with the size of the input. New research addresses the issue with a simple twist on a convolutional neural network.

March 31, 20212 min read
Chatbots Against Depression: The Trevor Project used GPT-2 to train crisis counselors.
Language

Chatbots Against Depression: The Trevor Project used GPT-2 to train crisis counselors.

A language model is helping crisis-intervention volunteers practice their suicide-prevention skills. The Trevor Project, a nonprofit organization that operates a 24-hour hotline for LGBTQ youth, uses a “crisis contact simulator” to train its staff in how to talk with troubled teenagers.

March 24, 20211 min read
Chatbots Against Depression: The Trevor Project used GPT-2 to train crisis counselors.
Language

Chatbots Against Depression: The Trevor Project used GPT-2 to train crisis counselors.

A language model is helping crisis-intervention volunteers practice their suicide-prevention skills. The Trevor Project, a nonprofit organization that operates a 24-hour hotline for LGBTQ youth, uses a “crisis contact simulator” to train its staff in how to talk with troubled teenagers.

March 24, 20211 min read
Google Overhauls Ethical AI Team: What Google is doing after Timnit Gebru's departure.
Language

Google Overhauls Ethical AI Team: What Google is doing after Timnit Gebru's departure.

Having dismissed two key researchers, Google restructured its efforts in AI ethics. Marian Croak, an accomplished software engineer and vice president of engineering at Google, will lead a new center of expertise in responsible AI, the company announced.

March 3, 20212 min read
Google Overhauls Ethical AI Team: What Google is doing after Timnit Gebru's departure.
Language

Google Overhauls Ethical AI Team: What Google is doing after Timnit Gebru's departure.

Having dismissed two key researchers, Google restructured its efforts in AI ethics. Marian Croak, an accomplished software engineer and vice president of engineering at Google, will lead a new center of expertise in responsible AI, the company announced.

March 3, 20212 min read
Transformer Variants Head to Head: A benchmark for comparing different AI transformers.
Language

Transformer Variants Head to Head: A benchmark for comparing different AI transformers.

The transformer architecture has inspired a plethora of variations. Yet researchers have used a patchwork of metrics to evaluate their performance, making them hard to compare. New work aims to level the playing field.

March 3, 20212 min read
Transformer Variants Head to Head: A benchmark for comparing different AI transformers.
Language

Transformer Variants Head to Head: A benchmark for comparing different AI transformers.

The transformer architecture has inspired a plethora of variations. Yet researchers have used a patchwork of metrics to evaluate their performance, making them hard to compare. New work aims to level the playing field.

March 3, 20212 min read
Cake + Cookie = Cakie: Google AI creates new dessert recipes.
Language

Cake + Cookie = Cakie: Google AI creates new dessert recipes.

AI may help revolutionize the human diet – or dessert, at least. Google applied AI engineer Dale Markowitz and developer advocate Sara Robinson trained a model to predict whether a recipe is...

February 24, 20211 min read
Cake + Cookie = Cakie: Google AI creates new dessert recipes.
Language

Cake + Cookie = Cakie: Google AI creates new dessert recipes.

AI may help revolutionize the human diet – or dessert, at least. Google applied AI engineer Dale Markowitz and developer advocate Sara Robinson trained a model to predict whether a recipe is...

February 24, 20211 min read
Sharper Eyes For Vision+Language: AI research shows improved image and text matching.
Language

Sharper Eyes For Vision+Language: AI research shows improved image and text matching.

Models that interpret the interplay of words and images tend to be trained on richer bodies of text than images. Recent research worked toward giving such models a more balanced knowledge of the two domains.

February 24, 20212 min read
Sharper Eyes For Vision+Language: AI research shows improved image and text matching.
Language

Sharper Eyes For Vision+Language: AI research shows improved image and text matching.

Models that interpret the interplay of words and images tend to be trained on richer bodies of text than images. Recent research worked toward giving such models a more balanced knowledge of the two domains.

February 24, 20212 min read
Bigger, Faster Transformers: Increasing parameters without slowing down transformers
Language

Bigger, Faster Transformers: Increasing parameters without slowing down transformers

Performance in language tasks rises with the size of the model — yet, as a model’s parameter count rises, so does the time it takes to render output. New work pumps up the number of parameters without slowing down the network.

February 24, 20212 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox