Synthetic Videos on the Double: VideoGPT is an efficient generative AI system for video.
Transformer

Synthetic Videos on the Double: VideoGPT is an efficient generative AI system for video.

Using a neural network to generate realistic videos takes a lot of computation. New work performs the task efficiently enough to run on a beefy personal computer.

June 23, 20212 min read
Synthetic Videos on the Double: VideoGPT is an efficient generative AI system for video.
Transformer

Synthetic Videos on the Double: VideoGPT is an efficient generative AI system for video.

Using a neural network to generate realistic videos takes a lot of computation. New work performs the task efficiently enough to run on a beefy personal computer.

June 23, 20212 min read
One Model for Vision-Language: A general purpose AI for vision and language tasks.
Transformer

One Model for Vision-Language: A general purpose AI for vision and language tasks.

Researchers have proposed task-agnostic architectures for image classification tasks and language tasks. New work proposes a single architecture for vision-language tasks.

June 2, 20212 min read
One Model for Vision-Language: A general purpose AI for vision and language tasks.
Transformer

One Model for Vision-Language: A general purpose AI for vision and language tasks.

Researchers have proposed task-agnostic architectures for image classification tasks and language tasks. New work proposes a single architecture for vision-language tasks.

June 2, 20212 min read
What AI Knows About Proteins: NLP systems can be used to code amino acids.
Transformer

What AI Knows About Proteins: NLP systems can be used to code amino acids.

Transformer models trained on sequences of amino acids that form proteins have had success classifying and generating viable sequences. New research shows that they also capture information about protein structure.

June 2, 20212 min read
What AI Knows About Proteins: NLP systems can be used to code amino acids.
Transformer

What AI Knows About Proteins: NLP systems can be used to code amino acids.

Transformer models trained on sequences of amino acids that form proteins have had success classifying and generating viable sequences. New research shows that they also capture information about protein structure.

June 2, 20212 min read
Greener Machine Learning: Here's how AI models can shrink their carbon footprints.
Transformer

Greener Machine Learning: Here's how AI models can shrink their carbon footprints.

A new study suggests tactics for machine learning engineers to cut their carbon emissions. Led by David Patterson, researchers at Google and UC Berkeley found that AI developers can shrink a model’s carbon footprint a thousand-fold by streamlining architecture...

May 5, 20211 min read
Greener Machine Learning: Here's how AI models can shrink their carbon footprints.
Transformer

Greener Machine Learning: Here's how AI models can shrink their carbon footprints.

A new study suggests tactics for machine learning engineers to cut their carbon emissions. Led by David Patterson, researchers at Google and UC Berkeley found that AI developers can shrink a model’s carbon footprint a thousand-fold by streamlining architecture...

May 5, 20211 min read
Large Language Models for Chinese: A brief overview of the WuDao family
Transformer

Large Language Models for Chinese: A brief overview of the WuDao family

Researchers unveiled competition for the reigning large language model GPT-3. Four models collectively called Wu Dao were described by Beijing Academy of Artificial Intelligence, a research collective funded by the Chinese government, according to Synced Review.

April 14, 20212 min read
Image Generation Transformed: New research combines GANs with transformers.
Transformer

Image Generation Transformed: New research combines GANs with transformers.

A recent generative adversarial network (GAN) produced more coherent images using modified transformers that replaced fully connected layers with convolutional layers. A new GAN achieved a similar end using transformers in their original form.

April 14, 20212 min read
Image Generation Transformed: New research combines GANs with transformers.
Transformer

Image Generation Transformed: New research combines GANs with transformers.

A recent generative adversarial network (GAN) produced more coherent images using modified transformers that replaced fully connected layers with convolutional layers. A new GAN achieved a similar end using transformers in their original form.

April 14, 20212 min read
Large Language Models for Chinese: A brief overview of the WuDao family
Transformer

Large Language Models for Chinese: A brief overview of the WuDao family

Researchers unveiled competition for the reigning large language model GPT-3. Four models collectively called Wu Dao were described by Beijing Academy of Artificial Intelligence, a research collective funded by the Chinese government, according to Synced Review.

April 14, 20212 min read
Attention for Image Generation: Combining GANs and transformers for more believable images.
Transformer

Attention for Image Generation: Combining GANs and transformers for more believable images.

Attention quantifies how each part of one input affects the various parts of another. Researchers added a step that reverses this comparison to produce more convincing images.

April 7, 20212 min read
Attention for Image Generation: Combining GANs and transformers for more believable images.
Transformer

Attention for Image Generation: Combining GANs and transformers for more believable images.

Attention quantifies how each part of one input affects the various parts of another. Researchers added a step that reverses this comparison to produce more convincing images.

April 7, 20212 min read
Chatbots Against Depression: The Trevor Project used GPT-2 to train crisis counselors.
Transformer

Chatbots Against Depression: The Trevor Project used GPT-2 to train crisis counselors.

A language model is helping crisis-intervention volunteers practice their suicide-prevention skills. The Trevor Project, a nonprofit organization that operates a 24-hour hotline for LGBTQ youth, uses a “crisis contact simulator” to train its staff in how to talk with troubled teenagers.

March 24, 20211 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox