Multimodal AI Takes Off: Multimodal Models, such as CLIP and DALL·E, are taking over AI.
Multimodal

Multimodal AI Takes Off: Multimodal Models, such as CLIP and DALL·E, are taking over AI.

While models like GPT-3 and EfficientNet, which work on text and images respectively, are responsible for some of deep learning’s highest-profile successes, approaches that find relationships between text and images made impressive

December 22, 20211 min read
Richer Video Representations: Pretraining Method Improves AI's Ability to Understand Video
Multimodal

Richer Video Representations: Pretraining Method Improves AI's Ability to Understand Video

To understand a movie scene, viewers often must remember or infer previous events and extrapolate potential consequences. New work improved a model’s ability to do the same.

November 3, 20212 min read
Richer Video Representations: Pretraining Method Improves AI's Ability to Understand Video
Multimodal

Richer Video Representations: Pretraining Method Improves AI's Ability to Understand Video

To understand a movie scene, viewers often must remember or infer previous events and extrapolate potential consequences. New work improved a model’s ability to do the same.

November 3, 20212 min read
Crawl the Web, Absorb the Bias: NLP Models Absorb Biases from Web Training Data
Multimodal

Crawl the Web, Absorb the Bias: NLP Models Absorb Biases from Web Training Data

The emerging generation of trillion-parameter models needs datasets of billions of examples, but the most readily available source of examples on that scale — the web — is polluted with bias and antisocial expressions. A new study examines the issue.

October 13, 20212 min read
Crawl the Web, Absorb the Bias: NLP Models Absorb Biases from Web Training Data
Multimodal

Crawl the Web, Absorb the Bias: NLP Models Absorb Biases from Web Training Data

The emerging generation of trillion-parameter models needs datasets of billions of examples, but the most readily available source of examples on that scale — the web — is polluted with bias and antisocial expressions. A new study examines the issue.

October 13, 20212 min read
Search Goes Multimodal: Google Upgrades its Search Algorithm with Multimodal AI
Multimodal

Search Goes Multimodal: Google Upgrades its Search Algorithm with Multimodal AI

Google will upgrade its search engine with a new model that tracks the relationships between words, images, and, in time, videos — the first fruit of its latest research into multimodal machine learning and multilingual language modeling.

October 13, 20212 min read
Search Goes Multimodal: Google Upgrades its Search Algorithm with Multimodal AI
Multimodal

Search Goes Multimodal: Google Upgrades its Search Algorithm with Multimodal AI

Google will upgrade its search engine with a new model that tracks the relationships between words, images, and, in time, videos — the first fruit of its latest research into multimodal machine learning and multilingual language modeling.

October 13, 20212 min read
Transformers Are Smarter Than You Think: Language transformers can do math, vision, and logic.
Multimodal

Transformers Are Smarter Than You Think: Language transformers can do math, vision, and logic.

The transformer architecture has shown an uncanny ability to model not only language but also images and proteins. New research found that it can apply what it learns from the first domain to the others.

July 28, 20212 min read
Transformers Are Smarter Than You Think: Language transformers can do math, vision, and logic.
Multimodal

Transformers Are Smarter Than You Think: Language transformers can do math, vision, and logic.

The transformer architecture has shown an uncanny ability to model not only language but also images and proteins. New research found that it can apply what it learns from the first domain to the others.

July 28, 20212 min read
I Know It When I See It: Zero-shot detection for objects not in training data.
Multimodal

I Know It When I See It: Zero-shot detection for objects not in training data.

Object detectors typically detect only items that were labeled in their training data. A new method liberates them to locate and recognize a much wider variety of objects.

July 14, 20212 min read
I Know It When I See It: Zero-shot detection for objects not in training data.
Multimodal

I Know It When I See It: Zero-shot detection for objects not in training data.

Object detectors typically detect only items that were labeled in their training data. A new method liberates them to locate and recognize a much wider variety of objects.

July 14, 20212 min read
One Model for Vision-Language: A general purpose AI for vision and language tasks.
Multimodal

One Model for Vision-Language: A general purpose AI for vision and language tasks.

Researchers have proposed task-agnostic architectures for image classification tasks and language tasks. New work proposes a single architecture for vision-language tasks.

June 2, 20212 min read
One Model for Vision-Language: A general purpose AI for vision and language tasks.
Multimodal

One Model for Vision-Language: A general purpose AI for vision and language tasks.

Researchers have proposed task-agnostic architectures for image classification tasks and language tasks. New work proposes a single architecture for vision-language tasks.

June 2, 20212 min read
Large Language Models for Chinese: A brief overview of the WuDao family
Multimodal

Large Language Models for Chinese: A brief overview of the WuDao family

Researchers unveiled competition for the reigning large language model GPT-3. Four models collectively called Wu Dao were described by Beijing Academy of Artificial Intelligence, a research collective funded by the Chinese government, according to Synced Review.

April 14, 20212 min read
Large Language Models for Chinese: A brief overview of the WuDao family
Multimodal

Large Language Models for Chinese: A brief overview of the WuDao family

Researchers unveiled competition for the reigning large language model GPT-3. Four models collectively called Wu Dao were described by Beijing Academy of Artificial Intelligence, a research collective funded by the Chinese government, according to Synced Review.

April 14, 20212 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox