Weak Foundations Make Weak Models: Foundation AI Models Pass Flaws to Fine-Tuned Variants
BERT

Weak Foundations Make Weak Models: Foundation AI Models Pass Flaws to Fine-Tuned Variants

A new study examines a major strain of recent research: huge models pretrained on immense quantities of uncurated, unlabeled data and then fine-tuned on a smaller, curated corpus.

August 25, 20212 min read
One Model for Vision-Language: A general purpose AI for vision and language tasks.
BERT

One Model for Vision-Language: A general purpose AI for vision and language tasks.

Researchers have proposed task-agnostic architectures for image classification tasks and language tasks. New work proposes a single architecture for vision-language tasks.

June 2, 20212 min read
One Model for Vision-Language: A general purpose AI for vision and language tasks.
BERT

One Model for Vision-Language: A general purpose AI for vision and language tasks.

Researchers have proposed task-agnostic architectures for image classification tasks and language tasks. New work proposes a single architecture for vision-language tasks.

June 2, 20212 min read
Double Check for Defamation: CaliberAI uses NLP to scan for possible legal defamation.
BERT

Double Check for Defamation: CaliberAI uses NLP to scan for possible legal defamation.

A libel-detection system could help news outlets and social media companies stay out of legal hot water. CaliberAI, an Irish startup, scans text for statements that could be considered defamatory, Wired reported.

May 26, 20212 min read
Double Check for Defamation: CaliberAI uses NLP to scan for possible legal defamation.
BERT

Double Check for Defamation: CaliberAI uses NLP to scan for possible legal defamation.

A libel-detection system could help news outlets and social media companies stay out of legal hot water. CaliberAI, an Irish startup, scans text for statements that could be considered defamatory, Wired reported.

May 26, 20212 min read
Large Language Models for Chinese: A brief overview of the WuDao family
BERT

Large Language Models for Chinese: A brief overview of the WuDao family

Researchers unveiled competition for the reigning large language model GPT-3. Four models collectively called Wu Dao were described by Beijing Academy of Artificial Intelligence, a research collective funded by the Chinese government, according to Synced Review.

April 14, 20212 min read
Large Language Models for Chinese: A brief overview of the WuDao family
BERT

Large Language Models for Chinese: A brief overview of the WuDao family

Researchers unveiled competition for the reigning large language model GPT-3. Four models collectively called Wu Dao were described by Beijing Academy of Artificial Intelligence, a research collective funded by the Chinese government, according to Synced Review.

April 14, 20212 min read
Pictures From Words and Gestures: AI model generates captions as users mouse over images.
BERT

Pictures From Words and Gestures: AI model generates captions as users mouse over images.

A new system combines verbal descriptions and crude lines to visualize complex scenes. Google researchers led by Jing Yu Koh proposed Tag-Retrieve-Compose-Synthesize (TReCS), a system that generates photorealistic images by describing what they want to see while mousing around on a blank screen.

March 31, 20212 min read
Pictures From Words and Gestures: AI model generates captions as users mouse over images.
BERT

Pictures From Words and Gestures: AI model generates captions as users mouse over images.

A new system combines verbal descriptions and crude lines to visualize complex scenes. Google researchers led by Jing Yu Koh proposed Tag-Retrieve-Compose-Synthesize (TReCS), a system that generates photorealistic images by describing what they want to see while mousing around on a blank screen.

March 31, 20212 min read
Google Overhauls Ethical AI Team: What Google is doing after Timnit Gebru's departure.
BERT

Google Overhauls Ethical AI Team: What Google is doing after Timnit Gebru's departure.

Having dismissed two key researchers, Google restructured its efforts in AI ethics. Marian Croak, an accomplished software engineer and vice president of engineering at Google, will lead a new center of expertise in responsible AI, the company announced.

March 3, 20212 min read
Google Overhauls Ethical AI Team: What Google is doing after Timnit Gebru's departure.
BERT

Google Overhauls Ethical AI Team: What Google is doing after Timnit Gebru's departure.

Having dismissed two key researchers, Google restructured its efforts in AI ethics. Marian Croak, an accomplished software engineer and vice president of engineering at Google, will lead a new center of expertise in responsible AI, the company announced.

March 3, 20212 min read
Sharper Eyes For Vision+Language: AI research shows improved image and text matching.
BERT

Sharper Eyes For Vision+Language: AI research shows improved image and text matching.

Models that interpret the interplay of words and images tend to be trained on richer bodies of text than images. Recent research worked toward giving such models a more balanced knowledge of the two domains.

February 24, 20212 min read
Sharper Eyes For Vision+Language: AI research shows improved image and text matching.
BERT

Sharper Eyes For Vision+Language: AI research shows improved image and text matching.

Models that interpret the interplay of words and images tend to be trained on richer bodies of text than images. Recent research worked toward giving such models a more balanced knowledge of the two domains.

February 24, 20212 min read
Better Language Through Vision: Study improved Bert performance using visual tokens.
BERT

Better Language Through Vision: Study improved Bert performance using visual tokens.

For children, associating a word with a picture that illustrates it helps them learn the word’s meaning. Research aims to do something similar for machine learning models. Researchers improved a BERT model’s performance on some language tasks by training it on a large dataset of image-word pairs.

February 10, 20212 min read
Better Language Through Vision: Study improved Bert performance using visual tokens.
BERT

Better Language Through Vision: Study improved Bert performance using visual tokens.

For children, associating a word with a picture that illustrates it helps them learn the word’s meaning. Research aims to do something similar for machine learning models. Researchers improved a BERT model’s performance on some language tasks by training it on a large dataset of image-word pairs.

February 10, 20212 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox