Adversarial Helper: Adversarial learning can improve vision and NLP.
BERT

Adversarial Helper: Adversarial learning can improve vision and NLP.

Models that learn relationships between images and words are gaining a higher profile. New research shows that adversarial learning, usually a way to make models robust to deliberately misleading inputs, can boost vision-and-language performance.

January 20, 20212 min read
Adversarial Helper: Adversarial learning can improve vision and NLP.
BERT

Adversarial Helper: Adversarial learning can improve vision and NLP.

Models that learn relationships between images and words are gaining a higher profile. New research shows that adversarial learning, usually a way to make models robust to deliberately misleading inputs, can boost vision-and-language performance.

January 20, 20212 min read
The Measure of a Muppet: How NLP models learn attributes of pretrained embeddings.
BERT

The Measure of a Muppet: How NLP models learn attributes of pretrained embeddings.

The latest pretrained language models have shown a remarkable ability to learn facts. A new study drills down on issues of scale, showing that such models might learn the approximate weight of a dog or cost of an apple, at least to the right order of magnitude.

December 9, 20202 min read
The Measure of a Muppet: How NLP models learn attributes of pretrained embeddings.
BERT

The Measure of a Muppet: How NLP models learn attributes of pretrained embeddings.

The latest pretrained language models have shown a remarkable ability to learn facts. A new study drills down on issues of scale, showing that such models might learn the approximate weight of a dog or cost of an apple, at least to the right order of magnitude.

December 9, 20202 min read
Learning From Words and Pictures: A deep learning method for medical x-rays with text
BERT

Learning From Words and Pictures: A deep learning method for medical x-rays with text

It’s expensive to pay doctors to label medical images, and the relative scarcity of high-quality training examples can make it hard for neural networks to learn features that make for accurate diagnoses.

December 2, 20202 min read
Learning From Words and Pictures: A deep learning method for medical x-rays with text
BERT

Learning From Words and Pictures: A deep learning method for medical x-rays with text

It’s expensive to pay doctors to label medical images, and the relative scarcity of high-quality training examples can make it hard for neural networks to learn features that make for accurate diagnoses.

December 2, 20202 min read
Selective Attention: More efficient NLP training without sacrificing performance
BERT

Selective Attention: More efficient NLP training without sacrificing performance

Large transformer networks work wonders with natural language, but they require enormous amounts of computation. New research slashes processor cycles without compromising performance.

November 18, 20201 min read
Selective Attention: More efficient NLP training without sacrificing performance
BERT

Selective Attention: More efficient NLP training without sacrificing performance

Large transformer networks work wonders with natural language, but they require enormous amounts of computation. New research slashes processor cycles without compromising performance.

November 18, 20201 min read
Do Muppets Have Common Sense?: The Bert NLP model scores high on common sense test.
BERT

Do Muppets Have Common Sense?: The Bert NLP model scores high on common sense test.

Two years after it pointed a new direction for language models, Bert still hovers near the top of several natural language processing leaderboards. A new study considers whether Bert simply excels at tracking word order or or learns something closer to common sense.

September 16, 20202 min read
Do Muppets Have Common Sense?: The Bert NLP model scores high on common sense test.
BERT

Do Muppets Have Common Sense?: The Bert NLP model scores high on common sense test.

Two years after it pointed a new direction for language models, Bert still hovers near the top of several natural language processing leaderboards. A new study considers whether Bert simply excels at tracking word order or or learns something closer to common sense.

September 16, 20202 min read
Transforming Pixels: An image generation model using the GPT architecture
BERT

Transforming Pixels: An image generation model using the GPT architecture

Language models like Bert, Ernie, and Elmo have achieved spectacular results based on clever pre-training approaches. New research applies some of those Sesame Street lessons into image processing.

August 5, 20202 min read
Transforming Pixels: An image generation model using the GPT architecture
BERT

Transforming Pixels: An image generation model using the GPT architecture

Language models like Bert, Ernie, and Elmo have achieved spectacular results based on clever pre-training approaches. New research applies some of those Sesame Street lessons into image processing.

August 5, 20202 min read
AI Makes Headlines: Primer introduces an automated headline generator.
BERT

AI Makes Headlines: Primer introduces an automated headline generator.

Which headline was written by a computer? A: FIFA to Decide on 2022 World Cup in March B: Decision in March on 48-team 2022 World Cup, Says Infantino

July 15, 20202 min read
AI Makes Headlines: Primer introduces an automated headline generator.
BERT

AI Makes Headlines: Primer introduces an automated headline generator.

Which headline was written by a computer? A: FIFA to Decide on 2022 World Cup in March B: Decision in March on 48-team 2022 World Cup, Says Infantino

July 15, 20202 min read
Outing Hidden Hatred: How Facebook built a hate speech detector
BERT

Outing Hidden Hatred: How Facebook built a hate speech detector

Facebook uses automated systems to block hate speech, but hateful posts can slip through when seemingly benign words and pictures combine to create a nasty message. The social network is tackling this problem by enhancing AI’s ability to recognize context.

June 17, 20202 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox