ImageNet Performance, No Panacea: ImageNet pretraining won't always improve computer vision.
Machine Learning Research

ImageNet Performance, No Panacea: ImageNet pretraining won't always improve computer vision.

It’s commonly assumed that models pretrained to achieve high performance on ImageNet will perform better on other visual tasks after fine-tuning. But is it always true? A new study reached surprising conclusions.

March 10, 20212 min read
ImageNet Performance, No Panacea: ImageNet pretraining won't always improve computer vision.
Machine Learning Research

ImageNet Performance, No Panacea: ImageNet pretraining won't always improve computer vision.

It’s commonly assumed that models pretrained to achieve high performance on ImageNet will perform better on other visual tasks after fine-tuning. But is it always true? A new study reached surprising conclusions.

March 10, 20212 min read
Covid-19 Triage: Computer vision for x-rays helps triage Covid-19 patients.
Machine Learning Research

Covid-19 Triage: Computer vision for x-rays helps triage Covid-19 patients.

The pandemic has pushed hospitals to their limits. A new machine learning system could help doctors make sure the most severe cases get timely, appropriate care.

March 3, 20212 min read
Transformer Variants Head to Head: A benchmark for comparing different AI transformers.
Machine Learning Research

Transformer Variants Head to Head: A benchmark for comparing different AI transformers.

The transformer architecture has inspired a plethora of variations. Yet researchers have used a patchwork of metrics to evaluate their performance, making them hard to compare. New work aims to level the playing field.

March 3, 20212 min read
Transformer Variants Head to Head: A benchmark for comparing different AI transformers.
Machine Learning Research

Transformer Variants Head to Head: A benchmark for comparing different AI transformers.

The transformer architecture has inspired a plethora of variations. Yet researchers have used a patchwork of metrics to evaluate their performance, making them hard to compare. New work aims to level the playing field.

March 3, 20212 min read
Covid-19 Triage: Computer vision for x-rays helps triage Covid-19 patients.
Machine Learning Research

Covid-19 Triage: Computer vision for x-rays helps triage Covid-19 patients.

The pandemic has pushed hospitals to their limits. A new machine learning system could help doctors make sure the most severe cases get timely, appropriate care.

March 3, 20212 min read
Sharper Eyes For Vision+Language: AI research shows improved image and text matching.
Machine Learning Research

Sharper Eyes For Vision+Language: AI research shows improved image and text matching.

Models that interpret the interplay of words and images tend to be trained on richer bodies of text than images. Recent research worked toward giving such models a more balanced knowledge of the two domains.

February 24, 20212 min read
Sharper Eyes For Vision+Language: AI research shows improved image and text matching.
Machine Learning Research

Sharper Eyes For Vision+Language: AI research shows improved image and text matching.

Models that interpret the interplay of words and images tend to be trained on richer bodies of text than images. Recent research worked toward giving such models a more balanced knowledge of the two domains.

February 24, 20212 min read
Bigger, Faster Transformers: Increasing parameters without slowing down transformers
Machine Learning Research

Bigger, Faster Transformers: Increasing parameters without slowing down transformers

Performance in language tasks rises with the size of the model — yet, as a model’s parameter count rises, so does the time it takes to render output. New work pumps up the number of parameters without slowing down the network.

February 24, 20212 min read
Bigger, Faster Transformers: Increasing parameters without slowing down transformers
Machine Learning Research

Bigger, Faster Transformers: Increasing parameters without slowing down transformers

Performance in language tasks rises with the size of the model — yet, as a model’s parameter count rises, so does the time it takes to render output. New work pumps up the number of parameters without slowing down the network.

February 24, 20212 min read
Better Zero-Shot Translations: A method for improving transformer NLP translation
Machine Learning Research

Better Zero-Shot Translations: A method for improving transformer NLP translation

Train a multilingual language translator to translate between Spanish and English and between English and German, and it may be able to translate directly between Spanish and German as well. New work proposes a simple path to better machine translation between languages.

February 17, 20212 min read
Better Zero-Shot Translations: A method for improving transformer NLP translation
Machine Learning Research

Better Zero-Shot Translations: A method for improving transformer NLP translation

Train a multilingual language translator to translate between Spanish and English and between English and German, and it may be able to translate directly between Spanish and German as well. New work proposes a simple path to better machine translation between languages.

February 17, 20212 min read
Facing Failure to Generalize: Why some AI models exhibit underspecification.
Machine Learning Research

Facing Failure to Generalize: Why some AI models exhibit underspecification.

The same models trained on the same data may show the same performance in the lab, and yet respond very differently to data they haven’t seen before. New work finds this inconsistency to be pervasive.

February 17, 20212 min read
Facing Failure to Generalize: Why some AI models exhibit underspecification.
Machine Learning Research

Facing Failure to Generalize: Why some AI models exhibit underspecification.

The same models trained on the same data may show the same performance in the lab, and yet respond very differently to data they haven’t seen before. New work finds this inconsistency to be pervasive.

February 17, 20212 min read
Shortcut to Cancer Treatment: AI suggests breast cancer therapies based on tumor-tissue slides.
Machine Learning Research

Shortcut to Cancer Treatment: AI suggests breast cancer therapies based on tumor-tissue slides.

Doctors who treat breast cancer typically use a quick, inexpensive tumor-tissue stain test to diagnose the illness and a slower, more costly one to determine treatment. A new neural network could help doctors to go straight from diagnosis to treatment.

February 10, 20212 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox