EfficientNet

12 Posts

Less Data for Vision Transformers: Boosting Vision Transformer Performance with Less Data
EfficientNet

Less Data for Vision Transformers: Boosting Vision Transformer Performance with Less Data

Vision Transformer (ViT) outperformed convolutional neural networks in image classification, but it required more training data. New work enabled ViT and its variants to outperform other architectures with less training data.

May 4, 20222 min read
Less Data for Vision Transformers: Boosting Vision Transformer Performance with Less Data
EfficientNet

Less Data for Vision Transformers: Boosting Vision Transformer Performance with Less Data

Vision Transformer (ViT) outperformed convolutional neural networks in image classification, but it required more training data. New work enabled ViT and its variants to outperform other architectures with less training data.

May 4, 20222 min read
AI Sees Race in X-Rays
EfficientNet

AI Sees Race in X-Rays

Researchers from Emory University, MIT, Purdue University, and other institutions found that deep learning systems trained to interpret x-rays and CT scans also were able to identify their subjects as Asian, Black, or White.

August 11, 20212 min read
AI Sees Race in X-Rays
EfficientNet

AI Sees Race in X-Rays

Researchers from Emory University, MIT, Purdue University, and other institutions found that deep learning systems trained to interpret x-rays and CT scans also were able to identify their subjects as Asian, Black, or White.

August 11, 20212 min read
ImageNet Performance, No Panacea: ImageNet pretraining won't always improve computer vision.
EfficientNet

ImageNet Performance, No Panacea: ImageNet pretraining won't always improve computer vision.

It’s commonly assumed that models pretrained to achieve high performance on ImageNet will perform better on other visual tasks after fine-tuning. But is it always true? A new study reached surprising conclusions.

March 10, 20212 min read
ImageNet Performance, No Panacea: ImageNet pretraining won't always improve computer vision.
EfficientNet

ImageNet Performance, No Panacea: ImageNet pretraining won't always improve computer vision.

It’s commonly assumed that models pretrained to achieve high performance on ImageNet will perform better on other visual tasks after fine-tuning. But is it always true? A new study reached surprising conclusions.

March 10, 20212 min read
Flexible Teachers, Smarter Students: Meta Pseudo Labels improves knowledge distillation.
EfficientNet

Flexible Teachers, Smarter Students: Meta Pseudo Labels improves knowledge distillation.

Human teachers can teach more effectively by adjusting their methods in response to student feedback. It turns out that teacher networks can do the same.

May 13, 20202 min read
Flexible Teachers, Smarter Students: Meta Pseudo Labels improves knowledge distillation.
EfficientNet

Flexible Teachers, Smarter Students: Meta Pseudo Labels improves knowledge distillation.

Human teachers can teach more effectively by adjusting their methods in response to student feedback. It turns out that teacher networks can do the same.

May 13, 20202 min read
Easy on the Eyes: More accurate object detection with EfficientDet
EfficientNet

Easy on the Eyes: More accurate object detection with EfficientDet

Researchers aiming to increase accuracy in object detection generally enlarge the network, but that approach also boosts computational cost. A novel architecture sets a new state of the art in accuracy while cutting the compute cycles required.

January 8, 20202 min read
Easy on the Eyes: More accurate object detection with EfficientDet
EfficientNet

Easy on the Eyes: More accurate object detection with EfficientDet

Researchers aiming to increase accuracy in object detection generally enlarge the network, but that approach also boosts computational cost. A novel architecture sets a new state of the art in accuracy while cutting the compute cycles required.

January 8, 20202 min read
Self-Training for Sharper Vision: The noisy student method for computer vision, explained
EfficientNet

Self-Training for Sharper Vision: The noisy student method for computer vision, explained

The previous state-of-the-art image classifier was trained on the ImageNet dataset plus 3.5 billion supplemental images from a different database. A new method achieved higher accuracy with one-tenth as many supplemental examples — and they were unlabeled, to boot.

December 18, 20192 min read
Self-Training for Sharper Vision: The noisy student method for computer vision, explained
EfficientNet

Self-Training for Sharper Vision: The noisy student method for computer vision, explained

The previous state-of-the-art image classifier was trained on the ImageNet dataset plus 3.5 billion supplemental images from a different database. A new method achieved higher accuracy with one-tenth as many supplemental examples — and they were unlabeled, to boot.

December 18, 20192 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox