Swin

6 Posts

Less Data for Vision Transformers: Boosting Vision Transformer Performance with Less Data
Swin

Less Data for Vision Transformers: Boosting Vision Transformer Performance with Less Data

Vision Transformer (ViT) outperformed convolutional neural networks in image classification, but it required more training data. New work enabled ViT and its variants to outperform other architectures with less training data.

May 4, 20222 min read
Less Data for Vision Transformers: Boosting Vision Transformer Performance with Less Data
Swin

Less Data for Vision Transformers: Boosting Vision Transformer Performance with Less Data

Vision Transformer (ViT) outperformed convolutional neural networks in image classification, but it required more training data. New work enabled ViT and its variants to outperform other architectures with less training data.

May 4, 20222 min read
High Accuracy at Low Power: An energy efficient method for computer vision
Swin

High Accuracy at Low Power: An energy efficient method for computer vision

Equipment that relies on computer vision while unplugged — mobile phones, drones, satellites, autonomous cars — need power-efficient models. A new architecture set a record for accuracy per computation.

January 26, 20222 min read
High Accuracy at Low Power: An energy efficient method for computer vision
Swin

High Accuracy at Low Power: An energy efficient method for computer vision

Equipment that relies on computer vision while unplugged — mobile phones, drones, satellites, autonomous cars — need power-efficient models. A new architecture set a record for accuracy per computation.

January 26, 20222 min read
Transformer Speed-Up Sped Up: How to Speed Up Image Transformers
Swin

Transformer Speed-Up Sped Up: How to Speed Up Image Transformers

The transformer architecture is notoriously inefficient when processing long sequences — a problem in processing images, which are essentially long sequences of pixels. One way around this is to break up input images and process the pieces

October 13, 20211 min read
Transformer Speed-Up Sped Up: How to Speed Up Image Transformers
Swin

Transformer Speed-Up Sped Up: How to Speed Up Image Transformers

The transformer architecture is notoriously inefficient when processing long sequences — a problem in processing images, which are essentially long sequences of pixels. One way around this is to break up input images and process the pieces

October 13, 20211 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox