Performer

4 Posts

Upgrade for Vision Transformers: Improved Efficiency for Vision Transformers
Performer

Upgrade for Vision Transformers: Improved Efficiency for Vision Transformers

Vision Transformer and models like it use a lot of computation and memory when processing images. New work modifies these architectures to run more efficiently while adopting helpful properties from convolutions.

May 18, 20222 min read
Upgrade for Vision Transformers: Improved Efficiency for Vision Transformers
Performer

Upgrade for Vision Transformers: Improved Efficiency for Vision Transformers

Vision Transformer and models like it use a lot of computation and memory when processing images. New work modifies these architectures to run more efficiently while adopting helpful properties from convolutions.

May 18, 20222 min read
Transformer Variants Head to Head: A benchmark for comparing different AI transformers.
Performer

Transformer Variants Head to Head: A benchmark for comparing different AI transformers.

The transformer architecture has inspired a plethora of variations. Yet researchers have used a patchwork of metrics to evaluate their performance, making them hard to compare. New work aims to level the playing field.

March 3, 20212 min read
Transformer Variants Head to Head: A benchmark for comparing different AI transformers.
Performer

Transformer Variants Head to Head: A benchmark for comparing different AI transformers.

The transformer architecture has inspired a plethora of variations. Yet researchers have used a patchwork of metrics to evaluate their performance, making them hard to compare. New work aims to level the playing field.

March 3, 20212 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox