Pale Transformer
Attention to Rows and Columns: Altering Transformers' Self-Attention Mechanism for Greater Efficiency
A new approach alters transformers' self-attention mechanism to balance computational efficiency with performance on vision tasks.
Pale Transformer
2 Posts
Pale Transformer
Attention to Rows and Columns: Altering Transformers' Self-Attention Mechanism for Greater Efficiency
A new approach alters transformers' self-attention mechanism to balance computational efficiency with performance on vision tasks.
Subscribe to The Batch
Stay updated with weekly AI News and Insights delivered to your inbox