
Transformers Take Over: Transformers Applied to Vision, Language, Video, and More
In 2021, transformers were harnessed to discover drugs, recognize speech, and paint pictures — and much more.

In 2021, transformers were harnessed to discover drugs, recognize speech, and paint pictures — and much more.

While models like GPT-3 and EfficientNet, which work on text and images respectively, are responsible for some of deep learning’s highest-profile successes, approaches that find relationships between text and images made impressive

While models like GPT-3 and EfficientNet, which work on text and images respectively, are responsible for some of deep learning’s highest-profile successes, approaches that find relationships between text and images made impressive

A system from California startup SewerAI analyzes videos of underground pipes to prioritize those in need of repair.

A system from California startup SewerAI analyzes videos of underground pipes to prioritize those in need of repair.

The transformer architecture is notoriously inefficient when processing long sequences — a problem in processing images, which are essentially long sequences of pixels. One way around this is to break up input images and process the pieces

The transformer architecture is notoriously inefficient when processing long sequences — a problem in processing images, which are essentially long sequences of pixels. One way around this is to break up input images and process the pieces

Models trained using supervised learning struggle to classify inputs that differ substantially from most of their training data. A new method helps them recognize such outliers.

Models trained using supervised learning struggle to classify inputs that differ substantially from most of their training data. A new method helps them recognize such outliers.

Deep learning is helping to protect elderly people from potentially catastrophic tumbles.What’s happening: More than 2,000 senior living facilities across the U.S. use a diagnostic system called VirtuSense Balance

Deep learning is helping to protect elderly people from potentially catastrophic tumbles.What’s happening: More than 2,000 senior living facilities across the U.S. use a diagnostic system called VirtuSense Balance

A crime-fighting AI company altered evidence to please police, a new investigation claims — the latest in a rising chorus of criticism. ShotSpotter modified the system’s findings in some cases.

Why use a complex model when a simple one will do? New work shows that the simplest multilayer neural network, with a small twist, can perform some tasks as well as today’s most sophisticated architectures.

A crime-fighting AI company altered evidence to please police, a new investigation claims — the latest in a rising chorus of criticism. ShotSpotter modified the system’s findings in some cases.

Why use a complex model when a simple one will do? New work shows that the simplest multilayer neural network, with a small twist, can perform some tasks as well as today’s most sophisticated architectures.
Stay updated with weekly AI News and Insights delivered to your inbox