Transformers Take Over: Transformers Applied to Vision, Language, Video, and More
DeepMind

Transformers Take Over: Transformers Applied to Vision, Language, Video, and More

In 2021, transformers were harnessed to discover drugs, recognize speech, and paint pictures — and much more.

December 22, 20212 min read
Transformers Take Over: Transformers Applied to Vision, Language, Video, and More
DeepMind

Transformers Take Over: Transformers Applied to Vision, Language, Video, and More

In 2021, transformers were harnessed to discover drugs, recognize speech, and paint pictures — and much more.

December 22, 20212 min read
Multimodal AI Takes Off: Multimodal Models, such as CLIP and DALL·E, are taking over AI.
DeepMind

Multimodal AI Takes Off: Multimodal Models, such as CLIP and DALL·E, are taking over AI.

While models like GPT-3 and EfficientNet, which work on text and images respectively, are responsible for some of deep learning’s highest-profile successes, approaches that find relationships between text and images made impressive

December 22, 20211 min read
Multimodal AI Takes Off: Multimodal Models, such as CLIP and DALL·E, are taking over AI.
DeepMind

Multimodal AI Takes Off: Multimodal Models, such as CLIP and DALL·E, are taking over AI.

While models like GPT-3 and EfficientNet, which work on text and images respectively, are responsible for some of deep learning’s highest-profile successes, approaches that find relationships between text and images made impressive

December 22, 20211 min read
Image Transformations Unmasked: CNNs for vision that aren't fooled by changing backgrounds.
DeepMind

Image Transformations Unmasked: CNNs for vision that aren't fooled by changing backgrounds.

If you change an image by moving its subject within the frame, a well trained convolutional neural network may not recognize the fundamental similarity between the two versions. New research aims to make CNN wise to such alterations.

December 15, 20212 min read
Image Transformations Unmasked: CNNs for vision that aren't fooled by changing backgrounds.
DeepMind

Image Transformations Unmasked: CNNs for vision that aren't fooled by changing backgrounds.

If you change an image by moving its subject within the frame, a well trained convolutional neural network may not recognize the fundamental similarity between the two versions. New research aims to make CNN wise to such alterations.

December 15, 20212 min read
Large Language Models Shrink: Gopher and RETRO prove lean language models can push boundaries.
DeepMind

Large Language Models Shrink: Gopher and RETRO prove lean language models can push boundaries.

DeepMind released three papers that push the boundaries — and examine the issues — of large language models.

December 15, 20212 min read
Large Language Models Shrink: Gopher and RETRO prove lean language models can push boundaries.
DeepMind

Large Language Models Shrink: Gopher and RETRO prove lean language models can push boundaries.

DeepMind released three papers that push the boundaries — and examine the issues — of large language models.

December 15, 20212 min read
A Deeper Look at Graphs: Graph Neural Networks Work Better With More Layers
DeepMind

A Deeper Look at Graphs: Graph Neural Networks Work Better With More Layers

New research shows that drastically increasing the number of layers in a graph neural networks improves its performance on large datasets.

December 1, 20212 min read
A Deeper Look at Graphs: Graph Neural Networks Work Better With More Layers
DeepMind

A Deeper Look at Graphs: Graph Neural Networks Work Better With More Layers

New research shows that drastically increasing the number of layers in a graph neural networks improves its performance on large datasets.

December 1, 20212 min read
DeepMind Doubles Down on AlphaFold: DeepMind Launches Company to Commercialize AlphaFold 2
DeepMind

DeepMind Doubles Down on AlphaFold: DeepMind Launches Company to Commercialize AlphaFold 2

Isomorphic aims to build its business on AlphaFold 2, an ensemble of neural networks that finds the shapes of protein molecules.

November 10, 20211 min read
DeepMind Doubles Down on AlphaFold: DeepMind Launches Company to Commercialize AlphaFold 2
DeepMind

DeepMind Doubles Down on AlphaFold: DeepMind Launches Company to Commercialize AlphaFold 2

Isomorphic aims to build its business on AlphaFold 2, an ensemble of neural networks that finds the shapes of protein molecules.

November 10, 20211 min read
AI Engineers Weigh In on AI Ethics: Survey Shows How AI Engineers Feel About Ethical Issues
DeepMind

AI Engineers Weigh In on AI Ethics: Survey Shows How AI Engineers Feel About Ethical Issues

Machine learning researchers tend to trust international organizations, distrust military forces, and disagree on how much disclosure is necessary when describing new models, a new study found.

September 15, 20212 min read
Team Players: Football-Playing AI Blends Individual and Group Skills
DeepMind

Team Players: Football-Playing AI Blends Individual and Group Skills

Playing a team sport involves a fluid blend of individual and group skills. Researchers integrated both types of action into realistic humanoid agents that play football (known as soccer in the U.S.).

September 15, 20212 min read
Team Players: Football-Playing AI Blends Individual and Group Skills
DeepMind

Team Players: Football-Playing AI Blends Individual and Group Skills

Playing a team sport involves a fluid blend of individual and group skills. Researchers integrated both types of action into realistic humanoid agents that play football (known as soccer in the U.S.).

September 15, 20212 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox