Adversarial Helper: Adversarial learning can improve vision and NLP.
Transformer

Adversarial Helper: Adversarial learning can improve vision and NLP.

Models that learn relationships between images and words are gaining a higher profile. New research shows that adversarial learning, usually a way to make models robust to deliberately misleading inputs, can boost vision-and-language performance.

January 20, 20212 min read
Adversarial Helper: Adversarial learning can improve vision and NLP.
Transformer

Adversarial Helper: Adversarial learning can improve vision and NLP.

Models that learn relationships between images and words are gaining a higher profile. New research shows that adversarial learning, usually a way to make models robust to deliberately misleading inputs, can boost vision-and-language performance.

January 20, 20212 min read
Tell Me a Picture: OpenAI's two new multimodal AI models, CLIP and DALL·E
Transformer

Tell Me a Picture: OpenAI's two new multimodal AI models, CLIP and DALL·E

Two new models show a surprisingly sharp sense of the relationship between words and images. OpenAI, the for-profit research lab, announced a pair of models that have produced impressive results in multimodal learning: DALL·E.

January 13, 20212 min read
Tell Me a Picture: OpenAI's two new multimodal AI models, CLIP and DALL·E
Transformer

Tell Me a Picture: OpenAI's two new multimodal AI models, CLIP and DALL·E

Two new models show a surprisingly sharp sense of the relationship between words and images. OpenAI, the for-profit research lab, announced a pair of models that have produced impressive results in multimodal learning: DALL·E.

January 13, 20212 min read
Ilya Sutskever: OpenAI’s co-founder on building multimodal AI models
Transformer

Ilya Sutskever: OpenAI’s co-founder on building multimodal AI models

The past year was the first in which general-purpose models became economically useful. GPT-3, in particular, demonstrated that large language models have surprising linguistic competence and the ability to perform a wide variety of useful tasks.

December 30, 20202 min read
Ilya Sutskever: OpenAI’s co-founder on building multimodal AI models
Transformer

Ilya Sutskever: OpenAI’s co-founder on building multimodal AI models

The past year was the first in which general-purpose models became economically useful. GPT-3, in particular, demonstrated that large language models have surprising linguistic competence and the ability to perform a wide variety of useful tasks.

December 30, 20202 min read
Matthew Mattina: Arm research leader explains how TinyML is bringing AI to phones and other edge devices
Transformer

Matthew Mattina: Arm research leader explains how TinyML is bringing AI to phones and other edge devices

Look at the tip of a standard #2 pencil. Now, imagine performing over one trillion multiplication operations in the area of that pencil tip every second. This can be accomplished using today’s 7nm semiconductor technology.

December 30, 20202 min read
Matthew Mattina: Arm research leader explains how TinyML is bringing AI to phones and other edge devices
Transformer

Matthew Mattina: Arm research leader explains how TinyML is bringing AI to phones and other edge devices

Look at the tip of a standard #2 pencil. Now, imagine performing over one trillion multiplication operations in the area of that pencil tip every second. This can be accomplished using today’s 7nm semiconductor technology.

December 30, 20202 min read
The Measure of a Muppet: How NLP models learn attributes of pretrained embeddings.
Transformer

The Measure of a Muppet: How NLP models learn attributes of pretrained embeddings.

The latest pretrained language models have shown a remarkable ability to learn facts. A new study drills down on issues of scale, showing that such models might learn the approximate weight of a dog or cost of an apple, at least to the right order of magnitude.

December 9, 20202 min read
The Measure of a Muppet: How NLP models learn attributes of pretrained embeddings.
Transformer

The Measure of a Muppet: How NLP models learn attributes of pretrained embeddings.

The latest pretrained language models have shown a remarkable ability to learn facts. A new study drills down on issues of scale, showing that such models might learn the approximate weight of a dog or cost of an apple, at least to the right order of magnitude.

December 9, 20202 min read
Learning From Words and Pictures: A deep learning method for medical x-rays with text
Transformer

Learning From Words and Pictures: A deep learning method for medical x-rays with text

It’s expensive to pay doctors to label medical images, and the relative scarcity of high-quality training examples can make it hard for neural networks to learn features that make for accurate diagnoses.

December 2, 20202 min read
Learning From Words and Pictures: A deep learning method for medical x-rays with text
Transformer

Learning From Words and Pictures: A deep learning method for medical x-rays with text

It’s expensive to pay doctors to label medical images, and the relative scarcity of high-quality training examples can make it hard for neural networks to learn features that make for accurate diagnoses.

December 2, 20202 min read
Selective Attention: More efficient NLP training without sacrificing performance
Transformer

Selective Attention: More efficient NLP training without sacrificing performance

Large transformer networks work wonders with natural language, but they require enormous amounts of computation. New research slashes processor cycles without compromising performance.

November 18, 20201 min read
Selective Attention: More efficient NLP training without sacrificing performance
Transformer

Selective Attention: More efficient NLP training without sacrificing performance

Large transformer networks work wonders with natural language, but they require enormous amounts of computation. New research slashes processor cycles without compromising performance.

November 18, 20201 min read
The Proof Is in the Network: A transformer model that generates mathematical proofs
Transformer

The Proof Is in the Network: A transformer model that generates mathematical proofs

OpenAI’s Generative Pre-Trained Transformer (GPT) architecture has created coherent essays, images, and code. Now it generates mathematical proofs as well.

November 11, 20202 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox