Striding Toward the Minimum: A faster way to optimize the loss function for deep learning.
Machine Learning Research

Striding Toward the Minimum: A faster way to optimize the loss function for deep learning.

When you’re training a deep learning model, it can take days for an optimization algorithm to minimize the loss function. A new approach could save time.

January 13, 20212 min read
It’s a Small World Model After All: More efficient world models for reinforcement learning
Machine Learning Research

It’s a Small World Model After All: More efficient world models for reinforcement learning

World models, which learn a compressed representation of a dynamic environment like, say, a video game, have delivered top results in reinforcement learning. A new method makes them much smaller.

January 13, 20212 min read
Striding Toward the Minimum: A faster way to optimize the loss function for deep learning.
Machine Learning Research

Striding Toward the Minimum: A faster way to optimize the loss function for deep learning.

When you’re training a deep learning model, it can take days for an optimization algorithm to minimize the loss function. A new approach could save time.

January 13, 20212 min read
It’s a Small World Model After All: More efficient world models for reinforcement learning
Machine Learning Research

It’s a Small World Model After All: More efficient world models for reinforcement learning

World models, which learn a compressed representation of a dynamic environment like, say, a video game, have delivered top results in reinforcement learning. A new method makes them much smaller.

January 13, 20212 min read
Physics Simulations Streamlined: Using neural networks to speed up physics simulations
Machine Learning Research

Physics Simulations Streamlined: Using neural networks to speed up physics simulations

Computer simulations do a good job of modeling physical systems from traffic patterns to rocket engines, but they can take a long time to run. New work takes advantage of deep learning to speed them up.

December 16, 20202 min read
Physics Simulations Streamlined: Using neural networks to speed up physics simulations
Machine Learning Research

Physics Simulations Streamlined: Using neural networks to speed up physics simulations

Computer simulations do a good job of modeling physical systems from traffic patterns to rocket engines, but they can take a long time to run. New work takes advantage of deep learning to speed them up.

December 16, 20202 min read
The Measure of a Muppet: How NLP models learn attributes of pretrained embeddings.
Machine Learning Research

The Measure of a Muppet: How NLP models learn attributes of pretrained embeddings.

The latest pretrained language models have shown a remarkable ability to learn facts. A new study drills down on issues of scale, showing that such models might learn the approximate weight of a dog or cost of an apple, at least to the right order of magnitude.

December 9, 20202 min read
The Measure of a Muppet: How NLP models learn attributes of pretrained embeddings.
Machine Learning Research

The Measure of a Muppet: How NLP models learn attributes of pretrained embeddings.

The latest pretrained language models have shown a remarkable ability to learn facts. A new study drills down on issues of scale, showing that such models might learn the approximate weight of a dog or cost of an apple, at least to the right order of magnitude.

December 9, 20202 min read
Learning From Words and Pictures: A deep learning method for medical x-rays with text
Machine Learning Research

Learning From Words and Pictures: A deep learning method for medical x-rays with text

It’s expensive to pay doctors to label medical images, and the relative scarcity of high-quality training examples can make it hard for neural networks to learn features that make for accurate diagnoses.

December 2, 20202 min read
Learning From Words and Pictures: A deep learning method for medical x-rays with text
Machine Learning Research

Learning From Words and Pictures: A deep learning method for medical x-rays with text

It’s expensive to pay doctors to label medical images, and the relative scarcity of high-quality training examples can make it hard for neural networks to learn features that make for accurate diagnoses.

December 2, 20202 min read
Better Crowd Counts: A computer vision method for counting crowds from images
Machine Learning Research

Better Crowd Counts: A computer vision method for counting crowds from images

Did a million people attend the Million Man March? Estimates of the crowd size gathered at a given place and time can have significant political implications — and practical ones, too, as they can help public safety experts deploy resources for public health or crowd control.

November 25, 20202 min read
Better Crowd Counts: A computer vision method for counting crowds from images
Machine Learning Research

Better Crowd Counts: A computer vision method for counting crowds from images

Did a million people attend the Million Man March? Estimates of the crowd size gathered at a given place and time can have significant political implications — and practical ones, too, as they can help public safety experts deploy resources for public health or crowd control.

November 25, 20202 min read
Selective Attention: More efficient NLP training without sacrificing performance
Machine Learning Research

Selective Attention: More efficient NLP training without sacrificing performance

Large transformer networks work wonders with natural language, but they require enormous amounts of computation. New research slashes processor cycles without compromising performance.

November 18, 20201 min read
Selective Attention: More efficient NLP training without sacrificing performance
Machine Learning Research

Selective Attention: More efficient NLP training without sacrificing performance

Large transformer networks work wonders with natural language, but they require enormous amounts of computation. New research slashes processor cycles without compromising performance.

November 18, 20201 min read
The Proof Is in the Network: A transformer model that generates mathematical proofs
Machine Learning Research

The Proof Is in the Network: A transformer model that generates mathematical proofs

OpenAI’s Generative Pre-Trained Transformer (GPT) architecture has created coherent essays, images, and code. Now it generates mathematical proofs as well.

November 11, 20202 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox