Moderating the ML Roller Coaster: A technique to avoid double descent in AI
Machine Learning Research

Moderating the ML Roller Coaster: A technique to avoid double descent in AI

Wait a minute — we added training data, and our model’s performance got worse?! New research offers a way to avoid so-called double descent.

April 22, 20202 min read
Preserving Detail in Image Inputs: Better image compression for computer vision datasets
Machine Learning Research

Preserving Detail in Image Inputs: Better image compression for computer vision datasets

Given real-world constraints on memory and processing time, images are often downsampled before they’re fed into a neural network. But the process removes fine details, and that degrades accuracy. A new technique squeezes images with less compromise.

April 22, 20202 min read
Outside the Norm: Batch normalization contributes to neural network accuracy.
Machine Learning Research

Outside the Norm: Batch normalization contributes to neural network accuracy.

Batch normalization is a technique that normalizes layer outputs to accelerate neural network training. But new research shows that it has other effects that may be more important.

April 8, 20202 min read
Outside the Norm: Batch normalization contributes to neural network accuracy.
Machine Learning Research

Outside the Norm: Batch normalization contributes to neural network accuracy.

Batch normalization is a technique that normalizes layer outputs to accelerate neural network training. But new research shows that it has other effects that may be more important.

April 8, 20202 min read
Beyond Neural Architecture Search: AutoML-Zero is a meta-algorithm for classification.
Machine Learning Research

Beyond Neural Architecture Search: AutoML-Zero is a meta-algorithm for classification.

Faced with a classification task, an important step is to browse the catalog of machine learning architectures to find a good performer. Researchers are exploring ways to do it automatically.

April 8, 20202 min read
Beyond Neural Architecture Search: AutoML-Zero is a meta-algorithm for classification.
Machine Learning Research

Beyond Neural Architecture Search: AutoML-Zero is a meta-algorithm for classification.

Faced with a classification task, an important step is to browse the catalog of machine learning architectures to find a good performer. Researchers are exploring ways to do it automatically.

April 8, 20202 min read
Optimize Your Training Parameters: Research on finding a neural net's optimal batch size
Machine Learning Research

Optimize Your Training Parameters: Research on finding a neural net's optimal batch size

Last week we reported on a formula to determine model width and dataset size for optimal performance. A new paper contributes equations that optimize some training parameters.

April 1, 20202 min read
Optimize Your Training Parameters: Research on finding a neural net's optimal batch size
Machine Learning Research

Optimize Your Training Parameters: Research on finding a neural net's optimal batch size

Last week we reported on a formula to determine model width and dataset size for optimal performance. A new paper contributes equations that optimize some training parameters.

April 1, 20202 min read
Seeing the See-Through: ClearGrasp allows robots to grab see-through objects.
Machine Learning Research

Seeing the See-Through: ClearGrasp allows robots to grab see-through objects.

Glass bottles and crystal bowls bend light in strange ways. Image processing networks often struggle to separate the boundaries of transparent objects from the background that shows through them. A new method sees such items more accurately.

April 1, 20202 min read
Seeing the See-Through: ClearGrasp allows robots to grab see-through objects.
Machine Learning Research

Seeing the See-Through: ClearGrasp allows robots to grab see-through objects.

Glass bottles and crystal bowls bend light in strange ways. Image processing networks often struggle to separate the boundaries of transparent objects from the background that shows through them. A new method sees such items more accurately.

April 1, 20202 min read
Rightsizing Neural Nets: An equation for predicting optimal data and model size
Machine Learning Research

Rightsizing Neural Nets: An equation for predicting optimal data and model size

How much data do we want? More! How large should the model be? Bigger! How much more and how much bigger? New research estimates the impact of dataset and model sizes on neural network performance.

March 25, 20202 min read
Deep Learning Finds New Antibiotic: Researchers used AI to identify a promising new antibiotic.
Machine Learning Research

Deep Learning Finds New Antibiotic: Researchers used AI to identify a promising new antibiotic.

Chemists typically develop new antibiotics by testing close chemical relatives of tried-and-true compounds like penicillin. That approach becomes less effective, though, as dangerous bacteria evolve resistance to those very chemical structures. Instead, researchers enlisted neural networks.

March 25, 20202 min read
Rightsizing Neural Nets: An equation for predicting optimal data and model size
Machine Learning Research

Rightsizing Neural Nets: An equation for predicting optimal data and model size

How much data do we want? More! How large should the model be? Bigger! How much more and how much bigger? New research estimates the impact of dataset and model sizes on neural network performance.

March 25, 20202 min read
Deep Learning Finds New Antibiotic: Researchers used AI to identify a promising new antibiotic.
Machine Learning Research

Deep Learning Finds New Antibiotic: Researchers used AI to identify a promising new antibiotic.

Chemists typically develop new antibiotics by testing close chemical relatives of tried-and-true compounds like penicillin. That approach becomes less effective, though, as dangerous bacteria evolve resistance to those very chemical structures. Instead, researchers enlisted neural networks.

March 25, 20202 min read
X Marks the Dataset: Radioacive data helps trace a model's training corpus.
Machine Learning Research

X Marks the Dataset: Radioacive data helps trace a model's training corpus.

Which dataset was used to train a given model? A new method makes it possible to see traces of the training corpus in a model’s output.

March 18, 20202 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox