Humanized Training for Robot Arms: New Research Improves Robot Performance and Adaptability
Machine Learning Research

Humanized Training for Robot Arms: New Research Improves Robot Performance and Adaptability

Robots trained via reinforcement learning usually study videos of robots performing the task at hand. A new approach used videos of humans to pre-train robotic arms.

July 29, 20222 min read
Tradeoffs for Higher Accuracy: Data Augmentation Plus Weight Decay can Boost Some AI Models
Machine Learning Research

Tradeoffs for Higher Accuracy: Data Augmentation Plus Weight Decay can Boost Some AI Models

Vision models can be improved by training them on several altered versions of the same image and also by encouraging their weights to be close to zero. Recent research showed that both can have adverse effects that may be difficult to detect.

July 13, 20222 min read
Tradeoffs for Higher Accuracy: Data Augmentation Plus Weight Decay can Boost Some AI Models
Machine Learning Research

Tradeoffs for Higher Accuracy: Data Augmentation Plus Weight Decay can Boost Some AI Models

Vision models can be improved by training them on several altered versions of the same image and also by encouraging their weights to be close to zero. Recent research showed that both can have adverse effects that may be difficult to detect.

July 13, 20222 min read
Who Was That Masked Input? Pretraining Method Improves Computer Vision Performance
Machine Learning Research

Who Was That Masked Input? Pretraining Method Improves Computer Vision Performance

Researchers have shown that it’s possible to train a computer vision model effectively on around 66 percent of the pixels in each training image. New work used 25 percent, saving computation and boosting performance to boot.

July 6, 20222 min read
Who Was That Masked Input? Pretraining Method Improves Computer Vision Performance
Machine Learning Research

Who Was That Masked Input? Pretraining Method Improves Computer Vision Performance

Researchers have shown that it’s possible to train a computer vision model effectively on around 66 percent of the pixels in each training image. New work used 25 percent, saving computation and boosting performance to boot.

July 6, 20222 min read
A Transformer for Graphs: New Method for Processing Graph Data with Transformers
Machine Learning Research

A Transformer for Graphs: New Method for Processing Graph Data with Transformers

Transformers can learn a lot from sequential data like words in a book, but they’ve shown limited ability to learn from data in the form of a graph. A new transformer variant gives graphs due attention.

June 29, 20222 min read
A Transformer for Graphs: New Method for Processing Graph Data with Transformers
Machine Learning Research

A Transformer for Graphs: New Method for Processing Graph Data with Transformers

Transformers can learn a lot from sequential data like words in a book, but they’ve shown limited ability to learn from data in the form of a graph. A new transformer variant gives graphs due attention.

June 29, 20222 min read
Pile on the Layers!: DeepNorm Allows Transformers to Accommodate More Layers
Machine Learning Research

Pile on the Layers!: DeepNorm Allows Transformers to Accommodate More Layers

Adding layers to a neural network puts the “deep” in deep learning, but it also increases the chance that the network will get stuck during training. A new approach effectively trains transformers with an order of magnitude more layers than previous methods.

June 22, 20222 min read
Pile on the Layers!: DeepNorm Allows Transformers to Accommodate More Layers
Machine Learning Research

Pile on the Layers!: DeepNorm Allows Transformers to Accommodate More Layers

Adding layers to a neural network puts the “deep” in deep learning, but it also increases the chance that the network will get stuck during training. A new approach effectively trains transformers with an order of magnitude more layers than previous methods.

June 22, 20222 min read
Airfoils Automatically Optimized: DeepMind AI Research Simulates Fluid Dynamics
Machine Learning Research

Airfoils Automatically Optimized: DeepMind AI Research Simulates Fluid Dynamics

Engineers who design aircraft, aqueducts, and other objects that interact with air and water use numerical simulations to test potential shapes, but they rely on trial and error to improve their designs. A neural simulator can optimize the shape itself.

June 15, 20222 min read
Airfoils Automatically Optimized: DeepMind AI Research Simulates Fluid Dynamics
Machine Learning Research

Airfoils Automatically Optimized: DeepMind AI Research Simulates Fluid Dynamics

Engineers who design aircraft, aqueducts, and other objects that interact with air and water use numerical simulations to test potential shapes, but they rely on trial and error to improve their designs. A neural simulator can optimize the shape itself.

June 15, 20222 min read
Tech Imitates Life, Life Imitates Art: Image Generation Technique Works Pixel By Pixel
Machine Learning Research

Tech Imitates Life, Life Imitates Art: Image Generation Technique Works Pixel By Pixel

The computational systems known as cellular automata reproduce patterns of pixels by iteratively applying simple rules based loosely on the behavior of biological cells. New work extends their utility from reproducing images to generating new ones.

June 8, 20223 min read
Tech Imitates Life, Life Imitates Art: Image Generation Technique Works Pixel By Pixel
Machine Learning Research

Tech Imitates Life, Life Imitates Art: Image Generation Technique Works Pixel By Pixel

The computational systems known as cellular automata reproduce patterns of pixels by iteratively applying simple rules based loosely on the behavior of biological cells. New work extends their utility from reproducing images to generating new ones.

June 8, 20223 min read
Right-Sizing Confidence: Object Detector Lowers Confidence for Unfamiliar Inputs
Machine Learning Research

Right-Sizing Confidence: Object Detector Lowers Confidence for Unfamiliar Inputs

An object detector trained exclusively on urban images might mistake a moose for a pedestrian and express high confidence in its poor judgment. New work enables object detectors, and potentially other neural networks, to lower their confidence when they encounter unfamiliar inputs.

June 1, 20222 min read
Right-Sizing Confidence: Object Detector Lowers Confidence for Unfamiliar Inputs
Machine Learning Research

Right-Sizing Confidence: Object Detector Lowers Confidence for Unfamiliar Inputs

An object detector trained exclusively on urban images might mistake a moose for a pedestrian and express high confidence in its poor judgment. New work enables object detectors, and potentially other neural networks, to lower their confidence when they encounter unfamiliar inputs.

June 1, 20222 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox