Optimizer Without Hyperparameters: VeLO, the system that eliminates the need for optimizer hyperparameters
Machine Learning Research

Optimizer Without Hyperparameters: VeLO, the system that eliminates the need for optimizer hyperparameters

During training, a neural network usually updates its weights according to an optimizer that’s tuned using hand-picked hyperparameters. New work eliminates the need for optimizer hyperparameters.

July 19, 20233 min read
Optimizer Without Hyperparameters: VeLO, the system that eliminates the need for optimizer hyperparameters
Machine Learning Research

Optimizer Without Hyperparameters: VeLO, the system that eliminates the need for optimizer hyperparameters

During training, a neural network usually updates its weights according to an optimizer that’s tuned using hand-picked hyperparameters. New work eliminates the need for optimizer hyperparameters.

July 19, 20233 min read
Sample-Efficient Training for Robots: Reinforcement learning from human feedback to train robots
Machine Learning Research

Sample-Efficient Training for Robots: Reinforcement learning from human feedback to train robots

Training an agent that controls a robot arm to perform a task — say, opening a door — that involves a sequence of motions (reach, grasp, turn, pull, release) can take from tens of thousands to millions of examples...

July 12, 20233 min read
Sample-Efficient Training for Robots: Reinforcement learning from human feedback to train robots
Machine Learning Research

Sample-Efficient Training for Robots: Reinforcement learning from human feedback to train robots

Training an agent that controls a robot arm to perform a task — say, opening a door — that involves a sequence of motions (reach, grasp, turn, pull, release) can take from tens of thousands to millions of examples...

July 12, 20233 min read
Bug Finder: A system that provides feedback with near human-level accuracy
Machine Learning Research

Bug Finder: A system that provides feedback with near human-level accuracy

One challenge to making online education available worldwide is evaluating an immense volume of student work. Especially difficult is evaluating interactive computer programming assignments such as coding a game.

July 5, 20233 min read
Bug Finder: A system that provides feedback with near human-level accuracy
Machine Learning Research

Bug Finder: A system that provides feedback with near human-level accuracy

One challenge to making online education available worldwide is evaluating an immense volume of student work. Especially difficult is evaluating interactive computer programming assignments such as coding a game.

July 5, 20233 min read
Finer Tuning: Surgical fine-tuning modifies layers based on data differences.
Machine Learning Research

Finer Tuning: Surgical fine-tuning modifies layers based on data differences.

Fine-tuning a neural network typically involves retraining every layer on new data. But research shows that networks may perform better when fine-tuning modifies only a subset of layers.

June 28, 20232 min read
Finer Tuning: Surgical fine-tuning modifies layers based on data differences.
Machine Learning Research

Finer Tuning: Surgical fine-tuning modifies layers based on data differences.

Fine-tuning a neural network typically involves retraining every layer on new data. But research shows that networks may perform better when fine-tuning modifies only a subset of layers.

June 28, 20232 min read
What the Brain Sees: How a text-to-image model generates images from brain scans
Machine Learning Research

What the Brain Sees: How a text-to-image model generates images from brain scans

A pretrained text-to-image generator enabled researchers to see — roughly — what other people looked at based on brain scans. Yu Takagi and Shinji Nishimoto developed a method that uses Stable Diffusion to reconstruct images viewed by test subjects...

June 22, 20232 min read
What the Brain Sees: How a text-to-image model generates images from brain scans
Machine Learning Research

What the Brain Sees: How a text-to-image model generates images from brain scans

A pretrained text-to-image generator enabled researchers to see — roughly — what other people looked at based on brain scans. Yu Takagi and Shinji Nishimoto developed a method that uses Stable Diffusion to reconstruct images viewed by test subjects...

June 22, 20232 min read
Like Diffusion but Faster: The Paella model for fast image generation, explained
Machine Learning Research

Like Diffusion but Faster: The Paella model for fast image generation, explained

The ability to generate realistic images without waiting would unlock applications from engineering to entertainment and beyond. New work takes a step in that direction.

June 14, 20232 min read
Like Diffusion but Faster: The Paella model for fast image generation, explained
Machine Learning Research

Like Diffusion but Faster: The Paella model for fast image generation, explained

The ability to generate realistic images without waiting would unlock applications from engineering to entertainment and beyond. New work takes a step in that direction.

June 14, 20232 min read
Optimizing Matrix Multiplication:  AlphaTensor for faster matrix multiplication, explained
Machine Learning Research

Optimizing Matrix Multiplication: AlphaTensor for faster matrix multiplication, explained

Matrix multiplication is executed so often in deep learning, video games, and scientific computing that even a slight acceleration can save substantial amounts of processing time. New work finds ways to speed up this crucial operation.

June 7, 20233 min read
Optimizing Matrix Multiplication:  AlphaTensor for faster matrix multiplication, explained
Machine Learning Research

Optimizing Matrix Multiplication: AlphaTensor for faster matrix multiplication, explained

Matrix multiplication is executed so often in deep learning, video games, and scientific computing that even a slight acceleration can save substantial amounts of processing time. New work finds ways to speed up this crucial operation.

June 7, 20233 min read
Text-to-Image Editing Evolves: InstructPix2Pix for text-to-image editing, explained
Machine Learning Research

Text-to-Image Editing Evolves: InstructPix2Pix for text-to-image editing, explained

Text-to-image generators like DALL·E 2, Stable Diffusion, and Adobe’s new Generative Fill feature can revise images in a targeted way — say, change the fruit in a bowl from oranges to bananas — if you enter a few words that describe the change plus an indication of the areas to be changed.

May 31, 20233 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox