Walking the Dog: Training a robot to walk over unsteady terrain with RL.
Machine Learning Research

Walking the Dog: Training a robot to walk over unsteady terrain with RL.

A reinforcement learning system enabled a four-legged robot to amble over unfamiliar, rapidly changing terrain.

July 14, 20211 min read
Behavioral Cloning Shootout: AI learns to play Counter Strike  Global Offensive.
Machine Learning Research

Behavioral Cloning Shootout: AI learns to play Counter Strike Global Offensive.

Neural networks have learned to play video games like Dota 2 via reinforcement learning by playing for the equivalent of thousands of years (compressed into far less time). In new work, an automated player learned not by playing for millennia but by watching a few days’ worth of recorded gameplay.

July 7, 20212 min read
Behavioral Cloning Shootout: AI learns to play Counter Strike  Global Offensive.
Machine Learning Research

Behavioral Cloning Shootout: AI learns to play Counter Strike Global Offensive.

Neural networks have learned to play video games like Dota 2 via reinforcement learning by playing for the equivalent of thousands of years (compressed into far less time). In new work, an automated player learned not by playing for millennia but by watching a few days’ worth of recorded gameplay.

July 7, 20212 min read
Pattern for Efficient Learning: A training method for few-shot learning in computer vision.
Machine Learning Research

Pattern for Efficient Learning: A training method for few-shot learning in computer vision.

Getting high accuracy out of a classifier trained on a small number of examples is tricky. You might train the model on several large-scale datasets prior to few-shot training, but what if the few-shot dataset includes novel classes? A new method performs well even in that case.

June 30, 20212 min read
Pattern for Efficient Learning: A training method for few-shot learning in computer vision.
Machine Learning Research

Pattern for Efficient Learning: A training method for few-shot learning in computer vision.

Getting high accuracy out of a classifier trained on a small number of examples is tricky. You might train the model on several large-scale datasets prior to few-shot training, but what if the few-shot dataset includes novel classes? A new method performs well even in that case.

June 30, 20212 min read
Synthetic Videos on the Double: VideoGPT is an efficient generative AI system for video.
Machine Learning Research

Synthetic Videos on the Double: VideoGPT is an efficient generative AI system for video.

Using a neural network to generate realistic videos takes a lot of computation. New work performs the task efficiently enough to run on a beefy personal computer.

June 23, 20212 min read
Synthetic Videos on the Double: VideoGPT is an efficient generative AI system for video.
Machine Learning Research

Synthetic Videos on the Double: VideoGPT is an efficient generative AI system for video.

Using a neural network to generate realistic videos takes a lot of computation. New work performs the task efficiently enough to run on a beefy personal computer.

June 23, 20212 min read
The Writing, Not the Doodles: A handwriting detection AI model for messy paper.
Machine Learning Research

The Writing, Not the Doodles: A handwriting detection AI model for messy paper.

Systems designed to turn handwriting into text typically work best on pages with a consistent layout, such as a single column unbroken by drawings, diagrams, or extraneous symbols. A new system removes that requirement.

June 16, 20212 min read
The Writing, Not the Doodles: A handwriting detection AI model for messy paper.
Machine Learning Research

The Writing, Not the Doodles: A handwriting detection AI model for messy paper.

Systems designed to turn handwriting into text typically work best on pages with a consistent layout, such as a single column unbroken by drawings, diagrams, or extraneous symbols. A new system removes that requirement.

June 16, 20212 min read
3D Scene Synthesis for the Real World: Generating 3D scenes with radiance fields and image data
Machine Learning Research

3D Scene Synthesis for the Real World: Generating 3D scenes with radiance fields and image data

Researchers have used neural networks to generate novel views of a 3D scene based on existing pictures plus the positions and angles of the cameras that took them. In practice, though, you may not know the precise camera

June 9, 20212 min read
3D Scene Synthesis for the Real World: Generating 3D scenes with radiance fields and image data
Machine Learning Research

3D Scene Synthesis for the Real World: Generating 3D scenes with radiance fields and image data

Researchers have used neural networks to generate novel views of a 3D scene based on existing pictures plus the positions and angles of the cameras that took them. In practice, though, you may not know the precise camera

June 9, 20212 min read
One Model for Vision-Language: A general purpose AI for vision and language tasks.
Machine Learning Research

One Model for Vision-Language: A general purpose AI for vision and language tasks.

Researchers have proposed task-agnostic architectures for image classification tasks and language tasks. New work proposes a single architecture for vision-language tasks.

June 2, 20212 min read
One Model for Vision-Language: A general purpose AI for vision and language tasks.
Machine Learning Research

One Model for Vision-Language: A general purpose AI for vision and language tasks.

Researchers have proposed task-agnostic architectures for image classification tasks and language tasks. New work proposes a single architecture for vision-language tasks.

June 2, 20212 min read
What AI Knows About Proteins: NLP systems can be used to code amino acids.
Machine Learning Research

What AI Knows About Proteins: NLP systems can be used to code amino acids.

Transformer models trained on sequences of amino acids that form proteins have had success classifying and generating viable sequences. New research shows that they also capture information about protein structure.

June 2, 20212 min read
What AI Knows About Proteins: NLP systems can be used to code amino acids.
Machine Learning Research

What AI Knows About Proteins: NLP systems can be used to code amino acids.

Transformer models trained on sequences of amino acids that form proteins have had success classifying and generating viable sequences. New research shows that they also capture information about protein structure.

June 2, 20212 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox