Collaborative Text Generator: A language model that collaborates with human writers
Machine Learning Research

Collaborative Text Generator: A language model that collaborates with human writers

Text from current language models can be useful as a rough draft, but that leaves the polishing to human writers. A language model learned how to generate and respond to editorial directions.

April 5, 20233 min read
Collaborative Text Generator: A language model that collaborates with human writers
Machine Learning Research

Collaborative Text Generator: A language model that collaborates with human writers

Text from current language models can be useful as a rough draft, but that leaves the polishing to human writers. A language model learned how to generate and respond to editorial directions.

April 5, 20233 min read
Efficient Reinforcement Learning: IRIS used reinforcement learning to master Atari games with little gameplay.
Machine Learning Research

Efficient Reinforcement Learning: IRIS used reinforcement learning to master Atari games with little gameplay.

Both transformers and reinforcement learning models are notoriously data-hungry. They may be less so when they work together. Vincent Micheli and colleagues at the University of Geneva trained a transformer-based system to simulate Atari games using a small amount of gameplay.

March 29, 20232 min read
Efficient Reinforcement Learning: IRIS used reinforcement learning to master Atari games with little gameplay.
Machine Learning Research

Efficient Reinforcement Learning: IRIS used reinforcement learning to master Atari games with little gameplay.

Both transformers and reinforcement learning models are notoriously data-hungry. They may be less so when they work together. Vincent Micheli and colleagues at the University of Geneva trained a transformer-based system to simulate Atari games using a small amount of gameplay.

March 29, 20232 min read
Real-World Training on the Double: A new method rapidly trains robots in the real world.
Machine Learning Research

Real-World Training on the Double: A new method rapidly trains robots in the real world.

Roboticists often train their machines in simulation, where the controller model can learn from millions of hours of experience. A new method trained robots in the real world in 20 minutes.

March 22, 20232 min read
Real-World Training on the Double: A new method rapidly trains robots in the real world.
Machine Learning Research

Real-World Training on the Double: A new method rapidly trains robots in the real world.

Roboticists often train their machines in simulation, where the controller model can learn from millions of hours of experience. A new method trained robots in the real world in 20 minutes.

March 22, 20232 min read
Vision and Language Tightly Bound: Training on a single loss function improves multimiodal AI.
Machine Learning Research

Vision and Language Tightly Bound: Training on a single loss function improves multimiodal AI.

Recent multimodal models process both text and images as sequences of tokens, but they learn to represent these distinct data types using separate loss functions. Recent work unifies the loss function as well.

March 15, 20232 min read
Vision and Language Tightly Bound: Training on a single loss function improves multimiodal AI.
Machine Learning Research

Vision and Language Tightly Bound: Training on a single loss function improves multimiodal AI.

Recent multimodal models process both text and images as sequences of tokens, but they learn to represent these distinct data types using separate loss functions. Recent work unifies the loss function as well.

March 15, 20232 min read
GPT-4 Has Landed: Everything you need to know about GPT-4.
Machine Learning Research

GPT-4 Has Landed: Everything you need to know about GPT-4.

Get ready for the next wave of language-model mania. OpenAI introduced the latest in its GPT series of large language models to widespread excitement. The company showed statistics and examples designed to demonstrate...

March 15, 20233 min read
GPT-4 Has Landed: Everything you need to know about GPT-4.
Machine Learning Research

GPT-4 Has Landed: Everything you need to know about GPT-4.

Get ready for the next wave of language-model mania. OpenAI introduced the latest in its GPT series of large language models to widespread excitement. The company showed statistics and examples designed to demonstrate...

March 15, 20233 min read
Text-Driven Video Alteration: Gen-1 uses text prompts to modify videos.
Machine Learning Research

Text-Driven Video Alteration: Gen-1 uses text prompts to modify videos.

On the heels of systems that generate video directly from text, new work uses text to adjust the imagery in existing videos. Researchers unveiled Gen-1...

March 8, 20233 min read
Text-Driven Video Alteration: Gen-1 uses text prompts to modify videos.
Machine Learning Research

Text-Driven Video Alteration: Gen-1 uses text prompts to modify videos.

On the heels of systems that generate video directly from text, new work uses text to adjust the imagery in existing videos. Researchers unveiled Gen-1...

March 8, 20233 min read
PCA Raises Red Flags: Principal component analysis can negatively impact science.
Machine Learning Research

PCA Raises Red Flags: Principal component analysis can negatively impact science.

Principal component analysis is a key machine learning technique for reducing the number of dimensions in a dataset, but new research shows that its output can be inconsistent and unreliable.

March 2, 20232 min read
PCA Raises Red Flags: Principal component analysis can negatively impact science.
Machine Learning Research

PCA Raises Red Flags: Principal component analysis can negatively impact science.

Principal component analysis is a key machine learning technique for reducing the number of dimensions in a dataset, but new research shows that its output can be inconsistent and unreliable.

March 2, 20232 min read
Streamlined Robot Training: Robots trained in lo-fi simulation perform better in reality.
Machine Learning Research

Streamlined Robot Training: Robots trained in lo-fi simulation perform better in reality.

Autonomous robots trained to navigate in a simulation often struggle in the real world. New work helps bridge the gap in a counterintuitive way.

February 22, 20232 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox