Self-Training for Sharper Vision: The noisy student method for computer vision, explained
Machine Learning Research

Self-Training for Sharper Vision: The noisy student method for computer vision, explained

The previous state-of-the-art image classifier was trained on the ImageNet dataset plus 3.5 billion supplemental images from a different database. A new method achieved higher accuracy with one-tenth as many supplemental examples — and they were unlabeled, to boot.

December 18, 20192 min read
Self-Training for Sharper Vision: The noisy student method for computer vision, explained
Machine Learning Research

Self-Training for Sharper Vision: The noisy student method for computer vision, explained

The previous state-of-the-art image classifier was trained on the ImageNet dataset plus 3.5 billion supplemental images from a different database. A new method achieved higher accuracy with one-tenth as many supplemental examples — and they were unlabeled, to boot.

December 18, 20192 min read
Seeing the World Blindfolded: The observational dropout technique, explained
Machine Learning Research

Seeing the World Blindfolded: The observational dropout technique, explained

In reinforcement learning, if researchers want an agent to have an internal representation of its environment, they’ll build and train a world model that it can refer to. New research shows that world models can emerge from standard training, rather than needing to be built separately.

December 11, 20192 min read
Keeping the Facts Straight: NLP system FactCC fact checks texts.
Machine Learning Research

Keeping the Facts Straight: NLP system FactCC fact checks texts.

Automatically generated text summaries are becoming common in search engines and news websites. But existing summarizers often mix up facts. For instance, a victim’s name might get switched for the perpetrator’s.

December 11, 20192 min read
Keeping the Facts Straight: NLP system FactCC fact checks texts.
Machine Learning Research

Keeping the Facts Straight: NLP system FactCC fact checks texts.

Automatically generated text summaries are becoming common in search engines and news websites. But existing summarizers often mix up facts. For instance, a victim’s name might get switched for the perpetrator’s.

December 11, 20192 min read
Seeing the World Blindfolded: The observational dropout technique, explained
Machine Learning Research

Seeing the World Blindfolded: The observational dropout technique, explained

In reinforcement learning, if researchers want an agent to have an internal representation of its environment, they’ll build and train a world model that it can refer to. New research shows that world models can emerge from standard training, rather than needing to be built separately.

December 11, 20192 min read
Bigger Corpora, Better Answers: Using knowledge graphs to improve question answering NLP
Machine Learning Research

Bigger Corpora, Better Answers: Using knowledge graphs to improve question answering NLP

Models that summarize documents and answer questions work pretty well with limited source material, but they can slip into incoherence when they draw from a sizeable corpus. Recent work addresses this problem.

December 4, 20192 min read
Bigger Corpora, Better Answers: Using knowledge graphs to improve question answering NLP
Machine Learning Research

Bigger Corpora, Better Answers: Using knowledge graphs to improve question answering NLP

Models that summarize documents and answer questions work pretty well with limited source material, but they can slip into incoherence when they draw from a sizeable corpus. Recent work addresses this problem.

December 4, 20192 min read
Bias Fighter: A neural network for countering bias variables in data
Machine Learning Research

Bias Fighter: A neural network for countering bias variables in data

Sophisticated models trained on biased data can learn discriminatory patterns, which leads to skewed decisions. A new solution aims to prevent neural networks from making decisions based on common biases.

December 4, 20192 min read
Bias Fighter: A neural network for countering bias variables in data
Machine Learning Research

Bias Fighter: A neural network for countering bias variables in data

Sophisticated models trained on biased data can learn discriminatory patterns, which leads to skewed decisions. A new solution aims to prevent neural networks from making decisions based on common biases.

December 4, 20192 min read
Melding Transformers with RL: GTrXL combines transformers and reinforcement learning.
Machine Learning Research

Melding Transformers with RL: GTrXL combines transformers and reinforcement learning.

Large NLP models like BERT can answer questions about a document thanks to the transformer network, a sequence-processing architecture that retains information across much longer sequences than previous methods. But transformers have had little success in reinforcement learning — until now.

November 27, 20192 min read
Bias Goes Undercover: Adversarial attacks can fool explainable AI techniques.
Machine Learning Research

Bias Goes Undercover: Adversarial attacks can fool explainable AI techniques.

As black-box algorithms like neural networks find their way into high-stakes fields such as transportation, healthcare, and finance, researchers have developed techniques to help explain models’ decisions. New findings show that some of these methods can be fooled.

November 27, 20192 min read
Bias Goes Undercover: Adversarial attacks can fool explainable AI techniques.
Machine Learning Research

Bias Goes Undercover: Adversarial attacks can fool explainable AI techniques.

As black-box algorithms like neural networks find their way into high-stakes fields such as transportation, healthcare, and finance, researchers have developed techniques to help explain models’ decisions. New findings show that some of these methods can be fooled.

November 27, 20192 min read
Melding Transformers with RL: GTrXL combines transformers and reinforcement learning.
Machine Learning Research

Melding Transformers with RL: GTrXL combines transformers and reinforcement learning.

Large NLP models like BERT can answer questions about a document thanks to the transformer network, a sequence-processing architecture that retains information across much longer sequences than previous methods. But transformers have had little success in reinforcement learning — until now.

November 27, 20192 min read
Nose Job: AI predicts smell by analyzing a molecule's structure.
Machine Learning Research

Nose Job: AI predicts smell by analyzing a molecule's structure.

Predicting a molecule’s aroma is hard because slight changes in structure lead to huge shifts in perception. Good thing deep learning is developing a sense of smell.

November 20, 20192 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox