Better Language Through Vision: Study improved Bert performance using visual tokens.
Machine Learning Research

Better Language Through Vision: Study improved Bert performance using visual tokens.

For children, associating a word with a picture that illustrates it helps them learn the word’s meaning. Research aims to do something similar for machine learning models. Researchers improved a BERT model’s performance on some language tasks by training it on a large dataset of image-word pairs.

February 10, 20212 min read
Better Language Through Vision: Study improved Bert performance using visual tokens.
Machine Learning Research

Better Language Through Vision: Study improved Bert performance using visual tokens.

For children, associating a word with a picture that illustrates it helps them learn the word’s meaning. Research aims to do something similar for machine learning models. Researchers improved a BERT model’s performance on some language tasks by training it on a large dataset of image-word pairs.

February 10, 20212 min read
Shortcut to Cancer Treatment: AI suggests breast cancer therapies based on tumor-tissue slides.
Machine Learning Research

Shortcut to Cancer Treatment: AI suggests breast cancer therapies based on tumor-tissue slides.

Doctors who treat breast cancer typically use a quick, inexpensive tumor-tissue stain test to diagnose the illness and a slower, more costly one to determine treatment. A new neural network could help doctors to go straight from diagnosis to treatment.

February 10, 20212 min read
Performance Guaranteed: How deep learning networks can become Bayes-optimal.
Machine Learning Research

Performance Guaranteed: How deep learning networks can become Bayes-optimal.

Bayes-optimal algorithms always make the best decisions given their training and input, if certain assumptions hold true. New work shows that some neural networks can approach this kind of performance.

February 3, 20212 min read
Performance Guaranteed: How deep learning networks can become Bayes-optimal.
Machine Learning Research

Performance Guaranteed: How deep learning networks can become Bayes-optimal.

Bayes-optimal algorithms always make the best decisions given their training and input, if certain assumptions hold true. New work shows that some neural networks can approach this kind of performance.

February 3, 20212 min read
A Privacy Threat Revealed: How researchers cracked InstaHide for computer vision.
Machine Learning Research

A Privacy Threat Revealed: How researchers cracked InstaHide for computer vision.

With access to a trained model, an attacker can use a reconstruction attack to approximate its training data. A method called InstaHide recently won acclaim for promising to make such examples unrecognizable to human eyes while retaining their utility for training.

February 3, 20212 min read
A Privacy Threat Revealed: How researchers cracked InstaHide for computer vision.
Machine Learning Research

A Privacy Threat Revealed: How researchers cracked InstaHide for computer vision.

With access to a trained model, an attacker can use a reconstruction attack to approximate its training data. A method called InstaHide recently won acclaim for promising to make such examples unrecognizable to human eyes while retaining their utility for training.

February 3, 20212 min read
Quake Watch: AI model detects earthquakes and estimates epicenters.
Machine Learning Research

Quake Watch: AI model detects earthquakes and estimates epicenters.

Detecting earthquakes is an important step toward warning surrounding communities that damaging seismic waves may be headed their way. A new model detects tremors and provides clues to their epicenter.

January 27, 20212 min read
The Language of Viruses: Researchers trained a neural net to predict viruses in DNA.
Machine Learning Research

The Language of Viruses: Researchers trained a neural net to predict viruses in DNA.

A neural network learned to read the genes of viruses as though they were text. That could enable researchers to page ahead for potentially dangerous mutations. Researchers at MIT trained a language model to predict mutations that would enable infectious viruses to become even more virulent.

January 27, 20212 min read
The Language of Viruses: Researchers trained a neural net to predict viruses in DNA.
Machine Learning Research

The Language of Viruses: Researchers trained a neural net to predict viruses in DNA.

A neural network learned to read the genes of viruses as though they were text. That could enable researchers to page ahead for potentially dangerous mutations. Researchers at MIT trained a language model to predict mutations that would enable infectious viruses to become even more virulent.

January 27, 20212 min read
Images From Noise: An upgrade for score-based generative AI models.
Machine Learning Research

Images From Noise: An upgrade for score-based generative AI models.

Generative adversarial networks and souped-up language models aren’t the only image generators around. Researchers recently upgraded an alternative known as score-based generative models.

January 27, 20213 min read
Images From Noise: An upgrade for score-based generative AI models.
Machine Learning Research

Images From Noise: An upgrade for score-based generative AI models.

Generative adversarial networks and souped-up language models aren’t the only image generators around. Researchers recently upgraded an alternative known as score-based generative models.

January 27, 20213 min read
Quake Watch: AI model detects earthquakes and estimates epicenters.
Machine Learning Research

Quake Watch: AI model detects earthquakes and estimates epicenters.

Detecting earthquakes is an important step toward warning surrounding communities that damaging seismic waves may be headed their way. A new model detects tremors and provides clues to their epicenter.

January 27, 20212 min read
Adversarial Helper: Adversarial learning can improve vision and NLP.
Machine Learning Research

Adversarial Helper: Adversarial learning can improve vision and NLP.

Models that learn relationships between images and words are gaining a higher profile. New research shows that adversarial learning, usually a way to make models robust to deliberately misleading inputs, can boost vision-and-language performance.

January 20, 20212 min read
Adversarial Helper: Adversarial learning can improve vision and NLP.
Machine Learning Research

Adversarial Helper: Adversarial learning can improve vision and NLP.

Models that learn relationships between images and words are gaining a higher profile. New research shows that adversarial learning, usually a way to make models robust to deliberately misleading inputs, can boost vision-and-language performance.

January 20, 20212 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox