Bigger, Faster Transformers: Increasing parameters without slowing down transformers
Language

Bigger, Faster Transformers: Increasing parameters without slowing down transformers

Performance in language tasks rises with the size of the model — yet, as a model’s parameter count rises, so does the time it takes to render output. New work pumps up the number of parameters without slowing down the network.

February 24, 20212 min read
Better Zero-Shot Translations: A method for improving transformer NLP translation
Language

Better Zero-Shot Translations: A method for improving transformer NLP translation

Train a multilingual language translator to translate between Spanish and English and between English and German, and it may be able to translate directly between Spanish and German as well. New work proposes a simple path to better machine translation between languages.

February 17, 20212 min read
Better Zero-Shot Translations: A method for improving transformer NLP translation
Language

Better Zero-Shot Translations: A method for improving transformer NLP translation

Train a multilingual language translator to translate between Spanish and English and between English and German, and it may be able to translate directly between Spanish and German as well. New work proposes a simple path to better machine translation between languages.

February 17, 20212 min read
How Art Makes AI Feel: How an AI model feels about art.
Language

How Art Makes AI Feel: How an AI model feels about art.

An automated art critic spells out the emotional impact of images. Led by Panos Achlioptas, researchers at Ecole Polytechnique, King Abdullah University, and Stanford University trained a deep learning system to generate subjective interpretations of art.

February 17, 20212 min read
How Art Makes AI Feel: How an AI model feels about art.
Language

How Art Makes AI Feel: How an AI model feels about art.

An automated art critic spells out the emotional impact of images. Led by Panos Achlioptas, researchers at Ecole Polytechnique, King Abdullah University, and Stanford University trained a deep learning system to generate subjective interpretations of art.

February 17, 20212 min read
Better Language Through Vision: Study improved Bert performance using visual tokens.
Language

Better Language Through Vision: Study improved Bert performance using visual tokens.

For children, associating a word with a picture that illustrates it helps them learn the word’s meaning. Research aims to do something similar for machine learning models. Researchers improved a BERT model’s performance on some language tasks by training it on a large dataset of image-word pairs.

February 10, 20212 min read
Better Language Through Vision: Study improved Bert performance using visual tokens.
Language

Better Language Through Vision: Study improved Bert performance using visual tokens.

For children, associating a word with a picture that illustrates it helps them learn the word’s meaning. Research aims to do something similar for machine learning models. Researchers improved a BERT model’s performance on some language tasks by training it on a large dataset of image-word pairs.

February 10, 20212 min read
Language Models Want to Be Free: How EleutherAI is developing a GPT-3 clone.
Language

Language Models Want to Be Free: How EleutherAI is developing a GPT-3 clone.

A grassroots research collective aims to make a GPT-3 clone that’s available to everyone. EleutherAI, a loose-knit group of independent researchers, is developing GPT-Neo, an open source, free-to-use version of OpenAI’s gargantuan language model.

February 3, 20211 min read
Language Models Want to Be Free: How EleutherAI is developing a GPT-3 clone.
Language

Language Models Want to Be Free: How EleutherAI is developing a GPT-3 clone.

A grassroots research collective aims to make a GPT-3 clone that’s available to everyone. EleutherAI, a loose-knit group of independent researchers, is developing GPT-Neo, an open source, free-to-use version of OpenAI’s gargantuan language model.

February 3, 20211 min read
Quake Watch: AI model detects earthquakes and estimates epicenters.
Language

Quake Watch: AI model detects earthquakes and estimates epicenters.

Detecting earthquakes is an important step toward warning surrounding communities that damaging seismic waves may be headed their way. A new model detects tremors and provides clues to their epicenter.

January 27, 20212 min read
The Language of Viruses: Researchers trained a neural net to predict viruses in DNA.
Language

The Language of Viruses: Researchers trained a neural net to predict viruses in DNA.

A neural network learned to read the genes of viruses as though they were text. That could enable researchers to page ahead for potentially dangerous mutations. Researchers at MIT trained a language model to predict mutations that would enable infectious viruses to become even more virulent.

January 27, 20212 min read
The Language of Viruses: Researchers trained a neural net to predict viruses in DNA.
Language

The Language of Viruses: Researchers trained a neural net to predict viruses in DNA.

A neural network learned to read the genes of viruses as though they were text. That could enable researchers to page ahead for potentially dangerous mutations. Researchers at MIT trained a language model to predict mutations that would enable infectious viruses to become even more virulent.

January 27, 20212 min read
Every Picture Tells a Story: Facebook expands automated alternative text.
Language

Every Picture Tells a Story: Facebook expands automated alternative text.

Facebook expanded a system of vision, language, and speech models designed to open the social network to users who are visually impaired. A Facebook service that describes photos in a synthesized voice now recognizes 1,200 visual concepts — 10 times more than the previous version.

January 27, 20212 min read
Quake Watch: AI model detects earthquakes and estimates epicenters.
Language

Quake Watch: AI model detects earthquakes and estimates epicenters.

Detecting earthquakes is an important step toward warning surrounding communities that damaging seismic waves may be headed their way. A new model detects tremors and provides clues to their epicenter.

January 27, 20212 min read
Every Picture Tells a Story: Facebook expands automated alternative text.
Language

Every Picture Tells a Story: Facebook expands automated alternative text.

Facebook expanded a system of vision, language, and speech models designed to open the social network to users who are visually impaired. A Facebook service that describes photos in a synthesized voice now recognizes 1,200 visual concepts — 10 times more than the previous version.

January 27, 20212 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox