Neural Networks Study Math: A sequence to sequence model for solving math problems.
Facebook

Neural Networks Study Math: A sequence to sequence model for solving math problems.

In tasks that involve generating natural language, neural networks often map an input sequence of words to an output sequence of words. Facebook researchers used a similar technique on sequences of mathematical symbols, training a model to map math problems to math solutions.

January 15, 20202 min read
Facebook vs Deepfakes: How Facebook cracked down on deepfakes
Facebook

Facebook vs Deepfakes: How Facebook cracked down on deepfakes

Facebook announced a ban on deepfake videos, on the heels of a crackdown on counterfeit profiles that used AI-generated faces. Facebook declared this week that it will remove deepfake videos it deems deliberately misleading.

January 8, 20201 min read
Facebook vs Deepfakes: How Facebook cracked down on deepfakes
Facebook

Facebook vs Deepfakes: How Facebook cracked down on deepfakes

Facebook announced a ban on deepfake videos, on the heels of a crackdown on counterfeit profiles that used AI-generated faces. Facebook declared this week that it will remove deepfake videos it deems deliberately misleading.

January 8, 20201 min read
Yann LeCun — Learning From Observation: The power of self-supervised learning
Facebook

Yann LeCun — Learning From Observation: The power of self-supervised learning

How is it that many people learn to drive a car fairly safely in 20 hours of practice, while current imitation learning algorithms take hundreds of thousands of hours, and reinforcement learning algorithms take millions of hours? Clearly we’re missing something big.

January 1, 20202 min read
Yann LeCun — Learning From Observation: The power of self-supervised learning
Facebook

Yann LeCun — Learning From Observation: The power of self-supervised learning

How is it that many people learn to drive a car fairly safely in 20 hours of practice, while current imitation learning algorithms take hundreds of thousands of hours, and reinforcement learning algorithms take millions of hours? Clearly we’re missing something big.

January 1, 20202 min read
Natural Language Processing Models Get Literate: Why 2019 was a breakthrough year for NLP
Facebook

Natural Language Processing Models Get Literate: Why 2019 was a breakthrough year for NLP

Earlier language models powered by Word2Vec and GloVe embeddings yielded confused chatbots, grammar tools with middle-school reading comprehension, and not-half-bad translations. The latest generation is so good, some people consider it dangerous.

December 24, 20192 min read
Deepfakes Go Mainstream: Why 2019 was a big year for deepfakes
Facebook

Deepfakes Go Mainstream: Why 2019 was a big year for deepfakes

Society awakened to the delight, threat, and sheer weirdness of realistic images and other media dreamed up by computers.

December 24, 20192 min read
Deepfakes Go Mainstream: Why 2019 was a big year for deepfakes
Facebook

Deepfakes Go Mainstream: Why 2019 was a big year for deepfakes

Society awakened to the delight, threat, and sheer weirdness of realistic images and other media dreamed up by computers.

December 24, 20192 min read
Natural Language Processing Models Get Literate: Why 2019 was a breakthrough year for NLP
Facebook

Natural Language Processing Models Get Literate: Why 2019 was a breakthrough year for NLP

Earlier language models powered by Word2Vec and GloVe embeddings yielded confused chatbots, grammar tools with middle-school reading comprehension, and not-half-bad translations. The latest generation is so good, some people consider it dangerous.

December 24, 20192 min read
Inside AI’s Muppet Empire: Why Are So Many NLP Models Named After Muppets?
Facebook

Inside AI’s Muppet Empire: Why Are So Many NLP Models Named After Muppets?

As language models show increasing power, a parallel trend has received less notice: The vogue for naming models after characters in the children’s TV show Sesame Street.

December 18, 20191 min read
Inside AI’s Muppet Empire: Why Are So Many NLP Models Named After Muppets?
Facebook

Inside AI’s Muppet Empire: Why Are So Many NLP Models Named After Muppets?

As language models show increasing power, a parallel trend has received less notice: The vogue for naming models after characters in the children’s TV show Sesame Street.

December 18, 20191 min read
Bigger Corpora, Better Answers: Using knowledge graphs to improve question answering NLP
Facebook

Bigger Corpora, Better Answers: Using knowledge graphs to improve question answering NLP

Models that summarize documents and answer questions work pretty well with limited source material, but they can slip into incoherence when they draw from a sizeable corpus. Recent work addresses this problem.

December 4, 20192 min read
Bigger Corpora, Better Answers: Using knowledge graphs to improve question answering NLP
Facebook

Bigger Corpora, Better Answers: Using knowledge graphs to improve question answering NLP

Models that summarize documents and answer questions work pretty well with limited source material, but they can slip into incoherence when they draw from a sizeable corpus. Recent work addresses this problem.

December 4, 20192 min read
Finer Tuning
Facebook

Finer Tuning

A word-embedding model typically learns vector representations from a large, general-purpose corpus like Google News. But to make the resulting vectors useful in a specialized domain, they must be fine-tuned on a smaller, domain-specific dataset. Researchers offer a more accurate method.

November 13, 20192 min read
Convolution Revolution
Facebook

Convolution Revolution

Looking at images, people see outlines before the details within them. A replacement for the traditional convolutional layer decomposes images based on this distinction between coarse and fine features.

November 13, 20192 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox