Crawl the Web, Absorb the Bias: NLP Models Absorb Biases from Web Training Data
Natural Language Processing

Crawl the Web, Absorb the Bias: NLP Models Absorb Biases from Web Training Data

The emerging generation of trillion-parameter models needs datasets of billions of examples, but the most readily available source of examples on that scale — the web — is polluted with bias and antisocial expressions. A new study examines the issue.

October 13, 20212 min read
Search Goes Multimodal: Google Upgrades its Search Algorithm with Multimodal AI
Natural Language Processing

Search Goes Multimodal: Google Upgrades its Search Algorithm with Multimodal AI

Google will upgrade its search engine with a new model that tracks the relationships between words, images, and, in time, videos — the first fruit of its latest research into multimodal machine learning and multilingual language modeling.

October 13, 20212 min read
Search Goes Multimodal: Google Upgrades its Search Algorithm with Multimodal AI
Natural Language Processing

Search Goes Multimodal: Google Upgrades its Search Algorithm with Multimodal AI

Google will upgrade its search engine with a new model that tracks the relationships between words, images, and, in time, videos — the first fruit of its latest research into multimodal machine learning and multilingual language modeling.

October 13, 20212 min read
Sharper Attention: NLP transformer technique for more Efficient token usage.
Natural Language Processing

Sharper Attention: NLP transformer technique for more Efficient token usage.

Self-attention enables transformer networks to track relationships between distant tokens — such as text characters — in long sequences, but the computational resources required grow quadratically with input size.

August 11, 20212 min read
Sharper Attention: NLP transformer technique for more Efficient token usage.
Natural Language Processing

Sharper Attention: NLP transformer technique for more Efficient token usage.

Self-attention enables transformer networks to track relationships between distant tokens — such as text characters — in long sequences, but the computational resources required grow quadratically with input size.

August 11, 20212 min read
Double Check for Defamation: CaliberAI uses NLP to scan for possible legal defamation.
Natural Language Processing

Double Check for Defamation: CaliberAI uses NLP to scan for possible legal defamation.

A libel-detection system could help news outlets and social media companies stay out of legal hot water. CaliberAI, an Irish startup, scans text for statements that could be considered defamatory, Wired reported.

May 26, 20212 min read
Double Check for Defamation: CaliberAI uses NLP to scan for possible legal defamation.
Natural Language Processing

Double Check for Defamation: CaliberAI uses NLP to scan for possible legal defamation.

A libel-detection system could help news outlets and social media companies stay out of legal hot water. CaliberAI, an Irish startup, scans text for statements that could be considered defamatory, Wired reported.

May 26, 20212 min read
Greener Machine Learning: Here's how AI models can shrink their carbon footprints.
Natural Language Processing

Greener Machine Learning: Here's how AI models can shrink their carbon footprints.

A new study suggests tactics for machine learning engineers to cut their carbon emissions. Led by David Patterson, researchers at Google and UC Berkeley found that AI developers can shrink a model’s carbon footprint a thousand-fold by streamlining architecture...

May 5, 20211 min read
Greener Machine Learning: Here's how AI models can shrink their carbon footprints.
Natural Language Processing

Greener Machine Learning: Here's how AI models can shrink their carbon footprints.

A new study suggests tactics for machine learning engineers to cut their carbon emissions. Led by David Patterson, researchers at Google and UC Berkeley found that AI developers can shrink a model’s carbon footprint a thousand-fold by streamlining architecture...

May 5, 20211 min read
Haters Gonna [Mute]: Gamers can mute offensive language with AI.
Natural Language Processing

Haters Gonna [Mute]: Gamers can mute offensive language with AI.

A new tool aims to let video gamers control how much vitriol they receive from fellow players. Intel announced a voice recognition tool called Bleep that the company claims can moderate voice chat automatically, allowing users to silence offensive language.

April 21, 20212 min read
Haters Gonna [Mute]: Gamers can mute offensive language with AI.
Natural Language Processing

Haters Gonna [Mute]: Gamers can mute offensive language with AI.

A new tool aims to let video gamers control how much vitriol they receive from fellow players. Intel announced a voice recognition tool called Bleep that the company claims can moderate voice chat automatically, allowing users to silence offensive language.

April 21, 20212 min read
Bigger, Faster Transformers: Increasing parameters without slowing down transformers
Natural Language Processing

Bigger, Faster Transformers: Increasing parameters without slowing down transformers

Performance in language tasks rises with the size of the model — yet, as a model’s parameter count rises, so does the time it takes to render output. New work pumps up the number of parameters without slowing down the network.

February 24, 20212 min read
Bigger, Faster Transformers: Increasing parameters without slowing down transformers
Natural Language Processing

Bigger, Faster Transformers: Increasing parameters without slowing down transformers

Performance in language tasks rises with the size of the model — yet, as a model’s parameter count rises, so does the time it takes to render output. New work pumps up the number of parameters without slowing down the network.

February 24, 20212 min read
Language Models Want to Be Free: How EleutherAI is developing a GPT-3 clone.
Natural Language Processing

Language Models Want to Be Free: How EleutherAI is developing a GPT-3 clone.

A grassroots research collective aims to make a GPT-3 clone that’s available to everyone. EleutherAI, a loose-knit group of independent researchers, is developing GPT-Neo, an open source, free-to-use version of OpenAI’s gargantuan language model.

February 3, 20211 min read
Language Models Want to Be Free: How EleutherAI is developing a GPT-3 clone.
Natural Language Processing

Language Models Want to Be Free: How EleutherAI is developing a GPT-3 clone.

A grassroots research collective aims to make a GPT-3 clone that’s available to everyone. EleutherAI, a loose-knit group of independent researchers, is developing GPT-Neo, an open source, free-to-use version of OpenAI’s gargantuan language model.

February 3, 20211 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox