Abeba Birhane: Clean up web datasets
Language

Abeba Birhane: Clean up web datasets

From language to vision models, deep neural networks are marked by improved performance, higher efficiency, and better generalizations. Yet, these systems are also marked by perpetuation of bias and injustice.

December 29, 20213 min read
Transformers Take Over: Transformers Applied to Vision, Language, Video, and More
Language

Transformers Take Over: Transformers Applied to Vision, Language, Video, and More

In 2021, transformers were harnessed to discover drugs, recognize speech, and paint pictures — and much more.

December 22, 20212 min read
Transformers Take Over: Transformers Applied to Vision, Language, Video, and More
Language

Transformers Take Over: Transformers Applied to Vision, Language, Video, and More

In 2021, transformers were harnessed to discover drugs, recognize speech, and paint pictures — and much more.

December 22, 20212 min read
Multimodal AI Takes Off: Multimodal Models, such as CLIP and DALL·E, are taking over AI.
Language

Multimodal AI Takes Off: Multimodal Models, such as CLIP and DALL·E, are taking over AI.

While models like GPT-3 and EfficientNet, which work on text and images respectively, are responsible for some of deep learning’s highest-profile successes, approaches that find relationships between text and images made impressive

December 22, 20211 min read
Multimodal AI Takes Off: Multimodal Models, such as CLIP and DALL·E, are taking over AI.
Language

Multimodal AI Takes Off: Multimodal Models, such as CLIP and DALL·E, are taking over AI.

While models like GPT-3 and EfficientNet, which work on text and images respectively, are responsible for some of deep learning’s highest-profile successes, approaches that find relationships between text and images made impressive

December 22, 20211 min read
Trillions of Parameters: Are AI models with trillions of parameters the new normal?
Language

Trillions of Parameters: Are AI models with trillions of parameters the new normal?

The trend toward ever-larger models crossed the threshold from immense to ginormous. Google kicked off 2021 with Switch Transformer, the first published work to exceed a trillion parameters, weighing in at 1.6 trillion.

December 22, 20212 min read
Trillions of Parameters: Are AI models with trillions of parameters the new normal?
Language

Trillions of Parameters: Are AI models with trillions of parameters the new normal?

The trend toward ever-larger models crossed the threshold from immense to ginormous. Google kicked off 2021 with Switch Transformer, the first published work to exceed a trillion parameters, weighing in at 1.6 trillion.

December 22, 20212 min read
Large Language Models Shrink: Gopher and RETRO prove lean language models can push boundaries.
Language

Large Language Models Shrink: Gopher and RETRO prove lean language models can push boundaries.

DeepMind released three papers that push the boundaries — and examine the issues — of large language models.

December 15, 20212 min read
Large Language Models Shrink: Gopher and RETRO prove lean language models can push boundaries.
Language

Large Language Models Shrink: Gopher and RETRO prove lean language models can push boundaries.

DeepMind released three papers that push the boundaries — and examine the issues — of large language models.

December 15, 20212 min read
Long-Haul Chatbot: Facebook Chatbot is Able to Carry on Long Conversations
Language

Long-Haul Chatbot: Facebook Chatbot is Able to Carry on Long Conversations

Facebook released a chatbot that summarizes dialog on the fly and uses the summary to generate further repartee.

November 24, 20212 min read
Long-Haul Chatbot: Facebook Chatbot is Able to Carry on Long Conversations
Language

Long-Haul Chatbot: Facebook Chatbot is Able to Carry on Long Conversations

Facebook released a chatbot that summarizes dialog on the fly and uses the summary to generate further repartee.

November 24, 20212 min read
Price Prediction Turns Perilous: How Covid Broke Zillow's Pricing Algorithm
Language

Price Prediction Turns Perilous: How Covid Broke Zillow's Pricing Algorithm

The real-estate website Zillow bought and sold homes based on prices estimated by an algorithm — until Covid-19 confounded the model’s predictive power. Zillow, whose core business is providing real-estate information for prospective buyers, shut down its house-flipping division after...

November 17, 20212 min read
Price Prediction Turns Perilous: How Covid Broke Zillow's Pricing Algorithm
Language

Price Prediction Turns Perilous: How Covid Broke Zillow's Pricing Algorithm

The real-estate website Zillow bought and sold homes based on prices estimated by an algorithm — until Covid-19 confounded the model’s predictive power. Zillow, whose core business is providing real-estate information for prospective buyers, shut down its house-flipping division after...

November 17, 20212 min read
Who Can Afford to Train AI?: Cost of AI is Too Expensive for Many Small Companies
Language

Who Can Afford to Train AI?: Cost of AI is Too Expensive for Many Small Companies

The cost of training top-performing machine learning models has grown beyond the reach of smaller companies.

November 17, 20212 min read
Who Can Afford to Train AI?: Cost of AI is Too Expensive for Many Small Companies
Language

Who Can Afford to Train AI?: Cost of AI is Too Expensive for Many Small Companies

The cost of training top-performing machine learning models has grown beyond the reach of smaller companies.

November 17, 20212 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox