
Abeba Birhane: Clean up web datasets
From language to vision models, deep neural networks are marked by improved performance, higher efficiency, and better generalizations. Yet, these systems are also marked by perpetuation of bias and injustice.

From language to vision models, deep neural networks are marked by improved performance, higher efficiency, and better generalizations. Yet, these systems are also marked by perpetuation of bias and injustice.

In 2021, transformers were harnessed to discover drugs, recognize speech, and paint pictures — and much more.

In 2021, transformers were harnessed to discover drugs, recognize speech, and paint pictures — and much more.

While models like GPT-3 and EfficientNet, which work on text and images respectively, are responsible for some of deep learning’s highest-profile successes, approaches that find relationships between text and images made impressive

While models like GPT-3 and EfficientNet, which work on text and images respectively, are responsible for some of deep learning’s highest-profile successes, approaches that find relationships between text and images made impressive

The trend toward ever-larger models crossed the threshold from immense to ginormous. Google kicked off 2021 with Switch Transformer, the first published work to exceed a trillion parameters, weighing in at 1.6 trillion.

The trend toward ever-larger models crossed the threshold from immense to ginormous. Google kicked off 2021 with Switch Transformer, the first published work to exceed a trillion parameters, weighing in at 1.6 trillion.

DeepMind released three papers that push the boundaries — and examine the issues — of large language models.

DeepMind released three papers that push the boundaries — and examine the issues — of large language models.

Facebook released a chatbot that summarizes dialog on the fly and uses the summary to generate further repartee.

Facebook released a chatbot that summarizes dialog on the fly and uses the summary to generate further repartee.

The real-estate website Zillow bought and sold homes based on prices estimated by an algorithm — until Covid-19 confounded the model’s predictive power. Zillow, whose core business is providing real-estate information for prospective buyers, shut down its house-flipping division after...

The real-estate website Zillow bought and sold homes based on prices estimated by an algorithm — until Covid-19 confounded the model’s predictive power. Zillow, whose core business is providing real-estate information for prospective buyers, shut down its house-flipping division after...

The cost of training top-performing machine learning models has grown beyond the reach of smaller companies.

The cost of training top-performing machine learning models has grown beyond the reach of smaller companies.
Stay updated with weekly AI News and Insights delivered to your inbox