Year in Review
Transformers Take Over: Transformers Applied to Vision, Language, Video, and More
In 2021, transformers were harnessed to discover drugs, recognize speech, and paint pictures — and much more.
Year in Review
Multimodal AI Takes Off: Multimodal Models, such as CLIP and DALL·E, are taking over AI.
While models like GPT-3 and EfficientNet, which work on text and images respectively, are responsible for some of deep learning’s highest-profile successes, approaches that find relationships between text and images made impressive
Year in Review
Governments Lay Down the Law: Governments around the world increasingly regulate AI.
Legislators worldwide wrote new laws — some proposed, some enacted — to rein in societal impacts of automation.What happened: Authorities at all levels ratcheted up regulatory pressure as
Year in Review
Governments Lay Down the Law: Governments around the world increasingly regulate AI.
Legislators worldwide wrote new laws — some proposed, some enacted — to rein in societal impacts of automation.What happened: Authorities at all levels ratcheted up regulatory pressure as
Year in Review
Trillions of Parameters: Are AI models with trillions of parameters the new normal?
The trend toward ever-larger models crossed the threshold from immense to ginormous. Google kicked off 2021 with Switch Transformer, the first published work to exceed a trillion parameters, weighing in at 1.6 trillion.
Year in Review
Trillions of Parameters: Are AI models with trillions of parameters the new normal?
The trend toward ever-larger models crossed the threshold from immense to ginormous. Google kicked off 2021 with Switch Transformer, the first published work to exceed a trillion parameters, weighing in at 1.6 trillion.
Year in Review
Writer’s Unblock: Language models keep getting bigger and better.
Neural networks for natural language processing got bigger, more prolific, and more fun to play with. Language models, which already had grown to gargantuan size, continued to swell, yielding chatbots that mimic AI luminaries and have very strange ideas about horses.
Year in Review
Writer’s Unblock: Language models keep getting bigger and better.
Neural networks for natural language processing got bigger, more prolific, and more fun to play with. Language models, which already had grown to gargantuan size, continued to swell, yielding chatbots that mimic AI luminaries and have very strange ideas about horses.
Year in Review
The Model Will See You Now: The rise of medical AI in 2020
Institutional hurdles to AI for medicine began to fall, setting the stage for widespread clinical use of deep learning in medical devices and treatments. DeepMind’s AlphaFold model determined the three-dimensional shape of a protein in just hours.
Year in Review
The Model Will See You Now: The rise of medical AI in 2020
Institutional hurdles to AI for medicine began to fall, setting the stage for widespread clinical use of deep learning in medical devices and treatments. DeepMind’s AlphaFold model determined the three-dimensional shape of a protein in just hours.
Year in Review
Algorithms Against Disinformation: How Facebook, Twitter, and more fought disinfo in 2020.
The worldwide pandemic and a contentious U.S. election whipped up a storm of automated disinformation, and some big AI companies reaped the whirlwind.
Year in Review
Algorithms Against Disinformation: How Facebook, Twitter, and more fought disinfo in 2020.
The worldwide pandemic and a contentious U.S. election whipped up a storm of automated disinformation, and some big AI companies reaped the whirlwind.
Year in Review
Representing the Underrepresented: Many important AI datasets contain bias.
Some of deep learning’s bedrock datasets came under scrutiny as researchers combed them for built-in biases. Researchers found that popular datasets impart biases against socially marginalized groups to trained models due to the ways the datasets were compiled, labeled, and used.
Year in Review
Representing the Underrepresented: Many important AI datasets contain bias.
Some of deep learning’s bedrock datasets came under scrutiny as researchers combed them for built-in biases. Researchers found that popular datasets impart biases against socially marginalized groups to trained models due to the ways the datasets were compiled, labeled, and used.
Year in Review
This Snowman Does Not Exist: The rise of deepfakes in 2020
While generative adversarial networks were infiltrating cultural, social, and scientific spheres, they quietly transformed the web into a bottomless well of synthetic images of . . . well, you name it.
Subscribe to The Batch
Stay updated with weekly AI News and Insights delivered to your inbox