Trillions of Parameters: Are AI models with trillions of parameters the new normal?
Nvidia

Trillions of Parameters: Are AI models with trillions of parameters the new normal?

The trend toward ever-larger models crossed the threshold from immense to ginormous. Google kicked off 2021 with Switch Transformer, the first published work to exceed a trillion parameters, weighing in at 1.6 trillion.

December 22, 20212 min read
Trillions of Parameters: Are AI models with trillions of parameters the new normal?
Nvidia

Trillions of Parameters: Are AI models with trillions of parameters the new normal?

The trend toward ever-larger models crossed the threshold from immense to ginormous. Google kicked off 2021 with Switch Transformer, the first published work to exceed a trillion parameters, weighing in at 1.6 trillion.

December 22, 20212 min read
Large Language Models Shrink: Gopher and RETRO prove lean language models can push boundaries.
Nvidia

Large Language Models Shrink: Gopher and RETRO prove lean language models can push boundaries.

DeepMind released three papers that push the boundaries — and examine the issues — of large language models.

December 15, 20212 min read
Large Language Models Shrink: Gopher and RETRO prove lean language models can push boundaries.
Nvidia

Large Language Models Shrink: Gopher and RETRO prove lean language models can push boundaries.

DeepMind released three papers that push the boundaries — and examine the issues — of large language models.

December 15, 20212 min read
Meet the New Smart-Cities Champ: Chinese researchers win prizes for AI traffic safety.
Nvidia

Meet the New Smart-Cities Champ: Chinese researchers win prizes for AI traffic safety.

Chinese researchers for the first time swept a competition to develop AI systems that monitor urban traffic. Chinese universities and companies won first and second place place in all five categories of the 2021 AI City Challenge.

July 28, 20211 min read
Meet the New Smart-Cities Champ: Chinese researchers win prizes for AI traffic safety.
Nvidia

Meet the New Smart-Cities Champ: Chinese researchers win prizes for AI traffic safety.

Chinese researchers for the first time swept a competition to develop AI systems that monitor urban traffic. Chinese universities and companies won first and second place place in all five categories of the 2021 AI City Challenge.

July 28, 20211 min read
Motion Mapper: An AI system for automated animations for video game sprites
Nvidia

Motion Mapper: An AI system for automated animations for video game sprites

In some animated games, different characters can perform the same actions — say, walking, jumping, or casting spells. A new system learned from unlabeled data to transfer such motions from one character to another.

April 14, 20212 min read
Motion Mapper: An AI system for automated animations for video game sprites
Nvidia

Motion Mapper: An AI system for automated animations for video game sprites

In some animated games, different characters can perform the same actions — say, walking, jumping, or casting spells. A new system learned from unlabeled data to transfer such motions from one character to another.

April 14, 20212 min read
Computation as a National Resource: An effort to estimate computing capacity for 37 nations.
Nvidia

Computation as a National Resource: An effort to estimate computing capacity for 37 nations.

How much processing power do various nations have on hand to drive their AI strategy? An international trade group aims to find out. The Organisation for Economic Co-operation and Development (OECD) is launching an effort to measure the computing capacity available in countries around the world.

February 17, 20211 min read
Computation as a National Resource: An effort to estimate computing capacity for 37 nations.
Nvidia

Computation as a National Resource: An effort to estimate computing capacity for 37 nations.

How much processing power do various nations have on hand to drive their AI strategy? An international trade group aims to find out. The Organisation for Economic Co-operation and Development (OECD) is launching an effort to measure the computing capacity available in countries around the world.

February 17, 20211 min read
Selective Attention: More efficient NLP training without sacrificing performance
Nvidia

Selective Attention: More efficient NLP training without sacrificing performance

Large transformer networks work wonders with natural language, but they require enormous amounts of computation. New research slashes processor cycles without compromising performance.

November 18, 20201 min read
Selective Attention: More efficient NLP training without sacrificing performance
Nvidia

Selective Attention: More efficient NLP training without sacrificing performance

Large transformer networks work wonders with natural language, but they require enormous amounts of computation. New research slashes processor cycles without compromising performance.

November 18, 20201 min read
Data Compression By AI: Nvidia uses AI to enhance video conferencing quality.
Nvidia

Data Compression By AI: Nvidia uses AI to enhance video conferencing quality.

In this work-from-home era, who hasn’t spent a video conference wishing they could read an onscreen document without turning their eyes from the person they’re talking with? Or simply hoping the stream wouldn’t stutter or stall? Deep learning can fill in the missing pieces.

October 14, 20201 min read
Data Compression By AI: Nvidia uses AI to enhance video conferencing quality.
Nvidia

Data Compression By AI: Nvidia uses AI to enhance video conferencing quality.

In this work-from-home era, who hasn’t spent a video conference wishing they could read an onscreen document without turning their eyes from the person they’re talking with? Or simply hoping the stream wouldn’t stutter or stall? Deep learning can fill in the missing pieces.

October 14, 20201 min read
GANs for Smaller Data: Training GANs on small data without overfitting
Nvidia

GANs for Smaller Data: Training GANs on small data without overfitting

Trained on a small dataset, generative adversarial networks (GANs) tend to generate either replicas of the training data or noisy output. A new method spurs them to produce satisfying variations.

October 14, 20202 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox