The Limits of Pretraining: More pretraining doesn't guarantee a better fine-tuned AI.
Google

The Limits of Pretraining: More pretraining doesn't guarantee a better fine-tuned AI.

The higher the accuracy of a pretrained model, the better its performance after fine-tuning, right? Not necessarily. Researchers conducted a meta-analysis of image-recognition experiments and performed some of their own.

February 9, 20222 min read
Robots in the Workplace: Google uses robot janitors to clean up offices.
Google

Robots in the Workplace: Google uses robot janitors to clean up offices.

Machines are doing light janitorial work in the uncontrolled environment of Google’s offices. Everyday Robots, a new spin-out from Google’s experimental X Development division, unleashed 100 robots to perform an array of cleanup tasks.

January 5, 20222 min read
Robots in the Workplace: Google uses robot janitors to clean up offices.
Google

Robots in the Workplace: Google uses robot janitors to clean up offices.

Machines are doing light janitorial work in the uncontrolled environment of Google’s offices. Everyday Robots, a new spin-out from Google’s experimental X Development division, unleashed 100 robots to perform an array of cleanup tasks.

January 5, 20222 min read
Transformers Take Over: Transformers Applied to Vision, Language, Video, and More
Google

Transformers Take Over: Transformers Applied to Vision, Language, Video, and More

In 2021, transformers were harnessed to discover drugs, recognize speech, and paint pictures — and much more.

December 22, 20212 min read
Transformers Take Over: Transformers Applied to Vision, Language, Video, and More
Google

Transformers Take Over: Transformers Applied to Vision, Language, Video, and More

In 2021, transformers were harnessed to discover drugs, recognize speech, and paint pictures — and much more.

December 22, 20212 min read
Multimodal AI Takes Off: Multimodal Models, such as CLIP and DALL·E, are taking over AI.
Google

Multimodal AI Takes Off: Multimodal Models, such as CLIP and DALL·E, are taking over AI.

While models like GPT-3 and EfficientNet, which work on text and images respectively, are responsible for some of deep learning’s highest-profile successes, approaches that find relationships between text and images made impressive

December 22, 20211 min read
Multimodal AI Takes Off: Multimodal Models, such as CLIP and DALL·E, are taking over AI.
Google

Multimodal AI Takes Off: Multimodal Models, such as CLIP and DALL·E, are taking over AI.

While models like GPT-3 and EfficientNet, which work on text and images respectively, are responsible for some of deep learning’s highest-profile successes, approaches that find relationships between text and images made impressive

December 22, 20211 min read
Trillions of Parameters: Are AI models with trillions of parameters the new normal?
Google

Trillions of Parameters: Are AI models with trillions of parameters the new normal?

The trend toward ever-larger models crossed the threshold from immense to ginormous. Google kicked off 2021 with Switch Transformer, the first published work to exceed a trillion parameters, weighing in at 1.6 trillion.

December 22, 20212 min read
Trillions of Parameters: Are AI models with trillions of parameters the new normal?
Google

Trillions of Parameters: Are AI models with trillions of parameters the new normal?

The trend toward ever-larger models crossed the threshold from immense to ginormous. Google kicked off 2021 with Switch Transformer, the first published work to exceed a trillion parameters, weighing in at 1.6 trillion.

December 22, 20212 min read
Large Language Models Shrink: Gopher and RETRO prove lean language models can push boundaries.
Google

Large Language Models Shrink: Gopher and RETRO prove lean language models can push boundaries.

DeepMind released three papers that push the boundaries — and examine the issues — of large language models.

December 15, 20212 min read
Large Language Models Shrink: Gopher and RETRO prove lean language models can push boundaries.
Google

Large Language Models Shrink: Gopher and RETRO prove lean language models can push boundaries.

DeepMind released three papers that push the boundaries — and examine the issues — of large language models.

December 15, 20212 min read
Reinforcement Learning Transformed: Transformers succeed at reinforcemend learning tasks.
Google

Reinforcement Learning Transformed: Transformers succeed at reinforcemend learning tasks.

Transformers have matched or exceeded earlier architectures in language modeling and image classification. New work shows they can achieve state-of-the-art results in some reinforcement learning tasks as well.

December 8, 20213 min read
Reinforcement Learning Transformed: Transformers succeed at reinforcemend learning tasks.
Google

Reinforcement Learning Transformed: Transformers succeed at reinforcemend learning tasks.

Transformers have matched or exceeded earlier architectures in language modeling and image classification. New work shows they can achieve state-of-the-art results in some reinforcement learning tasks as well.

December 8, 20213 min read
Everyone Has a Voice: Project Relate Offers Synthesized Speech that Works in Real Time
Google

Everyone Has a Voice: Project Relate Offers Synthesized Speech that Works in Real Time

An Android app offers speech recognition model for speech impaired by cerebral palsy, Down syndrome, Parkinson’s disease, stroke, or traumatic brain injury.

December 1, 20212 min read
Everyone Has a Voice: Project Relate Offers Synthesized Speech that Works in Real Time
Google

Everyone Has a Voice: Project Relate Offers Synthesized Speech that Works in Real Time

An Android app offers speech recognition model for speech impaired by cerebral palsy, Down syndrome, Parkinson’s disease, stroke, or traumatic brain injury.

December 1, 20212 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox