MLP-Mixer

4 Posts

The Limits of Pretraining: More pretraining doesn't guarantee a better fine-tuned AI.
MLP-Mixer

The Limits of Pretraining: More pretraining doesn't guarantee a better fine-tuned AI.

The higher the accuracy of a pretrained model, the better its performance after fine-tuning, right? Not necessarily. Researchers conducted a meta-analysis of image-recognition experiments and performed some of their own.

February 9, 20222 min read
The Limits of Pretraining: More pretraining doesn't guarantee a better fine-tuned AI.
MLP-Mixer

The Limits of Pretraining: More pretraining doesn't guarantee a better fine-tuned AI.

The higher the accuracy of a pretrained model, the better its performance after fine-tuning, right? Not necessarily. Researchers conducted a meta-analysis of image-recognition experiments and performed some of their own.

February 9, 20222 min read
Revenge of the Perceptrons: Perceptrons do some AI tasks on par with complex AI.
MLP-Mixer

Revenge of the Perceptrons: Perceptrons do some AI tasks on par with complex AI.

Why use a complex model when a simple one will do? New work shows that the simplest multilayer neural network, with a small twist, can perform some tasks as well as today’s most sophisticated architectures.

August 4, 20212 min read
Revenge of the Perceptrons: Perceptrons do some AI tasks on par with complex AI.
MLP-Mixer

Revenge of the Perceptrons: Perceptrons do some AI tasks on par with complex AI.

Why use a complex model when a simple one will do? New work shows that the simplest multilayer neural network, with a small twist, can perform some tasks as well as today’s most sophisticated architectures.

August 4, 20212 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox