Better Than Backprop: Greedy InfoMax trains AI without end-to-end backpropagation.
Self-Supervised Learning

Better Than Backprop: Greedy InfoMax trains AI without end-to-end backpropagation.

End-to-end backpropagation and labeled data are the peanut butter and chocolate of deep learning. However, recent work suggests that neither is necessary to train effective neural networks to represent complex data.

January 22, 20202 min read
Yann LeCun — Learning From Observation: The power of self-supervised learning
Self-Supervised Learning

Yann LeCun — Learning From Observation: The power of self-supervised learning

How is it that many people learn to drive a car fairly safely in 20 hours of practice, while current imitation learning algorithms take hundreds of thousands of hours, and reinforcement learning algorithms take millions of hours? Clearly we’re missing something big.

January 1, 20202 min read
Yann LeCun — Learning From Observation: The power of self-supervised learning
Self-Supervised Learning

Yann LeCun — Learning From Observation: The power of self-supervised learning

How is it that many people learn to drive a car fairly safely in 20 hours of practice, while current imitation learning algorithms take hundreds of thousands of hours, and reinforcement learning algorithms take millions of hours? Clearly we’re missing something big.

January 1, 20202 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox