Self-Supervised Learning

18 Posts

The Big Picture and the Details: I-JEPA, or how vision models understand the relationship between parts and the whole
Self-Supervised Learning

The Big Picture and the Details: I-JEPA, or how vision models understand the relationship between parts and the whole

A novel twist on self-supervised learning aims to improve on earlier methods by helping vision models learn how parts of an image relate to the whole.

December 13, 20232 min read
The Big Picture and the Details: I-JEPA, or how vision models understand the relationship between parts and the whole
Self-Supervised Learning

The Big Picture and the Details: I-JEPA, or how vision models understand the relationship between parts and the whole

A novel twist on self-supervised learning aims to improve on earlier methods by helping vision models learn how parts of an image relate to the whole.

December 13, 20232 min read
Alexei Efros: Learning from the ground up
Self-Supervised Learning

Alexei Efros: Learning from the ground up

Things are really starting to get going in the field of AI. After many years (decades?!) of focusing on algorithms, the AI community is finally ready to accept the central role of data and the high-capacity models that are capable of taking advantage of this data.

December 29, 20212 min read
Alexei Efros: Learning from the ground up
Self-Supervised Learning

Alexei Efros: Learning from the ground up

Things are really starting to get going in the field of AI. After many years (decades?!) of focusing on algorithms, the AI community is finally ready to accept the central role of data and the high-capacity models that are capable of taking advantage of this data.

December 29, 20212 min read
A Deeper Look at Graphs: Graph Neural Networks Work Better With More Layers
Self-Supervised Learning

A Deeper Look at Graphs: Graph Neural Networks Work Better With More Layers

New research shows that drastically increasing the number of layers in a graph neural networks improves its performance on large datasets.

December 1, 20212 min read
A Deeper Look at Graphs: Graph Neural Networks Work Better With More Layers
Self-Supervised Learning

A Deeper Look at Graphs: Graph Neural Networks Work Better With More Layers

New research shows that drastically increasing the number of layers in a graph neural networks improves its performance on large datasets.

December 1, 20212 min read
Unlabeled Brainwaves Spill Secrets: Deep learning helps doctors interpret EEGs.
Self-Supervised Learning

Unlabeled Brainwaves Spill Secrets: Deep learning helps doctors interpret EEGs.

For people with neurological disorders like epilepsy, attaching sensors to the scalp to measure electrical currents within the brain is benign. But interpreting the resulting electroencephalogram (EEG) graphs can give doctors a headache.

September 16, 20202 min read
Unlabeled Brainwaves Spill Secrets: Deep learning helps doctors interpret EEGs.
Self-Supervised Learning

Unlabeled Brainwaves Spill Secrets: Deep learning helps doctors interpret EEGs.

For people with neurological disorders like epilepsy, attaching sensors to the scalp to measure electrical currents within the brain is benign. But interpreting the resulting electroencephalogram (EEG) graphs can give doctors a headache.

September 16, 20202 min read
Fewer Labels, More Learning: How SimCLRv2 improves image recognition with fewer labels
Self-Supervised Learning

Fewer Labels, More Learning: How SimCLRv2 improves image recognition with fewer labels

Large models pretrained in an unsupervised fashion and then fine-tuned on a smaller corpus of labeled data have achieved spectacular results in natural language processing. New research pushes forward with a similar approach to computer vision.

September 9, 20202 min read
Fewer Labels, More Learning: How SimCLRv2 improves image recognition with fewer labels
Self-Supervised Learning

Fewer Labels, More Learning: How SimCLRv2 improves image recognition with fewer labels

Large models pretrained in an unsupervised fashion and then fine-tuned on a smaller corpus of labeled data have achieved spectacular results in natural language processing. New research pushes forward with a similar approach to computer vision.

September 9, 20202 min read
Self-Supervised Simplicity: Image classification with simple contrastive learning (SimCLR)
Self-Supervised Learning

Self-Supervised Simplicity: Image classification with simple contrastive learning (SimCLR)

A simple linear classifier paired with a self-supervised feature extractor outperformed a supervised deep learning model on ImageNet, according to new research.

March 18, 20202 min read
Self-Supervised Simplicity: Image classification with simple contrastive learning (SimCLR)
Self-Supervised Learning

Self-Supervised Simplicity: Image classification with simple contrastive learning (SimCLR)

A simple linear classifier paired with a self-supervised feature extractor outperformed a supervised deep learning model on ImageNet, according to new research.

March 18, 20202 min read
Meeting of the Minds: Deep learning pioneers discuss the state of AI.
Self-Supervised Learning

Meeting of the Minds: Deep learning pioneers discuss the state of AI.

Geoffrey Hinton, Yoshua Bengio, and Yann LeCun presented their latest thinking about deep learning’s limitations and how to overcome them.

February 19, 20202 min read
Meeting of the Minds: Deep learning pioneers discuss the state of AI.
Self-Supervised Learning

Meeting of the Minds: Deep learning pioneers discuss the state of AI.

Geoffrey Hinton, Yoshua Bengio, and Yann LeCun presented their latest thinking about deep learning’s limitations and how to overcome them.

February 19, 20202 min read
Better Than Backprop: Greedy InfoMax trains AI without end-to-end backpropagation.
Self-Supervised Learning

Better Than Backprop: Greedy InfoMax trains AI without end-to-end backpropagation.

End-to-end backpropagation and labeled data are the peanut butter and chocolate of deep learning. However, recent work suggests that neither is necessary to train effective neural networks to represent complex data.

January 22, 20202 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox