Making GANs More Inclusive: A technique to help GANs represent their datasets fairly
Machine Learning Research

Making GANs More Inclusive: A technique to help GANs represent their datasets fairly

A typical GAN’s output doesn’t necessarily reflect the data distribution of its training set. Instead, GANs are prone to modeling the majority of the training distribution, sometimes ignoring rare attributes — say, faces that represent minority populations.

September 30, 20202 min read
The Telltale Artifact: A technique for detecting GAN-generated deepfakes
Machine Learning Research

The Telltale Artifact: A technique for detecting GAN-generated deepfakes

Deepfakes have gone mainstream, allowing celebrities to star in commercials without setting foot in a film studio. A new method helps determine whether such endorsements — and other images produced by generative adversarial networks — are authentic.

September 30, 20202 min read
Guess What Happens Next: Research teaches robots to predict unseen obstacles.
Machine Learning Research

Guess What Happens Next: Research teaches robots to predict unseen obstacles.

New research teaches robots to anticipate what’s coming rather than focusing on what’s right in front of them. Researchers developed Occupancy Anticipation (OA), a navigation system that predicts unseen obstacles in addition to observing those in its field of view.

September 23, 20202 min read
Guess What Happens Next: Research teaches robots to predict unseen obstacles.
Machine Learning Research

Guess What Happens Next: Research teaches robots to predict unseen obstacles.

New research teaches robots to anticipate what’s coming rather than focusing on what’s right in front of them. Researchers developed Occupancy Anticipation (OA), a navigation system that predicts unseen obstacles in addition to observing those in its field of view.

September 23, 20202 min read
More Efficient Transformers: BigBird is an efficient attention mechanism for transformers.
Machine Learning Research

More Efficient Transformers: BigBird is an efficient attention mechanism for transformers.

As transformer networks move to the fore in applications from language to vision, the time it takes them to crunch longer sequences becomes a more pressing issue. A new method lightens the computational load using sparse attention.

September 23, 20202 min read
More Efficient Transformers: BigBird is an efficient attention mechanism for transformers.
Machine Learning Research

More Efficient Transformers: BigBird is an efficient attention mechanism for transformers.

As transformer networks move to the fore in applications from language to vision, the time it takes them to crunch longer sequences becomes a more pressing issue. A new method lightens the computational load using sparse attention.

September 23, 20202 min read
Do Muppets Have Common Sense?: The Bert NLP model scores high on common sense test.
Machine Learning Research

Do Muppets Have Common Sense?: The Bert NLP model scores high on common sense test.

Two years after it pointed a new direction for language models, Bert still hovers near the top of several natural language processing leaderboards. A new study considers whether Bert simply excels at tracking word order or or learns something closer to common sense.

September 16, 20202 min read
Unlabeled Brainwaves Spill Secrets: Deep learning helps doctors interpret EEGs.
Machine Learning Research

Unlabeled Brainwaves Spill Secrets: Deep learning helps doctors interpret EEGs.

For people with neurological disorders like epilepsy, attaching sensors to the scalp to measure electrical currents within the brain is benign. But interpreting the resulting electroencephalogram (EEG) graphs can give doctors a headache.

September 16, 20202 min read
Unlabeled Brainwaves Spill Secrets: Deep learning helps doctors interpret EEGs.
Machine Learning Research

Unlabeled Brainwaves Spill Secrets: Deep learning helps doctors interpret EEGs.

For people with neurological disorders like epilepsy, attaching sensors to the scalp to measure electrical currents within the brain is benign. But interpreting the resulting electroencephalogram (EEG) graphs can give doctors a headache.

September 16, 20202 min read
Do Muppets Have Common Sense?: The Bert NLP model scores high on common sense test.
Machine Learning Research

Do Muppets Have Common Sense?: The Bert NLP model scores high on common sense test.

Two years after it pointed a new direction for language models, Bert still hovers near the top of several natural language processing leaderboards. A new study considers whether Bert simply excels at tracking word order or or learns something closer to common sense.

September 16, 20202 min read
Optimizer Shootout: An evaluation of 14 deep learning optimizers
Machine Learning Research

Optimizer Shootout: An evaluation of 14 deep learning optimizers

Everyone has a favorite optimization method, but it’s not always clear which one works best in a given situation. New research aims to establish a set of benchmarks. Researchers evaluated 14 popular optimizers using the Deep Optimization Benchmark Suite some of them introduced last year.

September 9, 20202 min read
Fewer Labels, More Learning: How SimCLRv2 improves image recognition with fewer labels
Machine Learning Research

Fewer Labels, More Learning: How SimCLRv2 improves image recognition with fewer labels

Large models pretrained in an unsupervised fashion and then fine-tuned on a smaller corpus of labeled data have achieved spectacular results in natural language processing. New research pushes forward with a similar approach to computer vision.

September 9, 20202 min read
Optimizer Shootout: An evaluation of 14 deep learning optimizers
Machine Learning Research

Optimizer Shootout: An evaluation of 14 deep learning optimizers

Everyone has a favorite optimization method, but it’s not always clear which one works best in a given situation. New research aims to establish a set of benchmarks. Researchers evaluated 14 popular optimizers using the Deep Optimization Benchmark Suite some of them introduced last year.

September 9, 20202 min read
Fewer Labels, More Learning: How SimCLRv2 improves image recognition with fewer labels
Machine Learning Research

Fewer Labels, More Learning: How SimCLRv2 improves image recognition with fewer labels

Large models pretrained in an unsupervised fashion and then fine-tuned on a smaller corpus of labeled data have achieved spectacular results in natural language processing. New research pushes forward with a similar approach to computer vision.

September 9, 20202 min read
Dropout With a Difference: Reduce neural net overfitting without impacting accuracy
Machine Learning Research

Dropout With a Difference: Reduce neural net overfitting without impacting accuracy

The technique known as dropout discourages neural networks from overfitting by deterring them from reliance on particular features. A new approach reorganizes the process to run efficiently on the chips that typically run neural network calculations.

September 2, 20202 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox