Unsupervised Learning
Long-Haul Chatbot: Facebook Chatbot is Able to Carry on Long Conversations
Facebook released a chatbot that summarizes dialog on the fly and uses the summary to generate further repartee.
Unsupervised Learning
Finding Useful Points in Space: Keypoint3D Helps Robots Locate Spatial Coordinates
A new machine learning method aims to improve a machine’s ability to determine and locate points of interest.
Unsupervised Learning
Finding Useful Points in Space: Keypoint3D Helps Robots Locate Spatial Coordinates
A new machine learning method aims to improve a machine’s ability to determine and locate points of interest.
Unsupervised Learning
Transformer Speed-Up Sped Up: How to Speed Up Image Transformers
The transformer architecture is notoriously inefficient when processing long sequences — a problem in processing images, which are essentially long sequences of pixels. One way around this is to break up input images and process the pieces
Unsupervised Learning
Crawl the Web, Absorb the Bias: NLP Models Absorb Biases from Web Training Data
The emerging generation of trillion-parameter models needs datasets of billions of examples, but the most readily available source of examples on that scale — the web — is polluted with bias and antisocial expressions. A new study examines the issue.
Unsupervised Learning
Crawl the Web, Absorb the Bias: NLP Models Absorb Biases from Web Training Data
The emerging generation of trillion-parameter models needs datasets of billions of examples, but the most readily available source of examples on that scale — the web — is polluted with bias and antisocial expressions. A new study examines the issue.
Unsupervised Learning
Transformer Speed-Up Sped Up: How to Speed Up Image Transformers
The transformer architecture is notoriously inefficient when processing long sequences — a problem in processing images, which are essentially long sequences of pixels. One way around this is to break up input images and process the pieces
Unsupervised Learning
Weak Foundations Make Weak Models: Foundation AI Models Pass Flaws to Fine-Tuned Variants
A new study examines a major strain of recent research: huge models pretrained on immense quantities of uncurated, unlabeled data and then fine-tuned on a smaller, curated corpus.
Unsupervised Learning
Weak Foundations Make Weak Models: Foundation AI Models Pass Flaws to Fine-Tuned Variants
A new study examines a major strain of recent research: huge models pretrained on immense quantities of uncurated, unlabeled data and then fine-tuned on a smaller, curated corpus.
Unsupervised Learning
More Reliable Pretraining: Pretraining Method Helps AI Learn Useful Representations
Pretraining methods generate basic representations for later fine-tuning, but they’re prone to certain issues that can throw them off-kilter. New work proposes a solution.
Unsupervised Learning
More Reliable Pretraining: Pretraining Method Helps AI Learn Useful Representations
Pretraining methods generate basic representations for later fine-tuning, but they’re prone to certain issues that can throw them off-kilter. New work proposes a solution.
Unsupervised Learning
Motion Mapper: An AI system for automated animations for video game sprites
In some animated games, different characters can perform the same actions — say, walking, jumping, or casting spells. A new system learned from unlabeled data to transfer such motions from one character to another.
Unsupervised Learning
Motion Mapper: An AI system for automated animations for video game sprites
In some animated games, different characters can perform the same actions — say, walking, jumping, or casting spells. A new system learned from unlabeled data to transfer such motions from one character to another.
Unsupervised Learning
Pretraining on Uncurated Data: How unlabeled data improved computer vision accuracy.
It’s well established that pretraining a model on a large dataset improves performance on fine-tuned tasks. In sufficient quantity and paired with a big model, even data scraped from the internet at random can contribute to the performance boost.
Unsupervised Learning
Pretraining on Uncurated Data: How unlabeled data improved computer vision accuracy.
It’s well established that pretraining a model on a large dataset improves performance on fine-tuned tasks. In sufficient quantity and paired with a big model, even data scraped from the internet at random can contribute to the performance boost.
Subscribe to The Batch
Stay updated with weekly AI News and Insights delivered to your inbox