Machine Learning Research
Competitive Coder: AI code writing system can compete alongside humans.
Programming is hard. Programming competitions are harder. Yet transformers proved themselves up to the task.
Machine Learning Research
The Limits of Pretraining: More pretraining doesn't guarantee a better fine-tuned AI.
The higher the accuracy of a pretrained model, the better its performance after fine-tuning, right? Not necessarily. Researchers conducted a meta-analysis of image-recognition experiments and performed some of their own.
Machine Learning Research
Competitive Coder: AI code writing system can compete alongside humans.
Programming is hard. Programming competitions are harder. Yet transformers proved themselves up to the task.
Machine Learning Research
The Limits of Pretraining: More pretraining doesn't guarantee a better fine-tuned AI.
The higher the accuracy of a pretrained model, the better its performance after fine-tuning, right? Not necessarily. Researchers conducted a meta-analysis of image-recognition experiments and performed some of their own.
Machine Learning Research
Roadblocks to Regulation: Why laws to regulate AI usually fail.
Most U.S. state agencies use AI without limits or oversight. An investigative report probed reasons why efforts to rein them in have made little headway. Since 2018, nearly every proposed bill aimed at studying or controlling how state agencies use automated decision systems.
Machine Learning Research
Fake Faces Are Good Training Data: Synthetic data improves face recognition performance.
Collecting and annotating a dataset of facial portraits is a big job. New research shows that synthetic data can work just as well.
Machine Learning Research
Roadblocks to Regulation: Why laws to regulate AI usually fail.
Most U.S. state agencies use AI without limits or oversight. An investigative report probed reasons why efforts to rein them in have made little headway. Since 2018, nearly every proposed bill aimed at studying or controlling how state agencies use automated decision systems.
Machine Learning Research
Fake Faces Are Good Training Data: Synthetic data improves face recognition performance.
Collecting and annotating a dataset of facial portraits is a big job. New research shows that synthetic data can work just as well.
Machine Learning Research
Transformers See in 3D: Using transformers to visualize depth in 2D images.
Visual robots typically perceive the three-dimensional world through sequences of two-dimensional images, but they don’t always know what they’re looking at. For instance, Tesla’s self-driving system has been known to mistake a full moon for a traffic light.
Machine Learning Research
High Accuracy at Low Power: An energy efficient method for computer vision
Equipment that relies on computer vision while unplugged — mobile phones, drones, satellites, autonomous cars — need power-efficient models. A new architecture set a record for accuracy per computation.
Machine Learning Research
High Accuracy at Low Power: An energy efficient method for computer vision
Equipment that relies on computer vision while unplugged — mobile phones, drones, satellites, autonomous cars — need power-efficient models. A new architecture set a record for accuracy per computation.
Machine Learning Research
Transformers See in 3D: Using transformers to visualize depth in 2D images.
Visual robots typically perceive the three-dimensional world through sequences of two-dimensional images, but they don’t always know what they’re looking at. For instance, Tesla’s self-driving system has been known to mistake a full moon for a traffic light.
Machine Learning Research
More Learning With Less Memory: Training large language models using less memory.
Researchers discovered a new way to reduce memory requirements when training large machine learning models. Tim Dettmers and colleagues at University of Washington released 8-bit optimizers that store gradient statistics as 8-bit values, while maintaining the same accuracy.
Machine Learning Research
More Learning With Less Memory: Training large language models using less memory.
Researchers discovered a new way to reduce memory requirements when training large machine learning models. Tim Dettmers and colleagues at University of Washington released 8-bit optimizers that store gradient statistics as 8-bit values, while maintaining the same accuracy.
Machine Learning Research
Tax Relief the AI Way: AI Economist creates optimal tax rate.
Nothing is certain except death and taxes, the saying goes — but how to make taxes fair and beneficial remains an open question. New research aims to answer it.
Subscribe to The Batch
Stay updated with weekly AI News and Insights delivered to your inbox