What We Know — and Don’t Know — About Foundation Models: A new Stanford index to assess the transparency of leading AI models
Machine Learning Research

What We Know — and Don’t Know — About Foundation Models: A new Stanford index to assess the transparency of leading AI models

A new index ranks popular AI models in terms of information their developers provide about their training, architecture, and usage. Few score well.

November 1, 20233 min read
What We Know — and Don’t Know — About Foundation Models: A new Stanford index to assess the transparency of leading AI models
Machine Learning Research

What We Know — and Don’t Know — About Foundation Models: A new Stanford index to assess the transparency of leading AI models

A new index ranks popular AI models in terms of information their developers provide about their training, architecture, and usage. Few score well.

November 1, 20233 min read
Better Reasoning from ChatGPT: Iterative bootstrapping, a new method to improve chain-of-thought prompting
Machine Learning Research

Better Reasoning from ChatGPT: Iterative bootstrapping, a new method to improve chain-of-thought prompting

You can get a large language model to solve math problems more accurately if your prompts include a chain of thought: an example that solves a similar problem through a series of intermediate reasoning steps. A new approach to...

October 18, 20233 min read
Better Reasoning from ChatGPT: Iterative bootstrapping, a new method to improve chain-of-thought prompting
Machine Learning Research

Better Reasoning from ChatGPT: Iterative bootstrapping, a new method to improve chain-of-thought prompting

You can get a large language model to solve math problems more accurately if your prompts include a chain of thought: an example that solves a similar problem through a series of intermediate reasoning steps. A new approach to...

October 18, 20233 min read
Guiding the Scalpel: Researchers trained neural networks to assist brain surgeons' real-time tumor removal decisions.
Machine Learning Research

Guiding the Scalpel: Researchers trained neural networks to assist brain surgeons' real-time tumor removal decisions.

A neural network helped brain surgeons decide how much healthy tissue to cut out when removing tumors — while the patients were on the operating table.

October 18, 20232 min read
Guiding the Scalpel: Researchers trained neural networks to assist brain surgeons' real-time tumor removal decisions.
Machine Learning Research

Guiding the Scalpel: Researchers trained neural networks to assist brain surgeons' real-time tumor removal decisions.

A neural network helped brain surgeons decide how much healthy tissue to cut out when removing tumors — while the patients were on the operating table.

October 18, 20232 min read
Training on Generated Data Skews Model Performance: Study shows flaws in the output of models trained on other models’ outputs
Machine Learning Research

Training on Generated Data Skews Model Performance: Study shows flaws in the output of models trained on other models’ outputs

How accurate are machine learning models that were trained on data produced by other models? Researchers studied models that learned from data generated by models that learned from data generated by still other models.

October 11, 20233 min read
Training on Generated Data Skews Model Performance: Study shows flaws in the output of models trained on other models’ outputs
Machine Learning Research

Training on Generated Data Skews Model Performance: Study shows flaws in the output of models trained on other models’ outputs

How accurate are machine learning models that were trained on data produced by other models? Researchers studied models that learned from data generated by models that learned from data generated by still other models.

October 11, 20233 min read
More Scraped Data, Greater Bias: Research shows that training on larger datasets can increase social bias.
Machine Learning Research

More Scraped Data, Greater Bias: Research shows that training on larger datasets can increase social bias.

How can we build large-scale language and vision models that don’t inherit social biases? Conventional wisdom suggests training on larger datasets, but research challenges this assumption.

October 4, 20232 min read
More Scraped Data, Greater Bias: Research shows that training on larger datasets can increase social bias.
Machine Learning Research

More Scraped Data, Greater Bias: Research shows that training on larger datasets can increase social bias.

How can we build large-scale language and vision models that don’t inherit social biases? Conventional wisdom suggests training on larger datasets, but research challenges this assumption.

October 4, 20232 min read
How Vision Transformers See: A new understanding of what's happening inside transformers
Machine Learning Research

How Vision Transformers See: A new understanding of what's happening inside transformers

While transformers have delivered state-of-the-art results in several domains of machine learning, few attempts have been made to probe their inner workings. Researchers offer a new approach.

September 27, 20232 min read
How Vision Transformers See: A new understanding of what's happening inside transformers
Machine Learning Research

How Vision Transformers See: A new understanding of what's happening inside transformers

While transformers have delivered state-of-the-art results in several domains of machine learning, few attempts have been made to probe their inner workings. Researchers offer a new approach.

September 27, 20232 min read
Energy-Efficient Cooling: Google's DeepMind algorithms dramatically boost energy efficiency in commercial buildings.
Machine Learning Research

Energy-Efficient Cooling: Google's DeepMind algorithms dramatically boost energy efficiency in commercial buildings.

A reinforcement learning model maintains cooler temperatures in large data centers and other buildings.

September 27, 20233 min read
Energy-Efficient Cooling: Google's DeepMind algorithms dramatically boost energy efficiency in commercial buildings.
Machine Learning Research

Energy-Efficient Cooling: Google's DeepMind algorithms dramatically boost energy efficiency in commercial buildings.

A reinforcement learning model maintains cooler temperatures in large data centers and other buildings.

September 27, 20233 min read
Masked Pretraining for CNNs: ConvNeXt V2, the new model family that boosts ConvNet performance
Machine Learning Research

Masked Pretraining for CNNs: ConvNeXt V2, the new model family that boosts ConvNet performance

Vision transformers have bested convolutional neural networks (CNNs) in a number of key vision tasks. Have CNNs hit their limit? New research suggests otherwise.

September 13, 20232 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox