
Albert Gu: More learning, less data
Building a foundation model takes tremendous amounts of data. In the coming year, I hope we’ll enable models to learn more from less data.

Building a foundation model takes tremendous amounts of data. In the coming year, I hope we’ll enable models to learn more from less data.

In 2025, I expect progress in training foundation models to slow down as we hit scaling limits and inference costs continue to rise.

In 2025, I expect progress in training foundation models to slow down as we hit scaling limits and inference costs continue to rise.

For years, the best AI models got bigger and bigger. But in 2024, some popular large language models were small enough to run on a smartphone.

For years, the best AI models got bigger and bigger. But in 2024, some popular large language models were small enough to run on a smartphone.

Video generation exploded in an abundance of powerful models.

Video generation exploded in an abundance of powerful models.

Fierce competition among model makers and cloud providers drove down the price of access to state-of-the-art models.

Fierce competition among model makers and cloud providers drove down the price of access to state-of-the-art models.

The AI community laid the foundation for systems that can act by prompting large language models iteratively, leading to much higher performance across a range of applications.

The AI community laid the foundation for systems that can act by prompting large language models iteratively, leading to much higher performance across a range of applications.

How do agents based on large language models compare to human experts when it comes to proposing machine learning research? Pretty well, according to one study.

How do agents based on large language models compare to human experts when it comes to proposing machine learning research? Pretty well, according to one study.

Google’s Gemini 2.0 Flash, the first member of its updated Gemini family of large multimodal models, combines speed with performance that exceeds that of its earlier flagship model, Gemini 1.5 Pro, on several measures.

Google’s Gemini 2.0 Flash, the first member of its updated Gemini family of large multimodal models, combines speed with performance that exceeds that of its earlier flagship model, Gemini 1.5 Pro, on several measures.
Stay updated with weekly AI News and Insights delivered to your inbox