Outstanding Research Without Massive Compute: Researchers at Stanford and Chan Zuckerberg Biohub Network dramatically simplified a key algorithm for training large language models.
Letters

Outstanding Research Without Massive Compute: Researchers at Stanford and Chan Zuckerberg Biohub Network dramatically simplified a key algorithm for training large language models.

It is only rarely that, after reading a research paper, I feel like giving the authors a standing ovation. But I felt that way after finishing Direct Preference Optimization (DPO) by...

January 10, 20243 min read
The New York Times versus OpenAI and Microsoft: The New York Times sued OpenAI and Microsoft for copyright infringement, but the real issues and harms are not clear.
Letters

The New York Times versus OpenAI and Microsoft: The New York Times sued OpenAI and Microsoft for copyright infringement, but the real issues and harms are not clear.

Last week, the New York Times (NYT) filed a lawsuit against OpenAI and Microsoft, alleging massive copyright infringements. The suit claims, among other things, that OpenAI and Microsoft used millions of copyrighted NYT articles to train their models...

January 3, 20243 min read
The New York Times versus OpenAI and Microsoft: The New York Times sued OpenAI and Microsoft for copyright infringement, but the real issues and harms are not clear.
Letters

The New York Times versus OpenAI and Microsoft: The New York Times sued OpenAI and Microsoft for copyright infringement, but the real issues and harms are not clear.

Last week, the New York Times (NYT) filed a lawsuit against OpenAI and Microsoft, alleging massive copyright infringements. The suit claims, among other things, that OpenAI and Microsoft used millions of copyrighted NYT articles to train their models...

January 3, 20243 min read
What Will Change — And What Will Stay the Same: Change is hard to predict, so invest your time and energy in things that aren't likely to change.
Letters

What Will Change — And What Will Stay the Same: Change is hard to predict, so invest your time and energy in things that aren't likely to change.

AI is progressing faster than ever. This is thrilling, yet rapid change can be disorienting. In such times, it’s useful to follow Jeff Bezos’ advice to think about not only what is changing but also what will stay the same.

December 27, 20232 min read
What Will Change — And What Will Stay the Same: Change is hard to predict, so invest your time and energy in things that aren't likely to change.
Letters

What Will Change — And What Will Stay the Same: Change is hard to predict, so invest your time and energy in things that aren't likely to change.

AI is progressing faster than ever. This is thrilling, yet rapid change can be disorienting. In such times, it’s useful to follow Jeff Bezos’ advice to think about not only what is changing but also what will stay the same.

December 27, 20232 min read
The View From NeurIPS 2023: NeurIPS 2023 was chockablock with generative AI, large multimodal models, autonomous agents — and anxiety about the pace of development.
Letters

The View From NeurIPS 2023: NeurIPS 2023 was chockablock with generative AI, large multimodal models, autonomous agents — and anxiety about the pace of development.

Last week, I attended the NeurIPS conference in New Orleans. It was fun to catch up with old friends, make new ones, and also get a wide scan of current AI research.

December 20, 20232 min read
The View From NeurIPS 2023: NeurIPS 2023 was chockablock with generative AI, large multimodal models, autonomous agents — and anxiety about the pace of development.
Letters

The View From NeurIPS 2023: NeurIPS 2023 was chockablock with generative AI, large multimodal models, autonomous agents — and anxiety about the pace of development.

Last week, I attended the NeurIPS conference in New Orleans. It was fun to catch up with old friends, make new ones, and also get a wide scan of current AI research.

December 20, 20232 min read
AI Doomsday Scenarios and How to Guard Against Them: AI could help an evildoer perpetrate a bioweapon attack. Here's what we can do about it.
Letters

AI Doomsday Scenarios and How to Guard Against Them: AI could help an evildoer perpetrate a bioweapon attack. Here's what we can do about it.

Last week, I participated in the United States Senate’s Insight Forum on Artificial Intelligence to discuss “Risk, Alignment, & Guarding Against Doomsday Scenarios.”

December 13, 20233 min read
AI Doomsday Scenarios and How to Guard Against Them: AI could help an evildoer perpetrate a bioweapon attack. Here's what we can do about it.
Letters

AI Doomsday Scenarios and How to Guard Against Them: AI could help an evildoer perpetrate a bioweapon attack. Here's what we can do about it.

Last week, I participated in the United States Senate’s Insight Forum on Artificial Intelligence to discuss “Risk, Alignment, & Guarding Against Doomsday Scenarios.”

December 13, 20233 min read
Making Large Vision Models Work for Business: Large language models can learn what they need to know from the internet, but large vision models need training on proprietary data.
Letters

Making Large Vision Models Work for Business: Large language models can learn what they need to know from the internet, but large vision models need training on proprietary data.

Large language models, or LLMs, have transformed how we process text. Large vision models, or LVMs, are starting to change how we process images as well. But there is an important difference between LLMs and LVMs.

December 6, 20232 min read
Making Large Vision Models Work for Business: Large language models can learn what they need to know from the internet, but large vision models need training on proprietary data.
Letters

Making Large Vision Models Work for Business: Large language models can learn what they need to know from the internet, but large vision models need training on proprietary data.

Large language models, or LLMs, have transformed how we process text. Large vision models, or LVMs, are starting to change how we process images as well. But there is an important difference between LLMs and LVMs.

December 6, 20232 min read
An Expanding Universe of Large Language Models: From ChatGPT to the open source GPT4All, the bounty of large language models means opportunities for users and developers alike.
Letters

An Expanding Universe of Large Language Models: From ChatGPT to the open source GPT4All, the bounty of large language models means opportunities for users and developers alike.

One year since the launch of ChatGPT on November 30, 2022, it’s amazing how many large language models are available.  A year ago, ChatGPT was pretty much the only game in town for consumers (using a web user interface) who wanted to use a large language model (LLM)...

November 29, 20233 min read
An Expanding Universe of Large Language Models: From ChatGPT to the open source GPT4All, the bounty of large language models means opportunities for users and developers alike.
Letters

An Expanding Universe of Large Language Models: From ChatGPT to the open source GPT4All, the bounty of large language models means opportunities for users and developers alike.

One year since the launch of ChatGPT on November 30, 2022, it’s amazing how many large language models are available.  A year ago, ChatGPT was pretty much the only game in town for consumers (using a web user interface) who wanted to use a large language model (LLM)...

November 29, 20233 min read
What's Next for OpenAI: The abrupt firing and reinstatement of OpenAI CEO Sam Alman leaves impacts both hopeful and worrisome.
Letters

What's Next for OpenAI: The abrupt firing and reinstatement of OpenAI CEO Sam Alman leaves impacts both hopeful and worrisome.

I’m delighted that the crisis at OpenAI, which you can read about below, seems to have been resolved with an agreement in principle for Sam Altman to return as CEO after his sudden firing last week.

November 22, 20232 min read
What's Next for OpenAI: The abrupt firing and reinstatement of OpenAI CEO Sam Alman leaves impacts both hopeful and worrisome.
Letters

What's Next for OpenAI: The abrupt firing and reinstatement of OpenAI CEO Sam Alman leaves impacts both hopeful and worrisome.

I’m delighted that the crisis at OpenAI, which you can read about below, seems to have been resolved with an agreement in principle for Sam Altman to return as CEO after his sudden firing last week.

November 22, 20232 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox