Coding Skill is More Valuable Than Ever: Don't let the ease of prompting large language models discourage you from learning to code.
Technical Insights

Coding Skill is More Valuable Than Ever: Don't let the ease of prompting large language models discourage you from learning to code.

Andrej Karpathy, one of the Heroes of Deep Learning who currently works at OpenAI, quipped, “The hottest programming language is English.” While I appreciate the sentiment...

October 4, 20232 min read
Coding Skill is More Valuable Than Ever: Don't let the ease of prompting large language models discourage you from learning to code.
Technical Insights

Coding Skill is More Valuable Than Ever: Don't let the ease of prompting large language models discourage you from learning to code.

Andrej Karpathy, one of the Heroes of Deep Learning who currently works at OpenAI, quipped, “The hottest programming language is English.” While I appreciate the sentiment...

October 4, 20232 min read
Better Relationships Through AI: Doctors say there’s an epidemic of loneliness. Here's how large language models can help.
Technical Insights

Better Relationships Through AI: Doctors say there’s an epidemic of loneliness. Here's how large language models can help.

Improvements in chatbots have opened a market for bots integrated with dating apps. I’m concerned that AI romantic partners create fake relationships that displace, rather than strengthen, meaningful human relationships.

September 28, 20233 min read
Better Relationships Through AI: Doctors say there’s an epidemic of loneliness. Here's how large language models can help.
Technical Insights

Better Relationships Through AI: Doctors say there’s an epidemic of loneliness. Here's how large language models can help.

Improvements in chatbots have opened a market for bots integrated with dating apps. I’m concerned that AI romantic partners create fake relationships that displace, rather than strengthen, meaningful human relationships.

September 28, 20233 min read
Which AI Applications Should You Build? Here's How to Decide: AI isn't ideal for everything. How can you decide which use cases to build? Think about tasks, not jobs.
Technical Insights

Which AI Applications Should You Build? Here's How to Decide: AI isn't ideal for everything. How can you decide which use cases to build? Think about tasks, not jobs.

While AI is a general-purpose technology that’s useful for many things, it isn’t good for every task under the sun. How can we decide which concrete use cases to build? If you’re helping a business figure out where to apply AI, I’ve found the following recipe useful as a brainstorming aid…

September 20, 20234 min read
Which AI Applications Should You Build? Here's How to Decide: AI isn't ideal for everything. How can you decide which use cases to build? Think about tasks, not jobs.
Technical Insights

Which AI Applications Should You Build? Here's How to Decide: AI isn't ideal for everything. How can you decide which use cases to build? Think about tasks, not jobs.

While AI is a general-purpose technology that’s useful for many things, it isn’t good for every task under the sun. How can we decide which concrete use cases to build? If you’re helping a business figure out where to apply AI, I’ve found the following recipe useful as a brainstorming aid…

September 20, 20234 min read
The Unlikely Roots of Large Language Models: U.S. military funding helped build the foundation for ChatGPT and other innovations in natural language processing.
Technical Insights

The Unlikely Roots of Large Language Models: U.S. military funding helped build the foundation for ChatGPT and other innovations in natural language processing.

I’d like to share a part of the origin story of large language models that isn’t widely known. A lot of early work in natural language processing (NLP) was funded by U.S. military intelligence agencies that needed machine translation and speech recognition capabilities.

August 30, 20233 min read
The Unlikely Roots of Large Language Models: U.S. military funding helped build the foundation for ChatGPT and other innovations in natural language processing.
Technical Insights

The Unlikely Roots of Large Language Models: U.S. military funding helped build the foundation for ChatGPT and other innovations in natural language processing.

I’d like to share a part of the origin story of large language models that isn’t widely known. A lot of early work in natural language processing (NLP) was funded by U.S. military intelligence agencies that needed machine translation and speech recognition capabilities.

August 30, 20233 min read
The Hidden Value of Deep Technical Knowledge: What's the best way to prompt a large language model? Understand the technology.
Technical Insights

The Hidden Value of Deep Technical Knowledge: What's the best way to prompt a large language model? Understand the technology.

Machine learning development is an empirical process. It’s hard to know in advance the result of a hyperparameter choice, dataset, or prompt to a large language model (LLM).

August 23, 20232 min read
The Hidden Value of Deep Technical Knowledge: What's the best way to prompt a large language model? Understand the technology.
Technical Insights

The Hidden Value of Deep Technical Knowledge: What's the best way to prompt a large language model? Understand the technology.

Machine learning development is an empirical process. It’s hard to know in advance the result of a hyperparameter choice, dataset, or prompt to a large language model (LLM).

August 23, 20232 min read
Tips for Taking Advantage of Open Large Language Models: Prompting? Few-Shot? Fine-Tuning? Pretraining from scratch? Open LLMs mean more options for developers.
Technical Insights

Tips for Taking Advantage of Open Large Language Models: Prompting? Few-Shot? Fine-Tuning? Pretraining from scratch? Open LLMs mean more options for developers.

An increasing variety of large language models (LLMs) are open source, or close to it. The proliferation of models with relatively permissive licenses gives developers more options for building applications.

August 16, 20233 min read
Tips for Taking Advantage of Open Large Language Models: Prompting? Few-Shot? Fine-Tuning? Pretraining from scratch? Open LLMs mean more options for developers.
Technical Insights

Tips for Taking Advantage of Open Large Language Models: Prompting? Few-Shot? Fine-Tuning? Pretraining from scratch? Open LLMs mean more options for developers.

An increasing variety of large language models (LLMs) are open source, or close to it. The proliferation of models with relatively permissive licenses gives developers more options for building applications.

August 16, 20233 min read
Does AI Understand the World?: There's no scientific test for understanding, but there is evidence that large language models understand the world to some extent.
Technical Insights

Does AI Understand the World?: There's no scientific test for understanding, but there is evidence that large language models understand the world to some extent.

Do large language models understand the world? As a scientist and engineer, I’ve avoided asking whether an AI system “understands” anything. There’s no widely agreed-upon, scientific test for whether a system really understands — as opposed to appearing to understand —

August 9, 20233 min read
Does AI Understand the World?: There's no scientific test for understanding, but there is evidence that large language models understand the world to some extent.
Technical Insights

Does AI Understand the World?: There's no scientific test for understanding, but there is evidence that large language models understand the world to some extent.

Do large language models understand the world? As a scientist and engineer, I’ve avoided asking whether an AI system “understands” anything. There’s no widely agreed-upon, scientific test for whether a system really understands — as opposed to appearing to understand —

August 9, 20233 min read
Building Machine Learning Systems is More Debugging Than Development: Traditional software development requires meticulous planning. With machine learning, it's better to jump right in.
Technical Insights

Building Machine Learning Systems is More Debugging Than Development: Traditional software development requires meticulous planning. With machine learning, it's better to jump right in.

Internalizing this mental framework has made me a more efficient machine learning engineer: Most of the work of building a machine learning system is debugging rather than development.

July 12, 20233 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox