Choose the Right Point On the Automation Spectrum
Technical Insights

Choose the Right Point On the Automation Spectrum

AI-enabled automation is often portrayed as a binary on-or-off: A process is either automated or not. But in practice, automation is a spectrum, and AI teams have to choose where on this spectrum to operate.

February 24, 20212 min read
A Different Approach to A/B Testing
Technical Insights

A Different Approach to A/B Testing

When a lot of data is available, machine learning is great at automating decisions. But when data is scarce, consider using the data to augment human insight, so people can make better decisions.

February 17, 20212 min read
A Different Approach to A/B Testing
Technical Insights

A Different Approach to A/B Testing

When a lot of data is available, machine learning is great at automating decisions. But when data is scarce, consider using the data to augment human insight, so people can make better decisions.

February 17, 20212 min read
High Test-Set Accuracy Is Not Enough
Technical Insights

High Test-Set Accuracy Is Not Enough

Over the last several decades, driven by a multitude of benchmarks, supervised learning algorithms have become really good at achieving high accuracy on test datasets. As valuable as this is, unfortunately maximizing average test set accuracy isn’t always enough.

February 10, 20212 min read
High Test-Set Accuracy Is Not Enough
Technical Insights

High Test-Set Accuracy Is Not Enough

Over the last several decades, driven by a multitude of benchmarks, supervised learning algorithms have become really good at achieving high accuracy on test datasets. As valuable as this is, unfortunately maximizing average test set accuracy isn’t always enough.

February 10, 20212 min read
Don't Confuse Proof of Concept With Production Deployment
Technical Insights

Don't Confuse Proof of Concept With Production Deployment

Last week, I talked about how best practices for machine learning projects are not one-size-fits-all, and how they vary depending on whether a project uses structured or unstructured data, and whether the dataset is small or big.

January 27, 20212 min read
Don't Confuse Proof of Concept With Production Deployment
Technical Insights

Don't Confuse Proof of Concept With Production Deployment

Last week, I talked about how best practices for machine learning projects are not one-size-fits-all, and how they vary depending on whether a project uses structured or unstructured data, and whether the dataset is small or big.

January 27, 20212 min read
Structured and Unstructured Data: Implications for AI Development
Technical Insights

Structured and Unstructured Data: Implications for AI Development

Experience gained in building a model to solve one problem doesn’t always transfer to building models for other problems. How can you tell whether or not intuitions honed in one project are likely to generalize to another?

January 20, 20212 min read
Structured and Unstructured Data: Implications for AI Development
Technical Insights

Structured and Unstructured Data: Implications for AI Development

Experience gained in building a model to solve one problem doesn’t always transfer to building models for other problems. How can you tell whether or not intuitions honed in one project are likely to generalize to another?

January 20, 20212 min read
Data-Centric AI Development: Small-Data Problems
Technical Insights

Data-Centric AI Development: Small-Data Problems

Over the last two weeks, I described the importance of clean, consistent labels and how to use human-level performance (HLP) to trigger a review of whether labeling instructions need to be reviewed.

November 25, 20202 min read
Data-Centric AI Development: Small-Data Problems
Technical Insights

Data-Centric AI Development: Small-Data Problems

Over the last two weeks, I described the importance of clean, consistent labels and how to use human-level performance (HLP) to trigger a review of whether labeling instructions need to be reviewed.

November 25, 20202 min read
AI Versus Human-Level Performance, Part 2
Technical Insights

AI Versus Human-Level Performance, Part 2

Last week, I wrote about the limitation of using human-level performance (HLP) as a metric to beat in machine learning applications for manufacturing and other fields. In this letter, I would like to show why beating HLP isn’t always the best way to improve performance.

November 18, 20202 min read
AI Versus Human-Level Performance, Part 2
Technical Insights

AI Versus Human-Level Performance, Part 2

Last week, I wrote about the limitation of using human-level performance (HLP) as a metric to beat in machine learning applications for manufacturing and other fields. In this letter, I would like to show why beating HLP isn’t always the best way to improve performance.

November 18, 20202 min read
AI Versus Human-Level Performance
Technical Insights

AI Versus Human-Level Performance

Beating human-level performance (HLP) has been a goal of academic research in machine learning from speech recognition to X-ray diagnosis. When your model outperforms humans, you can argue that you’ve reached a significant milestone and publish a paper!

November 11, 20202 min read
AI Versus Human-Level Performance
Technical Insights

AI Versus Human-Level Performance

Beating human-level performance (HLP) has been a goal of academic research in machine learning from speech recognition to X-ray diagnosis. When your model outperforms humans, you can argue that you’ve reached a significant milestone and publish a paper!

November 11, 20202 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox