The Batch: Special Issue! Foundational Algorithms, Where They Came From, Where They're Going
Natural Language Processing

The Batch: Special Issue! Foundational Algorithms, Where They Came From, Where They're Going

Years ago, I had to choose between a neural network and a decision tree learning algorithm. It was necessary to pick an efficient one, because we planned to apply the algorithm to a very large set of users on a limited compute budget.

May 25, 202217 min read
Decision Trees: From Root to Leaves — Decision Trees for Machine Learning Explained
Natural Language Processing

Decision Trees: From Root to Leaves — Decision Trees for Machine Learning Explained

What kind of beast was Aristotle? The philosopher's follower Porphyry, who lived in Syria during the third century, came up with a logical way to answer the question...

May 25, 20223 min read
Decision Trees: From Root to Leaves — Decision Trees for Machine Learning Explained
Natural Language Processing

Decision Trees: From Root to Leaves — Decision Trees for Machine Learning Explained

What kind of beast was Aristotle? The philosopher's follower Porphyry, who lived in Syria during the third century, came up with a logical way to answer the question...

May 25, 20223 min read
Neural Networks: Find the Function — A Basic Introduction to Neural Networks
Natural Language Processing

Neural Networks: Find the Function — A Basic Introduction to Neural Networks

Let’s get this out of the way: A brain is not a cluster of graphics processing units, and if it were, it would run software far more complex than the typical artificial neural network. Yet neural networks were inspired by the brain’s architecture.

May 25, 20223 min read
Neural Networks: Find the Function — A Basic Introduction to Neural Networks
Natural Language Processing

Neural Networks: Find the Function — A Basic Introduction to Neural Networks

Let’s get this out of the way: A brain is not a cluster of graphics processing units, and if it were, it would run software far more complex than the typical artificial neural network. Yet neural networks were inspired by the brain’s architecture.

May 25, 20223 min read
Logistic Regression: Follow the Curve — A Basic Introduction to Logistic Regression for Machine Learning
Natural Language Processing

Logistic Regression: Follow the Curve — A Basic Introduction to Logistic Regression for Machine Learning

There was a moment when logistic regression was used to classify just one thing: If you drink a vial of poison, are you likely to be labeled “living” or “deceased”? Times have changed.

May 25, 20222 min read
Logistic Regression: Follow the Curve — A Basic Introduction to Logistic Regression for Machine Learning
Natural Language Processing

Logistic Regression: Follow the Curve — A Basic Introduction to Logistic Regression for Machine Learning

There was a moment when logistic regression was used to classify just one thing: If you drink a vial of poison, are you likely to be labeled “living” or “deceased”? Times have changed.

May 25, 20222 min read
GPT-Free: Meta Releases Open Source Large Language Models OPT
Natural Language Processing

GPT-Free: Meta Releases Open Source Large Language Models OPT

Itching to get your hands on a fully trained large language model? The wait is over. Meta introduced the OPT family of transformer-based language models with nearly unfettered access to source code and trained weights.

May 11, 20222 min read
GPT-Free: Meta Releases Open Source Large Language Models OPT
Natural Language Processing

GPT-Free: Meta Releases Open Source Large Language Models OPT

Itching to get your hands on a fully trained large language model? The wait is over. Meta introduced the OPT family of transformer-based language models with nearly unfettered access to source code and trained weights.

May 11, 20222 min read
Less Data for Vision Transformers: Boosting Vision Transformer Performance with Less Data
Natural Language Processing

Less Data for Vision Transformers: Boosting Vision Transformer Performance with Less Data

Vision Transformer (ViT) outperformed convolutional neural networks in image classification, but it required more training data. New work enabled ViT and its variants to outperform other architectures with less training data.

May 4, 20222 min read
Less Data for Vision Transformers: Boosting Vision Transformer Performance with Less Data
Natural Language Processing

Less Data for Vision Transformers: Boosting Vision Transformer Performance with Less Data

Vision Transformer (ViT) outperformed convolutional neural networks in image classification, but it required more training data. New work enabled ViT and its variants to outperform other architectures with less training data.

May 4, 20222 min read
Efficiency Experts: Mixture of Experts Makes Language Models More Efficient
Natural Language Processing

Efficiency Experts: Mixture of Experts Makes Language Models More Efficient

The emerging generation of trillion-parameter language models take significant computation to train. Activating only a portion of the network at a time can cut the requirement dramatically and still achieve exceptional results.

April 27, 20223 min read
Efficiency Experts: Mixture of Experts Makes Language Models More Efficient
Natural Language Processing

Efficiency Experts: Mixture of Experts Makes Language Models More Efficient

The emerging generation of trillion-parameter language models take significant computation to train. Activating only a portion of the network at a time can cut the requirement dramatically and still achieve exceptional results.

April 27, 20223 min read
Neural Nets + Rules = Truer Text: Jurassic-X can answer questions, check facts, solve math, and more
Natural Language Processing

Neural Nets + Rules = Truer Text: Jurassic-X can answer questions, check facts, solve math, and more

A new approach aims to cure text generators of their tendency to produce nonsense. AI21 Labs launched Jurassic-X, a natural language processing system that combines neural networks and rule-based programs.

April 20, 20222 min read
Neural Nets + Rules = Truer Text: Jurassic-X can answer questions, check facts, solve math, and more
Natural Language Processing

Neural Nets + Rules = Truer Text: Jurassic-X can answer questions, check facts, solve math, and more

A new approach aims to cure text generators of their tendency to produce nonsense. AI21 Labs launched Jurassic-X, a natural language processing system that combines neural networks and rule-based programs.

April 20, 20222 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox