Programmer’s Best Friend: Code generation services took off in 2022.
Language

Programmer’s Best Friend: Code generation services took off in 2022.

Behind schedule on a software project? There’s an app for that. Language models fine-tuned on computer code proved capable of generating software routines similar to the work of experienced developers — though the results can be hit-or-miss.

December 21, 20221 min read
Memorize Less; Retrieve More: How small language models can perform specialized tasks.
Language

Memorize Less; Retrieve More: How small language models can perform specialized tasks.

Large language models are trained only to predict the next word based on previous ones. Yet, given a modest fine-tuning set, they acquire enough information to learn how to perform tasks such as answering questions.

December 14, 20223 min read
Memorize Less; Retrieve More: How small language models can perform specialized tasks.
Language

Memorize Less; Retrieve More: How small language models can perform specialized tasks.

Large language models are trained only to predict the next word based on previous ones. Yet, given a modest fine-tuning set, they acquire enough information to learn how to perform tasks such as answering questions.

December 14, 20223 min read
How Alexa Says Goodnight: Amazon Echo uses generative AI to create bedtime stories.
Language

How Alexa Says Goodnight: Amazon Echo uses generative AI to create bedtime stories.

Too exhausted (or unimaginative) to tell your child a bedtime story? Amazon’s smart displays can spin bespoke tales on demand. A feature called Create with Alexa generates children’s stories complete with illustrations, music, and sound effects on the Amazon Echo Show device.

December 7, 20221 min read
How Alexa Says Goodnight: Amazon Echo uses generative AI to create bedtime stories.
Language

How Alexa Says Goodnight: Amazon Echo uses generative AI to create bedtime stories.

Too exhausted (or unimaginative) to tell your child a bedtime story? Amazon’s smart displays can spin bespoke tales on demand. A feature called Create with Alexa generates children’s stories complete with illustrations, music, and sound effects on the Amazon Echo Show device.

December 7, 20221 min read
More Plausible Text, Familiar Failings: ChatGPT hasn’t overcome the weaknesses of other large language models
Language

More Plausible Text, Familiar Failings: ChatGPT hasn’t overcome the weaknesses of other large language models

Members of the AI community tested the limits of the ChatGPT chatbot, unleashing an avalanche of tweets that made for sometimes-great, sometimes-troubling entertainment.

December 7, 20223 min read
More Plausible Text, Familiar Failings: ChatGPT hasn’t overcome the weaknesses of other large language models
Language

More Plausible Text, Familiar Failings: ChatGPT hasn’t overcome the weaknesses of other large language models

Members of the AI community tested the limits of the ChatGPT chatbot, unleashing an avalanche of tweets that made for sometimes-great, sometimes-troubling entertainment.

December 7, 20223 min read
Translating a Mostly Oral Language: How Meta Trained an NLP Model to Translate Hokkein
Language

Translating a Mostly Oral Language: How Meta Trained an NLP Model to Translate Hokkein

Most speech-to-speech translation systems use text as an intermediate mode. So how do you build an automated translator for a language that has no standard written form? A new approach trained neural networks to translate a primarily oral language.

November 30, 20223 min read
Translating a Mostly Oral Language: How Meta Trained an NLP Model to Translate Hokkein
Language

Translating a Mostly Oral Language: How Meta Trained an NLP Model to Translate Hokkein

Most speech-to-speech translation systems use text as an intermediate mode. So how do you build an automated translator for a language that has no standard written form? A new approach trained neural networks to translate a primarily oral language.

November 30, 20223 min read
Built to Scale: Andromeda Supercomputer from Cerebras Speeds up AI
Language

Built to Scale: Andromeda Supercomputer from Cerebras Speeds up AI

A new computing cluster delivers more bang per chip. Cerebras unveiled Andromeda, a supercomputer based on its processors. Unlike conventional clusters, the system’s processing speed rises linearly with additional processors.

November 23, 20222 min read
Built to Scale: Andromeda Supercomputer from Cerebras Speeds up AI
Language

Built to Scale: Andromeda Supercomputer from Cerebras Speeds up AI

A new computing cluster delivers more bang per chip. Cerebras unveiled Andromeda, a supercomputer based on its processors. Unlike conventional clusters, the system’s processing speed rises linearly with additional processors.

November 23, 20222 min read
Right-Sizing Models for the Dataset: Finding the Best Data-To-Parameter Ratio for NLP Models
Language

Right-Sizing Models for the Dataset: Finding the Best Data-To-Parameter Ratio for NLP Models

The route to improving transformer-based language models like GPT-3 and Gopher, which are trained on immense quantities of text scraped from the web, has been to increase their size. But research shows that, given a processing budget, bigger doesn’t necessarily mean better.

November 9, 20222 min read
Right-Sizing Models for the Dataset: Finding the Best Data-To-Parameter Ratio for NLP Models
Language

Right-Sizing Models for the Dataset: Finding the Best Data-To-Parameter Ratio for NLP Models

The route to improving transformer-based language models like GPT-3 and Gopher, which are trained on immense quantities of text scraped from the web, has been to increase their size. But research shows that, given a processing budget, bigger doesn’t necessarily mean better.

November 9, 20222 min read
When Safety Becomes Surveillance: Colleges Track Students Using AI Designed to Monitor Mental Health
Language

When Safety Becomes Surveillance: Colleges Track Students Using AI Designed to Monitor Mental Health

United States colleges tracked activists using a natural language processing system intended to monitor their mental health.

November 9, 20222 min read
When Safety Becomes Surveillance: Colleges Track Students Using AI Designed to Monitor Mental Health
Language

When Safety Becomes Surveillance: Colleges Track Students Using AI Designed to Monitor Mental Health

United States colleges tracked activists using a natural language processing system intended to monitor their mental health.

November 9, 20222 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox