Transforming Pixels: An image generation model using the GPT architecture
GPT-2

Transforming Pixels: An image generation model using the GPT architecture

Language models like Bert, Ernie, and Elmo have achieved spectacular results based on clever pre-training approaches. New research applies some of those Sesame Street lessons into image processing.

August 5, 20202 min read
AI’s Got Talent: The AI Song Contest replaced Eurovision during the pandemic.
GPT-2

AI’s Got Talent: The AI Song Contest replaced Eurovision during the pandemic.

Music that features a “singing” koala bear took the prize in one of Europe’s highest-profile AI competitions yet. A team of Australian programmers, designers, and musicians won the inaugural AI Song Contest with a koala-tinged track called “Beautiful the World.”

May 20, 20202 min read
AI’s Got Talent: The AI Song Contest replaced Eurovision during the pandemic.
GPT-2

AI’s Got Talent: The AI Song Contest replaced Eurovision during the pandemic.

Music that features a “singing” koala bear took the prize in one of Europe’s highest-profile AI competitions yet. A team of Australian programmers, designers, and musicians won the inaugural AI Song Contest with a koala-tinged track called “Beautiful the World.”

May 20, 20202 min read
OpenAI Under Fire: Critics claim OpenAI lost its founding ideals.
GPT-2

OpenAI Under Fire: Critics claim OpenAI lost its founding ideals.

An icon of idealism in AI stands accused of letting its ambition eclipse its principles. Founded in 2015 to develop artificial general intelligence for the good of humankind, OpenAI swapped its ideals for cash.

February 26, 20202 min read
OpenAI Under Fire: Critics claim OpenAI lost its founding ideals.
GPT-2

OpenAI Under Fire: Critics claim OpenAI lost its founding ideals.

An icon of idealism in AI stands accused of letting its ambition eclipse its principles. Founded in 2015 to develop artificial general intelligence for the good of humankind, OpenAI swapped its ideals for cash.

February 26, 20202 min read
Here Be Dragons: AI Dungeon 2 generated the script for a short movie.
GPT-2

Here Be Dragons: AI Dungeon 2 generated the script for a short movie.

AI is contributing to paintings, music, and now a whimsical fantasy video. The Squire is an amateur romp through a snowy realm of knights in armor and damsels in distress. The script was composed by AI Dungeon 2, an interactive text-adventure game based on the GPT-2 language model.

January 15, 20201 min read
Here Be Dragons: AI Dungeon 2 generated the script for a short movie.
GPT-2

Here Be Dragons: AI Dungeon 2 generated the script for a short movie.

AI is contributing to paintings, music, and now a whimsical fantasy video. The Squire is an amateur romp through a snowy realm of knights in armor and damsels in distress. The script was composed by AI Dungeon 2, an interactive text-adventure game based on the GPT-2 language model.

January 15, 20201 min read
Natural Language Processing Models Get Literate: Why 2019 was a breakthrough year for NLP
GPT-2

Natural Language Processing Models Get Literate: Why 2019 was a breakthrough year for NLP

Earlier language models powered by Word2Vec and GloVe embeddings yielded confused chatbots, grammar tools with middle-school reading comprehension, and not-half-bad translations. The latest generation is so good, some people consider it dangerous.

December 24, 20192 min read
Natural Language Processing Models Get Literate: Why 2019 was a breakthrough year for NLP
GPT-2

Natural Language Processing Models Get Literate: Why 2019 was a breakthrough year for NLP

Earlier language models powered by Word2Vec and GloVe embeddings yielded confused chatbots, grammar tools with middle-school reading comprehension, and not-half-bad translations. The latest generation is so good, some people consider it dangerous.

December 24, 20192 min read
Inside AI’s Muppet Empire: Why Are So Many NLP Models Named After Muppets?
GPT-2

Inside AI’s Muppet Empire: Why Are So Many NLP Models Named After Muppets?

As language models show increasing power, a parallel trend has received less notice: The vogue for naming models after characters in the children’s TV show Sesame Street.

December 18, 20191 min read
Inside AI’s Muppet Empire: Why Are So Many NLP Models Named After Muppets?
GPT-2

Inside AI’s Muppet Empire: Why Are So Many NLP Models Named After Muppets?

As language models show increasing power, a parallel trend has received less notice: The vogue for naming models after characters in the children’s TV show Sesame Street.

December 18, 20191 min read
Deepfakes Wreak Havoc
GPT-2

Deepfakes Wreak Havoc

Will AI fakery erode public trust in the key social institutions? Generative models will flood media outlets with convincing but false photos, videos, ads, and news stories. The ensuing crisis of authority will lead to widespread distrust in everything from the financial system to democracy itself.

October 30, 20192 min read
Deepfakes Wreak Havoc
GPT-2

Deepfakes Wreak Havoc

Will AI fakery erode public trust in the key social institutions? Generative models will flood media outlets with convincing but false photos, videos, ads, and news stories. The ensuing crisis of authority will lead to widespread distrust in everything from the financial system to democracy itself.

October 30, 20192 min read
Putting Text Generators on a Leash
GPT-2

Putting Text Generators on a Leash

Despite dramatic recent progress, natural language generation remains an iffy proposition. Even users of the muscular GPT-2 text generator have to press the button a number of times to get sensible output. But researchers are figuring out how to exert greater control over generated text.

October 2, 20192 min read
Putting Text Generators on a Leash
GPT-2

Putting Text Generators on a Leash

Despite dramatic recent progress, natural language generation remains an iffy proposition. Even users of the muscular GPT-2 text generator have to press the button a number of times to get sensible output. But researchers are figuring out how to exert greater control over generated text.

October 2, 20192 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox