Where Is Meta’s Generative Play?: Why Meta still lacks a flagship generative AI service
Meta

Where Is Meta’s Generative Play?: Why Meta still lacks a flagship generative AI service

While Microsoft and Google scramble to supercharge their businesses with text generation, Meta has yet to launch a flagship generative AI service. Reporters went looking for reasons why.

June 28, 20232 min read
Collaborative Text Generator: A language model that collaborates with human writers
Meta

Collaborative Text Generator: A language model that collaborates with human writers

Text from current language models can be useful as a rough draft, but that leaves the polishing to human writers. A language model learned how to generate and respond to editorial directions.

April 5, 20233 min read
Collaborative Text Generator: A language model that collaborates with human writers
Meta

Collaborative Text Generator: A language model that collaborates with human writers

Text from current language models can be useful as a rough draft, but that leaves the polishing to human writers. A language model learned how to generate and respond to editorial directions.

April 5, 20233 min read
Runaway LLaMA: How Meta's LLaMA NLP model leaked
Meta

Runaway LLaMA: How Meta's LLaMA NLP model leaked

Meta’s effort to make a large language model available to researchers ended with its escape into the wild. Soon after Meta started accepting applications for developer access to LLaMA, a family of trained large language models...

March 15, 20232 min read
Runaway LLaMA: How Meta's LLaMA NLP model leaked
Meta

Runaway LLaMA: How Meta's LLaMA NLP model leaked

Meta’s effort to make a large language model available to researchers ended with its escape into the wild. Soon after Meta started accepting applications for developer access to LLaMA, a family of trained large language models...

March 15, 20232 min read
Streamlined Robot Training: Robots trained in lo-fi simulation perform better in reality.
Meta

Streamlined Robot Training: Robots trained in lo-fi simulation perform better in reality.

Autonomous robots trained to navigate in a simulation often struggle in the real world. New work helps bridge the gap in a counterintuitive way.

February 22, 20232 min read
Streamlined Robot Training: Robots trained in lo-fi simulation perform better in reality.
Meta

Streamlined Robot Training: Robots trained in lo-fi simulation perform better in reality.

Autonomous robots trained to navigate in a simulation often struggle in the real world. New work helps bridge the gap in a counterintuitive way.

February 22, 20232 min read
Unsupervised Data Pruning: New method removes useless machine learning data.
Meta

Unsupervised Data Pruning: New method removes useless machine learning data.

Large datasets often contain overly similar examples that consume training cycles without contributing to learning. A new paper identifies similar training examples, even if they’re not labeled.

February 15, 20232 min read
Unsupervised Data Pruning: New method removes useless machine learning data.
Meta

Unsupervised Data Pruning: New method removes useless machine learning data.

Large datasets often contain overly similar examples that consume training cycles without contributing to learning. A new paper identifies similar training examples, even if they’re not labeled.

February 15, 20232 min read
Language Models Defy Logic: Large NLP models struggle with logical reasoning.
Meta

Language Models Defy Logic: Large NLP models struggle with logical reasoning.

Who would disagree that, if all people are mortal and Socrates is a person, Socrates must be mortal? GPT-3, for one. Recent work shows that bigger language models are not necessarily better when it comes to logical reasoning.

February 1, 20232 min read
Language Models Defy Logic: Large NLP models struggle with logical reasoning.
Meta

Language Models Defy Logic: Large NLP models struggle with logical reasoning.

Who would disagree that, if all people are mortal and Socrates is a person, Socrates must be mortal? GPT-3, for one. Recent work shows that bigger language models are not necessarily better when it comes to logical reasoning.

February 1, 20232 min read
Alon Halevy: Facebook AI director Alon Halevy envisions your personal data timeline
Meta

Alon Halevy: Facebook AI director Alon Halevy envisions your personal data timeline

The important question of how companies and organizations use our data has received a lot of attention in the technology and policy communities. An equally important question that deserves more focus in 2023 is how...

December 28, 20222 min read
Alon Halevy: Facebook AI director Alon Halevy envisions your personal data timeline
Meta

Alon Halevy: Facebook AI director Alon Halevy envisions your personal data timeline

The important question of how companies and organizations use our data has received a lot of attention in the technology and policy communities. An equally important question that deserves more focus in 2023 is how...

December 28, 20222 min read
Memorize Less; Retrieve More: How small language models can perform specialized tasks.
Meta

Memorize Less; Retrieve More: How small language models can perform specialized tasks.

Large language models are trained only to predict the next word based on previous ones. Yet, given a modest fine-tuning set, they acquire enough information to learn how to perform tasks such as answering questions.

December 14, 20223 min read
Memorize Less; Retrieve More: How small language models can perform specialized tasks.
Meta

Memorize Less; Retrieve More: How small language models can perform specialized tasks.

Large language models are trained only to predict the next word based on previous ones. Yet, given a modest fine-tuning set, they acquire enough information to learn how to perform tasks such as answering questions.

December 14, 20223 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox