24 Hours on an Old Consumer GPU: Optimizing LLMs for low-resource hardware
Machine Learning Research

24 Hours on an Old Consumer GPU: Optimizing LLMs for low-resource hardware

BERT, a large language model released in 2018 and built upon the then-new transformer architecture, marked a paradigm shift in AI.

July 2, 20242 min read
Benchmarks for Agentic Behaviors: New LLM benchmarks for Tool Use and Planning in workplace tasks
Machine Learning Research

Benchmarks for Agentic Behaviors: New LLM benchmarks for Tool Use and Planning in workplace tasks

Tool use and planning are key behaviors in agentic workflows that enable large language models (LLMs) to execute complex sequences of steps. New benchmarks measure these capabilities in common workplace tasks. 

June 26, 20243 min read
Benchmarks for Agentic Behaviors: New LLM benchmarks for Tool Use and Planning in workplace tasks
Machine Learning Research

Benchmarks for Agentic Behaviors: New LLM benchmarks for Tool Use and Planning in workplace tasks

Tool use and planning are key behaviors in agentic workflows that enable large language models (LLMs) to execute complex sequences of steps. New benchmarks measure these capabilities in common workplace tasks. 

June 26, 20243 min read
For Faster Diffusion, Think a GAN: Adversarial Diffusion Distillation, a method to accelerate diffusion models
Machine Learning Research

For Faster Diffusion, Think a GAN: Adversarial Diffusion Distillation, a method to accelerate diffusion models

Generative adversarial networks (GANs) produce images quickly, but they’re of relatively low quality. Diffusion image generators typically take more time, but they produce higher-quality output. Researchers aimed to achieve the best of both worlds.

June 19, 20242 min read
For Faster Diffusion, Think a GAN: Adversarial Diffusion Distillation, a method to accelerate diffusion models
Machine Learning Research

For Faster Diffusion, Think a GAN: Adversarial Diffusion Distillation, a method to accelerate diffusion models

Generative adversarial networks (GANs) produce images quickly, but they’re of relatively low quality. Diffusion image generators typically take more time, but they produce higher-quality output. Researchers aimed to achieve the best of both worlds.

June 19, 20242 min read
More New Open Models: New models from Nvidia, Alibaba, and Stability AI expand open options
Machine Learning Research

More New Open Models: New models from Nvidia, Alibaba, and Stability AI expand open options

A trio of powerful open and semi-open models give developers new options for both text and image generation. 

June 19, 20242 min read
More New Open Models: New models from Nvidia, Alibaba, and Stability AI expand open options
Machine Learning Research

More New Open Models: New models from Nvidia, Alibaba, and Stability AI expand open options

A trio of powerful open and semi-open models give developers new options for both text and image generation. 

June 19, 20242 min read
The LLM Will See You Now: AMIE, a chatbot that outperforms doctors in diagnostic conversations
Machine Learning Research

The LLM Will See You Now: AMIE, a chatbot that outperforms doctors in diagnostic conversations

A critical step in diagnosing illnesses is a conversation between doctor and patient to assemble a medical history, discuss approaches to managing symptoms, and so on.

June 12, 20243 min read
The LLM Will See You Now: AMIE, a chatbot that outperforms doctors in diagnostic conversations
Machine Learning Research

The LLM Will See You Now: AMIE, a chatbot that outperforms doctors in diagnostic conversations

A critical step in diagnosing illnesses is a conversation between doctor and patient to assemble a medical history, discuss approaches to managing symptoms, and so on.

June 12, 20243 min read
Audio Generation Clear of Copyrights: Stability AI releases enhanced text-to-audio generator Stable Audio Open
Machine Learning Research

Audio Generation Clear of Copyrights: Stability AI releases enhanced text-to-audio generator Stable Audio Open

Sonically minded developers gained a high-profile text-to-audio generator. 

June 12, 20242 min read
Audio Generation Clear of Copyrights: Stability AI releases enhanced text-to-audio generator Stable Audio Open
Machine Learning Research

Audio Generation Clear of Copyrights: Stability AI releases enhanced text-to-audio generator Stable Audio Open

Sonically minded developers gained a high-profile text-to-audio generator. 

June 12, 20242 min read
Better Teachers Make Better Students: Microsoft‘s Orca 2 strengthens the native reasoning abilities of smaller models
Machine Learning Research

Better Teachers Make Better Students: Microsoft‘s Orca 2 strengthens the native reasoning abilities of smaller models

A relatively small student LLM that learns to mimic a larger teacher model can perform nearly as well as the teacher while using much less computation. It can come even closer if the teacher also teaches reasoning techniques.

June 5, 20243 min read
Better Teachers Make Better Students: Microsoft‘s Orca 2 strengthens the native reasoning abilities of smaller models
Machine Learning Research

Better Teachers Make Better Students: Microsoft‘s Orca 2 strengthens the native reasoning abilities of smaller models

A relatively small student LLM that learns to mimic a larger teacher model can perform nearly as well as the teacher while using much less computation. It can come even closer if the teacher also teaches reasoning techniques.

June 5, 20243 min read
Richer Context for RAG: RAPTOR, a recursive summarizer, captures more relevant context for LLM inputs
Machine Learning Research

Richer Context for RAG: RAPTOR, a recursive summarizer, captures more relevant context for LLM inputs

Text excerpts used in retrieval augmented generation (RAG) tend to be short. Researchers used summarization to pack more relevant context into the same amount of text.

May 29, 20242 min read
Richer Context for RAG: RAPTOR, a recursive summarizer, captures more relevant context for LLM inputs
Machine Learning Research

Richer Context for RAG: RAPTOR, a recursive summarizer, captures more relevant context for LLM inputs

Text excerpts used in retrieval augmented generation (RAG) tend to be short. Researchers used summarization to pack more relevant context into the same amount of text.

May 29, 20242 min read

Subscribe to The Batch

Stay updated with weekly AI News and Insights delivered to your inbox