Transformer
A Transformer Alternative Emerges: Mamba, a new approach that may outperform transformers
An architectural innovation improves upon transformers — up to 2 billion parameters, at least...
Transformer
292 Posts
Transformer
A Transformer Alternative Emerges: Mamba, a new approach that may outperform transformers
An architectural innovation improves upon transformers — up to 2 billion parameters, at least...
Transformer
Nvidia Revs AI Engine: All about Nvidia’s new Blackwell architecture and B200 GPU
Nvidia’s latest chip promises to boost AI’s speed and energy efficiency.
Transformer
Nvidia Revs AI Engine: All about Nvidia’s new Blackwell architecture and B200 GPU
Nvidia’s latest chip promises to boost AI’s speed and energy efficiency.
Transformer
Ancient Scrolls Recovered: Researchers decipher scrolls charred by Mount Vesuvius using AI
Three researchers decoded scrolls that had gone unread since they were turned into charcoal by the eruption of Mount Vesuvius in the year 79.
Transformer
Ancient Scrolls Recovered: Researchers decipher scrolls charred by Mount Vesuvius using AI
Three researchers decoded scrolls that had gone unread since they were turned into charcoal by the eruption of Mount Vesuvius in the year 79.
Transformer
Sing a Tune, Generate an Accompaniment: SingSong, a tool that generates instrumental music for unaccompanied input vocals
A neural network makes music for unaccompanied vocal tracks. Chris Donahue, Antoine Caillon, Adam Roberts, and colleagues at Google proposed SingSong, a system that generates musical accompaniments for sung melodies. You can listen to its output here.
Transformer
Sing a Tune, Generate an Accompaniment: SingSong, a tool that generates instrumental music for unaccompanied input vocals
A neural network makes music for unaccompanied vocal tracks. Chris Donahue, Antoine Caillon, Adam Roberts, and colleagues at Google proposed SingSong, a system that generates musical accompaniments for sung melodies. You can listen to its output here.
Transformer
Google’s Multimodal Challenger: All you need to know about Gemini, Google's new multimodal model
Google unveiled Gemini, its bid to catch up to, and perhaps surpass, OpenAI’s GPT-4. Google demonstrated the Gemini family of models that accept any combination of text (including code), images, video, and audio and output text and images. The demonstrations and metrics were impressive...
Transformer
Google’s Multimodal Challenger: All you need to know about Gemini, Google's new multimodal model
Google unveiled Gemini, its bid to catch up to, and perhaps surpass, OpenAI’s GPT-4. Google demonstrated the Gemini family of models that accept any combination of text (including code), images, video, and audio and output text and images. The demonstrations and metrics were impressive...
Transformer
Robot, Find My Keys: A machine learning model for robots to predict the location of objects in households
Researchers proposed a way for robots to find objects in households where things get moved around. Andrey Kurenkov and colleagues at Stanford University introduced Node Edge Predictor, a model that learned to predict where objects were located in houses.
Transformer
Robot, Find My Keys: A machine learning model for robots to predict the location of objects in households
Researchers proposed a way for robots to find objects in households where things get moved around. Andrey Kurenkov and colleagues at Stanford University introduced Node Edge Predictor, a model that learned to predict where objects were located in houses.
Transformer
Taming Transformers: Researchers find new strategies to accelerate transformer architecture.
The transformer architecture is astonishingly powerful but notoriously slow. Researchers have developed numerous tweaks to accelerate it — enough to warrant a look at how these alternatives work, their strengths, and their weaknesses.
Transformer
Taming Transformers: Researchers find new strategies to accelerate transformer architecture.
The transformer architecture is astonishingly powerful but notoriously slow. Researchers have developed numerous tweaks to accelerate it — enough to warrant a look at how these alternatives work, their strengths, and their weaknesses.
Transformer
Masked Pretraining for CNNs: ConvNeXt V2, the new model family that boosts ConvNet performance
Vision transformers have bested convolutional neural networks (CNNs) in a number of key vision tasks. Have CNNs hit their limit? New research suggests otherwise.
Subscribe to The Batch
Stay updated with weekly AI News and Insights delivered to your inbox