
Streamlined Inference: Deja Vu, a method that boosts LLM speed by activating only essential neural parts
It’s not necessary to activate all parts of a large language model to process a given input. Using only the necessary parts saves processing.

It’s not necessary to activate all parts of a large language model to process a given input. Using only the necessary parts saves processing.

It’s not necessary to activate all parts of a large language model to process a given input. Using only the necessary parts saves processing.

Researchers used an AI system to identify animal cell types from gene sequences, including a cell type that conventional approaches had discovered only in the past year.

Researchers used an AI system to identify animal cell types from gene sequences, including a cell type that conventional approaches had discovered only in the past year.

Pruning weights from a neural network makes it smaller and faster, but it can take a lot of computation to choose weights that can be removed without degrading the network’s performance.

Pruning weights from a neural network makes it smaller and faster, but it can take a lot of computation to choose weights that can be removed without degrading the network’s performance.

A neural network detected early signs of pancreatic cancer more effectively than doctors who used the usual risk-assessment criteria. Researchers at MIT and oncologists at Beth Israel Medical Center in Boston...

A neural network detected early signs of pancreatic cancer more effectively than doctors who used the usual risk-assessment criteria. Researchers at MIT and oncologists at Beth Israel Medical Center in Boston...

A neural network makes music for unaccompanied vocal tracks. Chris Donahue, Antoine Caillon, Adam Roberts, and colleagues at Google proposed SingSong, a system that generates musical accompaniments for sung melodies. You can listen to its output here.

A neural network makes music for unaccompanied vocal tracks. Chris Donahue, Antoine Caillon, Adam Roberts, and colleagues at Google proposed SingSong, a system that generates musical accompaniments for sung melodies. You can listen to its output here.

Biologists used neural networks to find a new class of antibiotics. Researchers at MIT and Harvard trained models to screen chemical compounds for those that kill methicillin-resistant Staphylococcus aureus (MRSA), the deadliest among bacteria that have...

Biologists used neural networks to find a new class of antibiotics. Researchers at MIT and Harvard trained models to screen chemical compounds for those that kill methicillin-resistant Staphylococcus aureus (MRSA), the deadliest among bacteria that have...

Online sorting algorithms run trillions of times a day to organize lists according to users’ interests. New work found faster alternatives. Daniel J. Mankowitz and colleagues at Google developed AlphaDev, a system that learned to generate algorithms that sort three...

Online sorting algorithms run trillions of times a day to organize lists according to users’ interests. New work found faster alternatives. Daniel J. Mankowitz and colleagues at Google developed AlphaDev, a system that learned to generate algorithms that sort three...

A neural network helped brain surgeons decide how much healthy tissue to cut out when removing tumors — while the patients were on the operating table.
Stay updated with weekly AI News and Insights delivered to your inbox