
24 Hours on an Old Consumer GPU: Optimizing LLMs for low-resource hardware
BERT, a large language model released in 2018 and built upon the then-new transformer architecture, marked a paradigm shift in AI.

BERT, a large language model released in 2018 and built upon the then-new transformer architecture, marked a paradigm shift in AI.

BERT, a large language model released in 2018 and built upon the then-new transformer architecture, marked a paradigm shift in AI.

Nvidia’s latest chip promises to boost AI’s speed and energy efficiency.

Nvidia’s latest chip promises to boost AI’s speed and energy efficiency.

Huawei is emerging as an important supplier of AI chips. Amid a U.S. ban on exports of advanced chips to China, demand for Huawei’s AI chips is so intense that the company is limiting production of the chip that powers one of its most popular smartphones so it can serve the AI market.

Huawei is emerging as an important supplier of AI chips. Amid a U.S. ban on exports of advanced chips to China, demand for Huawei’s AI chips is so intense that the company is limiting production of the chip that powers one of its most popular smartphones so it can serve the AI market.

The AI boom is taxing power grids and pushing builders of data centers to rethink their sources of electricity.

The AI boom is taxing power grids and pushing builders of data centers to rethink their sources of electricity.

A new cloud-computing company promises to provide scarce AI processing power to startups and researchers. Voltage Park, a nonprofit north of Silicon Valley, will offer processing power from 24,000 top-of-the-line Nvidia H100 graphics processing units (GPUs)...

A new cloud-computing company promises to provide scarce AI processing power to startups and researchers. Voltage Park, a nonprofit north of Silicon Valley, will offer processing power from 24,000 top-of-the-line Nvidia H100 graphics processing units (GPUs)...

An upstart supplier of AI chips secured a major customer. Cerebras, which competes with Nvidia in hardware for training large models, signed a $100 million contract with Abu Dhabi tech conglomerate G42. The deal is the first part of a multi-stage plan to build a network of supercomputers.

An upstart supplier of AI chips secured a major customer. Cerebras, which competes with Nvidia in hardware for training large models, signed a $100 million contract with Abu Dhabi tech conglomerate G42. The deal is the first part of a multi-stage plan to build a network of supercomputers.

Nvidia’s top-of-the-line chips are in high demand and short supply. There aren’t enough H100 graphics processing units (GPUs) to meet the crush of demand brought on by the vogue for generative AI, VentureBeat reported.

Nvidia’s top-of-the-line chips are in high demand and short supply. There aren’t enough H100 graphics processing units (GPUs) to meet the crush of demand brought on by the vogue for generative AI, VentureBeat reported.

Chinese companies have found loopholes to sidestep United States limits on AI chips. Facing severe limits on U.S. exports of high-performance chips, Chinese AI firms are purchasing them through subsidiaries and using them through cloud services, the Financial Times reported.
Stay updated with weekly AI News and Insights delivered to your inbox