NVIDIA is on the verge of launching its next-generation AI semiconductor 'Blackwell,' bringing renewed attention to low-power DRAM

 

 

 

Previously used mainly in mobile products, low-power DRAM is now expected to play a crucial role in the AI semiconductor field.

NVIDIA will begin mass production of the "GB200 Grace Blackwell Superchip" in the second half of this year.

This superchip consists of one NVIDIA Grace CPU (Central Processing Unit) and two Blackwell GPUs (Graphics Processing Units).

Notably, the Blackwell GPU is the next-generation AI semiconductor that will replace the existing "Hopper (H100)" chip, featuring 16 High-Bandwidth Memory (HBM) modules to significantly enhance AI computing performance.

The Grace CPU is closely integrated with the Blackwell GPU to double computing power and is specialized in reducing power consumption.

This CPU is equipped with 16 seventh-generation low-power DRAM "LPDDR5X" modules, which require only one-eighth of the power per gigabyte compared to standard DDR5.

Thanks to this power efficiency, the Grace CPU delivers outstanding performance.

NVIDIA CEO Jensen Huang recently emphasized, "As generative AI advances, the importance of memory grows," and noted, "The LPDDR memory used in the Grace CPU can save a lot of power."

Due to the excellent power efficiency of low-power DRAM, the Grace CPU is already known for its high energy efficiency. According to Supercomputing data, many of the top-ranked systems in the Green500 list use NVIDIA's Grace CPU.

The energy consumption and heat generation issues of data centers are often cited as causes of global warming.

Therefore, low-power semiconductors have emerged as a critical issue for data centers, and the GB200 superchip equipped with the Grace CPU is being highlighted as a solution.

The GB200 superchip is produced by Taiwan's supply chain, including the world's top foundry TSMC, and is currently recording high demand.

Low-power DRAM is also essential in the on-device AI field, such as AI smartphones and AI PCs. According to TrendForce, despite concerns about oversupply, the low-power DRAM market is expected to grow by 3-8% in the third quarter of this year.

Apple has recently made its generative AI service "Apple Intelligence" available only on iPhone 15 Pro and Pro Max devices, and the upcoming iPhone 16 series is expected to feature 8GB LPDDR5X.

Additionally, PC manufacturers are actively considering the use of low-power memory for generative AI services.

Currently, DRAM companies have started commercializing LPCAMM2, a new memory form that bundles LPDDR packages into one.

LPCAMM2 reduces the mounting area by 60% compared to existing products while consuming even less power.

출처 : 산경투데이(https://www.sankyungtoday.com)

 

 

https://www.sankyungtoday.com/news/articleView.html?idxno=46919

NVIDIA is on the verge of launching its next-generation AI semiconductor 'Blackwell,' bringing renewed attention to low-power DR