Updated
Updated · The Motley Fool · Jun 21
Nvidia Blackwell Lifts AI Chip Memory to 192 GB as HBM Demand Outpaces GPU Unit Focus
Updated
Updated · The Motley Fool · Jun 21

Nvidia Blackwell Lifts AI Chip Memory to 192 GB as HBM Demand Outpaces GPU Unit Focus

3 articles · Updated · The Motley Fool · Jun 21

Summary

  • 192 GB of high-bandwidth memory in Nvidia's latest Blackwell chips marks another sharp jump in AI memory density, up from about 141 GB in H200 and 80 GB in H100.
  • That rise reflects how larger AI models, reasoning workloads and multimodal systems handling text, images, audio and video need more data available at once.
  • For Micron, the shift suggests growth may depend less on how many AI servers ship and more on rising memory content per accelerator.
  • The bet still hinges on HBM staying scarce and technically demanding; if supply catches up and it commoditizes, the memory industry's usual price-and-margin cycle could return.

Insights

As AI's memory needs explode, will flexible CXL technology make expensive, on-chip HBM obsolete?
Can Micron’s new memory technology close the gap with SK Hynix and win the next big NVIDIA contract?
Is the AI memory boom truly different, or will record investments lead to another inevitable industry bust?