The biggest threat to the memory chip boom isn’t competition, it’s the customers themselves

The memory chip industry is having its best run in years, powered by an insatiable appetite for AI infrastructure. But the companies fueling that demand are simultaneously working to need less of it.

Nvidia is redesigning its Vera Rubin platform to reduce high-bandwidth memory usage, while Cerebras is building AI chips that skip HBM entirely. The very customers driving record revenues for memory makers are innovating their way toward using fewer chips.

The boom, by the numbers

Right now, business has never been better for the big three memory producers: Micron Technology, Samsung, and SK Hynix. Micron shares have peaked above $1,200, a record high riding the AI wave.

DRAM prices have surged between 80% and 90% in recent quarters, driven almost entirely by AI-related shortages.

The demand is coming from AI data centers that need massive amounts of high-bandwidth memory to train and run large language models. Every new AI infrastructure buildout, including partnerships tied to companies like Anthropic, requires enormous quantities of the stuff.

The AI data center buildout has created a supply shortage so severe that it’s pulling memory allocation away from consumer applications.

Innovation as a double-edged sword

Nvidia’s decision to re-engineer the Vera Rubin platform is the clearest signal that the current memory consumption trajectory isn’t sustainable from a buyer’s perspective. High-bandwidth memory is expensive, power-hungry, and takes up physical space on chip packages.

Cerebras is developing AI processors that can function without HBM altogether — one of the most innovative AI chip companies is trying to build a future where the hottest product in semiconductors becomes optional.

Memory makers are trying to shift toward more stable, contracted supply models rather than relying on spot market pricing, locking in long-term deals with hyperscalers and AI companies to smooth out revenue volatility.

What this means for investors

Investors should watch two things closely. First, the timeline on Nvidia’s Vera Rubin redesign and how much HBM reduction it actually achieves in production. Second, whether Cerebras’s HBM-free architecture gains traction with other AI chip designers.

DRAM price surges of 80-90% are already affecting consumer electronics costs, which touches everything from gaming hardware to other hardware-dependent markets.

Disclosure: This article was edited by Editorial Team. For more information on how we create and review content, see our Editorial Policy.