Last updated: October 23, 2026. This guide was refreshed with results Micron, SK hynix and Samsung published between July and October 2026. The original June analysis is preserved below the update.

Short answer: HBM memory is still the binding input to AI accelerator supply, and the autumn 2026 reports strengthen that case. Micron reported record fiscal Q4 revenue of $54.23 billion, SK hynix said HBM4 mass shipments began in Q2, and Samsung’s preliminary Q3 profit passed KRW 100 trillion on HBM4-driven price gains. The core mechanism explained in this article, memory bandwidth limiting LLM inference, has not changed.

What Changed for October 2026

The June version of this article, preserved in full below, was written after Micron’s fiscal Q3. Four months later the three HBM suppliers have each reported again, so the figures in the original body are now dated. This section replaces them; the engineering explanation underneath still holds. Numbers below are company-reported and, where the source is press coverage of a company statement rather than the filing itself, that is noted. Nothing here is investment advice; this is a systems analysis of supply constraints.

Micron: fiscal Q4 2026 (quarter ended September 3)

Micron reported record fiscal Q4 revenue of $54.23 billion and fiscal 2026 revenue of $133.19 billion. Gross margin was 86.8% (GAAP) for the quarter. Fiscal Q1 2027 guidance is about $61.5 billion, plus or minus $1.5 billion, according to the results as published and reported on September 30 and October 1. The original article below cites fiscal Q3 revenue of roughly $41.5 billion and a Q4 guide near $50 billion, so the quarter came in above that guidance.

On HBM specifically, reporting of the earnings call says CEO Sanjay Mehrotra described the HBM4 ramp as “proceeding apace” and said Micron has completed agreements for the vast majority of its calendar 2027 HBM bit supply. Micron does not break out HBM revenue; any HBM revenue figure you see is an outside estimate. Management also said it expects memory to be more tightly constrained in 2027 and 2028 than in 2026 and plans higher fiscal 2027 capital spending aimed at DRAM output (as reported by The Next Platform; I did not verify against the call transcript).

SK hynix: 2Q26 (reported late July)

SK hynix reported record 2Q26 revenue of KRW 79.3 trillion and operating profit of KRW 60.5 trillion, a 76% operating margin, on preliminary, unaudited figures. Its release states that mass shipments of HBM4 began in the second quarter with production ramping in the second half, and that HBM4E completed sample shipments in the first half. It also says customer demand exceeds its supply capability, and that long-term agreements are finalized with around ten customers. Capacity additions named in the release include the Yongin Phase 1 cleanroom (early 2027) and an accelerated M15X ramp. Its 3Q26 results had not yet been published when this update was written, so check the company’s investor page for the latest.

Samsung: preliminary 3Q26 (October 8)

Samsung’s preliminary guidance put third-quarter consolidated operating profit at KRW 107.4 trillion on revenue of KRW 195 trillion, the first time operating profit passed KRW 100 trillion. Divisional detail comes with the full release, due October 29. Press reports attribute the jump to memory price gains and the start of meaningful HBM4 sales, with Reuters reporting HBM bit shipments up nearly 50% quarter over quarter. Those HBM points are press reports, not statements in the preliminary release, so treat them as provisional until the full results.

HBM4 status in one view

Item	Status as of Oct 23, 2026	Source type
Micron HBM4	Ramp “proceeding apace”; most of CY2027 HBM supply under agreement	Management, via press
SK hynix HBM4	Mass shipments began 2Q26; ramp in 2H26; HBM4E samples shipped	Company release
Samsung HBM4	Meaningful sales reported from 3Q26	Press reports
Packaging and capacity	Customer demand exceeds supply; new fabs arrive 2027	Company release

What this means for the argument below

Three things shift. First, the “supercycle” label rests less on spot pricing and more on contracts: Micron and SK hynix both point to multi-year agreements and prepayments, which is what separates this cycle from earlier DRAM booms. Second, HBM4 has moved from roadmap to production across all three suppliers, so the HBM3E-versus-HBM4 discussion in the roadmap section should be read as a transition now underway. Third, the risk side is unchanged: yields on taller stacks, advanced packaging capacity, and the fact that these results are peak-margin figures in an industry with a history of down-cycles. The updated numbers make the bottleneck thesis stronger; they do not make it permanent.

The Original Analysis (Published June 2026)

The text below is the original article, unchanged. Where it quotes fiscal Q3 figures or a $50 billion guide, the section above supersedes them.

Micron HBM AI Memory: Why the Supercycle Runs Through the Memory Wall

For two years the AI hardware story was a GPU story. Every headline was about accelerators, FLOPS, and who could buy the most silicon from a single vendor. That framing is now incomplete. The micron hbm ai memory narrative has moved the spotlight to a quieter component sitting millimeters from the GPU die: high-bandwidth memory.

Micron’s fiscal Q3 2026 made the shift impossible to ignore. The company posted record revenue and guided the following quarter to roughly $50 billion, a number that would have looked absurd for a memory maker even eighteen months ago. The driver was not commodity DRAM. It was HBM, the stacked memory that feeds AI accelerators.

This is not a stock story. It is an engineering one. The binding constraint on large-model inference has quietly become memory bandwidth, not raw compute. Understanding why explains the supercycle better than any earnings slide.

What this covers: the memory-wall problem behind Micron’s quarter, why HBM bandwidth (not GPU FLOPS) limits LLM inference, how HBM stacks and CoWoS packaging actually work, the SK hynix–Samsung–Micron supply dynamics and the HBM3E-to-HBM4 roadmap, and the trade-offs the bulls tend to skip.

Context and Background

Micron’s fiscal Q3 2026, reported in late June, was a genuine inflection. Revenue came in at roughly $41.5 billion with gross margins in the mid-80s, and management guided fiscal Q4 to about $50 billion, plus or minus a billion, per the company’s investor materials. Those are figures attached to AI memory demand and multi-year, fixed-price agreements, not to the historically cyclical spot DRAM market. Treat the exact numbers as reported by Micron rather than independently audited here.

Why did memory suddenly become the story? Because the rest of the stack got faster than memory did. GPU compute throughput has scaled aggressively across generations, but the memory feeding those compute units has scaled more slowly. The gap between how fast a processor can compute and how fast it can be fed data has a name in computer architecture: the memory wall.

The memory wall is decades old. It described CPUs stalling on DRAM long before anyone trained a transformer. What changed is the workload. Large language model inference, especially the token-by-token decode phase, spends most of its time moving model weights and the attention KV cache in and out of memory. The arithmetic is cheap; the data movement is expensive.

HBM exists precisely to push that wall back. By stacking DRAM dies vertically and wiring them to the processor over an extremely wide interface, HBM delivers bandwidth that conventional memory cannot approach. That is why an AI accelerator does not use ordinary server DIMMs for its working set. It uses HBM stacks bonded to the same package.

The economic consequence is that memory has been promoted from a commodity input to a strategic one. For most of computing history, DRAM was the part you bought on price, interchangeable across vendors and bought in bulk. HBM is the opposite: scarce, qualification-gated, and sold under long-term agreements. When a component shifts from commodity to strategic, the company that makes it captures far more of the value, and that re-rating is exactly what Micron’s quarter reflects.

The result is a supply chain where memory has become a gating input to AI capacity, on par with the GPU itself. If you want to understand why hyperscaler buildouts depend on more than one vendor’s accelerator, start here. For the accelerator side of this same story, see our analysis of the NVIDIA GB300 NVL72 Blackwell Ultra architecture, which consumes these HBM stacks by the rack.

It is worth being precise about what “record” means in this context. Memory has always been a boom-and-bust business, and Micron has lived through brutal down-cycles where pricing collapsed and the company burned cash. The reason this quarter reads differently is that a large share of the revenue is now tied to contracted HBM volumes rather than spot DRAM. That structural change is the real headline, and it is what justifies treating the moment as a supercycle rather than another ordinary upswing.

Why HBM Is the Bottleneck

HBM is the bottleneck because modern LLM inference is memory-bound, not compute-bound: each generated token requires reading the full set of model weights (and a growing KV cache) out of memory, so the speed of token generation is governed by memory bandwidth and capacity rather than by the accelerator’s peak FLOPS. When you cannot feed the compute units fast enough, faster compute units do not help.

What an HBM stack actually is

An HBM stack is not a single chip. It is a vertical assembly of DRAM dies sitting on top of a base logic die. The DRAM layers are connected to each other and to the base die by through-silicon vias, or TSVs, which are vertical copper columns punched straight through the silicon. A current stack might be 8-high, 12-high, or 16-high, meaning that many DRAM layers.

The base logic die at the bottom is the unsung hero. It handles the interface to the host processor, buffering and routing the wide stream of data coming off the stacked DRAM above it. In newer generations this base die takes on more logic, which is part of what makes HBM4 a meaningful step rather than a minor refresh.

It is worth dwelling on the TSVs for a moment, because they are where much of the manufacturing difficulty concentrates. A single stack can carry thousands of these vertical connections, each of which must be etched, filled with copper, and aligned across every layer. A defect in one via can fail the whole stack, and the taller the stack, the more vias and the more bonds that must all be perfect at once. This is the physical reason HBM yields lag conventional memory and why each new generation reopens a yield-learning curve that takes time to climb.

The whole stack is then placed next to the GPU die on a shared substrate. That proximity matters. The shorter the distance between memory and compute, the wider and faster you can make the connection without burning unacceptable power per bit moved.

The vertical construction is also why HBM is hard to make and easy to undersupply. Each DRAM die in the stack must be thinned to tens of micrometers so the whole assembly fits inside a strict height budget, and the TSVs that carry signal between layers have to land with near-perfect alignment. A single bad die or a flawed bond can wreck an otherwise good stack. That fragility is the engineering reason HBM yields trail conventional DRAM, and it is part of why capacity does not scale linearly with investment.

Power per bit is the other quiet constraint. Moving data costs energy, and at data-center scale the energy spent shuttling bytes between memory and compute is a meaningful fraction of total draw. HBM’s wide, short interface moves each bit a shorter distance over more wires running slower, which is more energy-efficient than pushing fewer wires at very high frequency. That efficiency, not just raw speed, is why accelerator designers accept HBM’s cost and complexity.

Bandwidth versus capacity, and why GDDR loses

The headline advantage of HBM is interface width. Where a GDDR memory chip talks to the processor over a relatively narrow bus, an HBM stack uses a 1024-bit interface in older generations and a 2048-bit interface in HBM4. That is an enormously wide road for data.

Wide and short beats narrow and fast for this workload. HBM3E delivers on the order of 1.2 TB/s per stack, and HBM4 is specified to push past 2.0 TB/s per stack, with some configurations reported higher, according to Tom’s Hardware’s roadmap reporting. Treat per-stack figures as reported or approximate; they vary by speed bin and configuration.

Capacity per stack matters as much as bandwidth. A modern stack carries tens of gigabytes, and an accelerator pairs several stacks together. That aggregate capacity determines how large a model, or how much KV cache, can live close to the compute units instead of spilling to slower memory tiers. Bigger models and longer context windows both push capacity demand up.

GDDR is not obsolete. It remains excellent for gaming GPUs and cost-sensitive accelerators. But for frontier training and high-throughput inference, the bandwidth-per-watt and capacity-per-package math favors HBM decisively, which is why the most expensive accelerators all use it.

Why bandwidth binds inference, not FLOPS

Here is the part that surprises people new to the workload. During the decode phase of LLM inference, the accelerator generates one token at a time. For each token it must stream the relevant model weights through the compute units. With a large model and a modest batch size, the compute units finish their math and then sit idle, waiting for the next chunk of weights to arrive from memory.

That idle waiting is the signature of a memory-bound workload. The arithmetic intensity, the ratio of compute operations to bytes moved, is low. You can add more FLOPS and the tokens will not come out faster, because the processor was never the limiter. The limiter was how fast HBM could deliver bytes.

Contrast this with the prefill phase, when the model first ingests a prompt. Prefill processes many tokens at once and tends to be compute-bound, so it stresses the GPU cores. Decode, the one-token-at-a-time generation that follows, is the memory-bound phase. Most interactive workloads spend the bulk of their wall-clock time in decode, which is why memory bandwidth dominates the user-visible latency. Understanding which phase you are optimizing tells you whether to reach for more compute or more memory bandwidth, and for chat-style inference the answer is usually the latter.

The KV cache makes this worse as context grows. Every prior token in the conversation contributes key and value tensors that must be read on each new step. Longer context means a larger cache to stream, which means more bandwidth pressure and more capacity pressure simultaneously. This is the structural reason memory, not the GPU core, has become the scaling constraint.

Batching changes the arithmetic but does not abolish it. Serving many requests at once lets the accelerator reuse the same weight read across multiple tokens, which raises arithmetic intensity and pushes the workload back toward compute-bound. That is exactly why high-throughput inference clusters batch aggressively. But batching has limits: it adds latency, it needs enough concurrent demand, and the KV cache for every request in the batch still has to fit in HBM. Capacity, again, sets the ceiling on how far batching can rescue you.

There is a useful way to make this concrete without invoking any specific chip. Take the total bytes that must be read to produce one token, divide by the memory bandwidth, and you get a floor on time per token that no amount of extra compute can beat. This is a back-of-the-envelope roofline argument, and it is why practitioners who profile inference workloads almost always find themselves staring at memory bandwidth utilization rather than compute utilization. The hardware is doing exactly what the arithmetic predicts.

Capacity, the working set, and why more HBM sells

Bandwidth gets the headlines, but capacity is the quieter half of the constraint, and it is climbing for two independent reasons. Models keep getting larger, and the context windows they serve keep getting longer. Both push more bytes into the part of memory that must sit close to the compute units.

Think of HBM as the accelerator’s working set. The model weights, the KV cache for every in-flight request, and the activations all need to live in HBM during inference. When they do not fit, the system must either shrink the batch, shorten the context, shard the model across more accelerators, or spill to slower memory. Each of those options costs throughput, latency, or hardware. So total HBM capacity per accelerator directly sets how much useful work a single device can do.

This is why vendors race to add layers to the stack. Going from a 12-high to a 16-high stack, or from one die density to the next, adds capacity inside the same physical footprint. Every extra gigabyte that fits next to the GPU is a gigabyte that does not have to be served more slowly from elsewhere. The demand for capacity, not just bandwidth, is a large part of why HBM is sold out: customers want both more bytes per second and more total bytes, and the two requirements compound.

There is a system-level corollary. Because capacity is finite and precious, a great deal of inference engineering is really memory engineering, deciding what gets to live in HBM and what does not. Techniques that shrink the KV cache or compress weights are valuable precisely because they relax the capacity constraint. The accelerator is fixed; the working set is the variable you control.

The Supply Chain and the Roadmap

Memory bandwidth this exotic comes from a thin supply base. Three companies make HBM at volume: SK hynix, Samsung, and Micron. The competitive dynamics among them, and the packaging step that sits downstream, explain why HBM is effectively sold out and why Micron’s guidance could leap the way it did.

A three-supplier market is unusual in modern semiconductors, and it shapes behavior. With only three credible vendors and a small number of enormous buyers, both sides have leverage and both sides want stability. Buyers want second and third sources so they are never hostage to one supplier; sellers want long contracts so they can justify the capital. The multi-year, fixed-price agreements that defined this cycle are the natural equilibrium of that standoff, and they are why a memory maker can suddenly forecast revenue with a confidence the industry has rarely seen.

SK hynix is the clear leader. Reporting through 2026 places its HBM market share around the 50 to 55 percent range, with Samsung in the high 30s and Micron in the single digits to low teens, depending on the quarter and the source. SK hynix earned that lead by qualifying early with the dominant accelerator customer and by executing well on stacking technology and yield.

Micron’s position is the interesting one for this story. A smaller share of a market growing this fast still produces record revenue, because the pie expanded violently. Micron has also said its HBM4 is in high-volume production for a lead customer, with samples out to others, and disclosed a large slate of multi-year strategic agreements representing roughly $100 billion in minimum contracted revenue, per its Q3 prepared remarks. Long-term contracts are what turn a cyclical memory business into something that looks, for now, more like a utility.

Samsung sits between the two strategically. It has the manufacturing scale and the ambition to lead, and it has pushed aggressively on next-generation samples, reportedly shipping early HBM4E parts ahead of rivals on some timelines. But it spent much of the prior generation working to qualify with the dominant accelerator customer, which is a reminder that in HBM, qualification is everything. Being able to make a fast stack in a lab is not the same as being designed into a shipping accelerator at volume, and the gap between the two can be quarters wide.

This is the core dynamic to hold in mind: HBM is a three-horse race where qualification, yield, and packaging access matter more than headline speed bins. A vendor that is a few months behind on a spec sheet but solidly qualified and yielding well can out-ship a vendor with a flashier sample. That is why market-share figures move slowly even as the underlying technology races ahead.

The generational roadmap

The roadmap is moving from HBM3E, shipping today, to HBM4, ramping now, with HBM4E samples already appearing from at least one vendor. The headline architectural change in HBM4 is the doubling of the interface to 2048 bits and a more capable base logic die. The table below summarizes the generations as reported; treat the numbers as approximate and configuration-dependent.

Generation	Interface width	Per-stack bandwidth (approx)	Typical stack height	Status (mid-2026)
HBM3	1024-bit	~0.8 TB/s	8-Hi / 12-Hi	Mature, shipping
HBM3E	1024-bit	~1.2 TB/s	8-Hi / 12-Hi	Volume, in H200/B200-class parts
HBM4	2048-bit	>2.0 TB/s	12-Hi / 16-Hi	Ramping in 2026
HBM4E	2048-bit	~3+ TB/s (reported)	12-Hi+	Early samples

The capacity story rides alongside bandwidth. HBM4 stacks are reported at 36 GB to 48 GB depending on layer count and die density, with vendors racing to qualify 16-high stacks for the most memory-hungry accelerators. More layers in the same height envelope means thinner dies and harder bonding, which raises the engineering bar.

The base logic die is where the generational competition is quietly being fought. In earlier HBM, the base die was relatively simple. In HBM4 and beyond, vendors are putting more capability into it, and some customers want it customized to their accelerator. A custom base die can improve performance and efficiency for a specific design, but it also tightens the bond between a memory vendor and a customer, and it shifts some of the value of the stack toward whoever controls that logic. This is one of the more important and least discussed shifts in the roadmap, because it changes HBM from a relatively standardized part into something closer to a co-designed component.

Timelines are worth treating with humility. Roadmap dates slip, qualification takes longer than announced, and “shipping samples” is not the same as “in volume production.” When you read that a vendor has the fastest HBM4E sample, the operative question is when that part reaches qualified volume inside a shipping accelerator. The gap between the two is where market share is actually won and lost, and it is rarely visible from a press release.

Packaging is a co-bottleneck

Making the HBM stack is only half the problem. The stack must then be married to the GPU on a silicon interposer using advanced 2.5D packaging, the TSM

Figure 2: Why LLM inference is memory bandwidth bound. During autoregressive decode the accelerator streams the full weight set and KV cache from HBM for every token, so throughput is capped by memory bandwidth long before the compute units saturate.

Frequently Asked Questions

What is HBM memory and why do AI accelerators use it?

HBM (high-bandwidth memory) stacks several DRAM dies vertically, links them with through-silicon vias and places them beside the GPU on one package. The very wide interface delivers far more bandwidth per watt than GDDR or DIMMs. LLM inference repeatedly streams weights and KV cache from memory, so bandwidth, not peak FLOPS, often sets token throughput.

What happened to Micron in fiscal Q4 2026?

Micron reported record revenue of $54.23 billion for the quarter ended September 3, 2026, and $133.19 billion for fiscal 2026. It guided fiscal Q1 2027 to about $61.5 billion, plus or minus $1.5 billion. Management said the HBM4 ramp is proceeding and that most calendar 2027 HBM supply is already under agreement.

Is HBM4 in volume production yet?

SK hynix says mass shipments of HBM4 began in the second quarter of 2026 with production ramping in the second half. Micron describes its ramp as proceeding. Press reports say Samsung’s HBM4 sales became meaningful in the third quarter. Volume production is not the same as full qualification on every accelerator, so ramp pace still varies by customer.

Who are the main HBM suppliers?

Three companies make HBM: SK hynix, Samsung and Micron. All three now report HBM4 activity, and each is tied to accelerator customers through long-term agreements. Micron does not publish HBM market share or HBM revenue, so share figures you see come from analyst estimates rather than company disclosures.

Is the AI memory supercycle going to end?

Memory has a history of boom and bust, and current margins are extreme: Micron’s GAAP gross margin was 86.8% last quarter. What differs now is contract coverage, with multi-year agreements and customer prepayments. Risks remain: new capacity from Yongin and others in 2027, demand shifts if AI spending slows, and yield or packaging problems. This is analysis, not investment advice.

Why does packaging matter as much as the memory itself?

HBM stacks must be joined to the GPU on a silicon interposer using 2.5D packaging such as TSMC’s CoWoS. That step has its own capacity limits and yield losses, so even with plentiful DRAM dies, accelerator output can be capped by packaging. The original article below covers this co-bottleneck in more detail.

Micron HBM and the AI Memory Supercycle (2026)