SK Hynix showcases its next-gen HBM4 AI memory tech
SK Hynix plans to power the next generation of AI tech with its HBM4 memory
At TSMC’s 2025 North America Technology Symposium, SK Hynix has showcased its next-generation HBM4 memory technology alongside new HBM3E products.
With its 12-layer HBM4 memory stacks, SK Hynix has achieved 2 TB/s speeds, delivering a major bandwidth boost over the company’s 1.2 TB/s HBM3E technology. This presents an excellent opportunity to AI hardware creators, as memory bandwidth is critical for modern AI hardware. As such, HBM4 memory is set to usher in the next generation of AI accelerator performance.
In the HBM Solution section, SK hynix presented samples of its 12-layer HBM4 and 16-layer HBM3E products. The 12-layer HBM4 is a next-generation HBM capable of processing over 2 terabytes (TB) of data per second. In March, the company announced it has become the first in the world to supply HBM4 samples to major customers and plans to complete preparations for mass production within the second half of 2025. The B100, NVIDIA’s latest Blackwell GPU equipped with the 8-layer HBM3E, was also exhibited in the section along with 3D models of key HBM technologies such as TSV and Advanced MR-MUF, drawing significant attention from visitors.
– SK Hynix
In gaming terms, a single HBM4 memory stack can deliver more memory bandwidth than an entire RTX 5090 graphics card. With its 32GB of GDDR7 memory, and RTX 5090 has access to 1792 GB/s of memory bandwidth. In other words, it delivers almost 1.8 TB/s of memory bandwidth. With a single HBM4 memory stack, 2 TB/s speeds can be achieved with up to 48GB of memory cappacity.
Remember, AI accelerators are typically connected to multiple HBM memory stacks. This allows them to achieve insane levels of memory bandwidth compared to gaming-oriented GPUs. Note that Nvidia’s B200 GPU/accelerator is connected to eight HBM3E memory stacks.
SK Hynix plans to mass-produce this new memory type in the second half of this year. The company has also become the first to supply HBM4 memory samples to major customers. This likely means that companies like AMD and Nvidia already have access to HBM4 memory modules.
You can join the discussion on SK Hynix’s HBM4 memory technology on the OC3D Forums.
