Micron ships the world’s first 256GB LPDDR5X SOCAMM2 modules

Micron’s shipping 256GB SOCAMM2 memory samples to customers

Micron has delivered its first 256GB SOCAMM2 memory samples to customers, allowing users to create AI systems with 2TB of LPDDR memory across eight memory channels. With Micron’s first monolithic 32Gb LPDDR5X memory, Micron can enable next-generation AI capabilities through increased memory access. This enables higher performance and support for larger datasets. Both of these changes are vital for future AI workloads.

These new memory modules feature one-third more memory than Micron’s existing 192GB memory modules. Thanks to the modular design of SOCAMM2 modules, users have highly serviceable memory modules and the ability to deliver future capacity upgrades. If/when higher capacity SOCAMM2 modules launch, users can upgrade their servers with ease to enhance their AI capabilities.

SOCAMM2 was built thanks to Micron’s long-term partnership with Nvidia, and is on its way to becoming an official JEDEC memory specification. Note that this shift will allow other DRAM manufacturers to launch SOCAMM2 memory modules. However, Micron will be first to market.

Thanks to SOCAMM2, LPDDR5X memory (which is typically used in mobile devices) is coming to datacenters. Now, Micron is leveraging this memory to deliver higher levels of performance and power efficiency in AI datacenters.

Micron is now shipping SOCAMM2 modules to customers with up to 256 GB capacities. Module speeds of up to 9.6 Gbps are shipping. Note that Micron plans to achieve higher volume SOCAMM2 production soon. This ramp-up will align with “customer launch schedules”. Note that this ramp will likely align with Nvidia’s ramp for its next-generation AI server products.

You can join the discussion on Micron’s 256GB SOCAMM2 memory modules on the OC3D Forums.