'

Samsung brings AI performance to its HBM memory to deliver breakthrough performance and efficiency - HBM PIM

Even memory has compute now!

Samsung brings AI performance to its HBM memory to deliver breakthrough performance and efficiency - HBM PIM

Samsung brings AI performance to its HBM memory to deliver breakthrough performance and efficiency 

Samsung's latest HBM memory promises to deliver tremendous performance and efficiency improvements by bringing the power of AI processing to its latest chips, enabling higher performance levels than today's HBM chips by non-traditional means. 

It is claimed that these new HBM-PIM (High BandWidth Memory-Processing In Memory) chips do "not require any hardware or software changes", allowing these new modules to be integrated into existing products to deliver "over twice the system performance while reducing energy consumption by more than 70%" when compared to their HBM2 Aquabolt modules. 

Right now, Samsung has not been clear about how their HBM-PIM technology works. Right now it looks like this technology many not require specific software/hardware support to enable these increased performance and efficiency targets, though things will be clarified on February 22nd as Samsung released a detailed paper on the technology at the International Solid-State Circuits Virtual Conference (ISSCC).

Even memory has compute - HBM-PIM  

Samsung has claimed that its HBM-PIM technology enables parallel data processing and minimises data movement within its HBM memory modules. By using a "DRAM-optimised AI engine" Samsung can increase the effective performance of their HBM DRAM technology, enabling transformative performance increases.  

HBM-PIM is designed to eliminate one of the largest bottlenecks for memory performance, integrating processing power into memory to eliminate unnecessary sequential data transfers and make the best possible use of their DRAM-to-processor interconnect.
 

   Most of today’s computing systems are based on the von Neumann architecture, which uses separate processor and memory units to carry out millions of intricate data processing tasks. This sequential processing approach requires data to constantly move back and forth, resulting in a system-slowing bottleneck especially when handling ever-increasing volumes of data. 


Right now, it remains to be seen how long it will take for HBM-PIM memory to be utilised by the industry, though you can bet that Samsung's promise if a 2x memory bandwidth increase will be of interested to a lot of potential customers. Samsung sees this new memory type as being useful for AI computing and other HPC applications, which makes sense given the high bandwidth requirements of datacenters. 

We will need more information about this new HBM-PIM memory from Samsung before reaching any firm conclusions on it, but if it works as intended, Samsung will have created the fastest and most efficient HBM memory on the market. 
Samsung brings AI performance to its HBM memory to deliver breakthrough performance and efficiency - HBM PIM
  
You can join the discussion on Samsung's HBM-PIM memory on the OC3D Forums

«Prev 1 Next»

Most Recent Comments

17-02-2021, 11:52:55

AngryGoldfish
That's really cool!Quote

18-02-2021, 00:45:53

NeverBackDown
Agreed that is an incredibly useful innovation. Question is how long for consumers and pricing.

I'd love to see how impactful it is. I can only imagine with DDR5 coming it would prove to be even more useful (since it operates at higher frequencies and ECC may aid the AI engine).Quote
Reply
x

Register for the OC3D Newsletter

Subscribing to the OC3D newsletter will keep you up-to-date on the latest technology reviews, competitions and goings-on at Overclock3D. We won't share your email address with ANYONE, and we will only email you with updates on site news, reviews, and competitions and you can unsubscribe easily at any time.

Simply enter your name and email address into the box below and be sure to click on the links in the confirmation emails that will arrive in your e-mail shortly after to complete the registration.

If you run into any problems, just drop us a message on the forums.