Nvidia reveals “World’s largest GPU” – Meet the DGX-2

Nvidia reveals

Nvidia reveals “World’s largest GPU” – Meet the DGX-2

Have you been wondering why Nvidia hasn’t released a new consumer GPU in a while? Well, if you can sell a system with 16 Tesla V100s for $399K, it is understandable why Nvidia’s focus has shifted to the enterprise market. 

Meet what Nvidia has called the “World’s largest GPU”, which aside from being a system that interconnects sixteen Tesla V100 32GB GPUs, offering a combined frame buffer or 512GB of HBM2 memory and 2 PFLOPS of total performance. 

One of the most exciting aspects of this system is Nvidia’s new “NV Switch” (No, not the Nintendo console), which allows each of these GPUs to connect to each other with ports that run with up to 50GB/s of bandwidth. This interconnect will enable each GPU to speak to each other when required with minimal latency. 

Nvidia reveals  
In total Nvidia’s DGX-2 has over 80,000 CUDA cores and 14.4 TB/s of combined/aggregate GPU memory bandwidth, though this level of GPU performance requires 10,000 Watts of power to run at full tilt.

This GPU cluster is powered by two Intel Platinum series 28-core Xeon processors with 1.5TB of DDR4 DRAM and 30TB of NVMe SSD storage, with 8x EDR 100 Gigabit Ethernet connections for external connectivity. When compared to the Nvidia Volta DGX-1, which was introduced in September 2017, the DGX-2 can offer up to a 10x performance uplift.    

Nvidia reveals  

Alongside the release of their DGX-2 system, Nvidia has also confirmed that they will be upgrading their DGX-1 with 32GB Volta GPUs, allowing these systems to handle larger datasets. 

More information about Nvidia’s DGX-2 system is available here. 

You can join the discussion on Nvidia’s “largest GPU” on the OC3D Forums.Â