Trainium
hardware
Nvidia Unveils NVHBM: Custom Memory Tech Promising Higher Bandwidth and Lower Power for Future AI Chips
Nvidia has announced NVHBM, a custom high-bandwidth memory design that moves the memory controller into the HBM base die instead of the compute die, claiming bandwidth, power, and area advantages over standard HBM4E. The technology will be offered to NVLink Fusion partners, with Amazon's Annapurna Labs named as the first collaborator.
3 outletsbusinessAWS and NVIDIA Expand AI Chip Partnership, Aiming for Up to 3 Million GPUs
Amazon Web Services and NVIDIA announced an expanded collaboration that will add 2 million more NVIDIA GPUs to AWS's infrastructure by 2027-2028, building on a prior 1 million GPU commitment, alongside new CPU, networking, and robotics initiatives.
2 outlets