Rambus has recently announced the launch of the industry's first HBM4 memory controller IP, marking a significant milestone in high-bandwidth memory (HBM) technology. This new controller supports the JEDEC standard with speeds of up to 6.4 Gbps and can operate at speeds as high as 10 Gbps, offering a remarkable 2.56 terabytes per second (TB/s) of throughput for each memory device.

Rambus Unveils Industry-First HBM4 Controller IP: 10 Gbps Speeds Powering Next-Gen AI and GPUs-3CGO

This advancement is expected to greatly benefit applications in AI accelerators, graphics processing units (GPUs), and high-performance computing (HPC). Rambus has emphasized that as large AI models, such as Large Language Models (LLMs), grow in complexity, overcoming memory bandwidth bottlenecks becomes crucial for real-time performance in both training and inference. The HBM4 controller is designed to work with third-party or custom PHY solutions to form a complete memory subsystem, pushing forward capabilities in AI and next-generation computing.