From News Desk
In an era of unprecedented AI innovation and growth, the entire datacentre ecosystem is transforming toward more energy-efficient infrastructure to support sustainable growth. With memory playing an increasingly critical role in AI systems, low-power memory solutions have become central to this transformation. Micron Technology hs announced customer sampling of 192GB SOCAMM2 (small outline compression attached memory modules) to enable broader adoption of low-power memory within AI data centers. SOCAMM2 extends the capabilities of Micron’s LPDRAM SOCAMM, delivering 50% more capacity in the same compact footprint. The added capacity can significantly reduce time to first token (TTFT) by more than 80% in real-time inference workloads. The 192GB SOCAMM2 uses Micron’s most advanced 1-gamma DRAM process technology to deliver greater than 20% improvement in power efficiency, further enabling power design optimisation of large datacentre clusters. These savings become quite significant in full-rack AI installations, which can include more than 40 terabytes of CPU-attached low-power DRAM main memory. The modular design of SOCAMM2 improves serviceability and lays the groundwork for future capacity expansion.
SOCAMM2 is said to deliver LPDDR5X’s inherent advantages, exceptionally low power consumption and high bandwidth, to the main memory of AI systems. Designed to meet the evolving demands of massive-context AI platforms, SOCAMM2 provides the high data throughput required for AI workloads while delivering new levels of energy efficiency, setting a new standard for AI training and inference systems. This combination of advantages will make SOCAMM2 a key memory solution for leading-edge AI platforms in the years ahead.
“As AI workloads become more complex and demanding, datacentre servers must achieve increased efficiency, delivering more tokens for every watt of power,” said Raj Narasimhan, Senior VP and GM, Micron’s Cloud Memory Business Unit. “Micron’s proven leadership in low-power DRAM ensures our SOCAMM2 modules provide the data throughput, energy efficiency, capacity and datacentre-class quality essential to powering the next generation of AI datacentre servers.”
Through specialised design features and enhanced testing, Micron SOCAMM2 products are said to transform low-power DRAM, initially designed for mobile phones, into datacentre-class solutions.
Disclaimer – The details expressed in this post are from the companies responsible for sending this post for publication. This website doesn’t endorse the details published here. Readers are urged to use their own discretion while making a decision about purchasing or using a product/service related to this company, or using this information in any way. There has been no monetary benefit to the Publisher/Editor/Website Owner for publishing this post and the Website Owner takes no responsibility for the impacts of purchasing or using these products/services on the reader, or using this information in any way.
Global Perspectives... 