Memory Crisis: Ai Revolution Demands New Era In Computing Power

The World’s Most Memory-Intensive Applications Need a New Standard

In an era where artificial intelligence (AI) is transforming industries and revolutionizing the way we live, one thing has become clear: memory is king. The sheer amount of data generated by AI systems, combined with the increasing demand for high-performance computing, has created a massive need for more memory capacity.

Traditional memory technologies like High Bandwidth Memory (HBM) are struggling to keep up with this demand. HBM, which uses multiple stacked DRAM chips to increase bandwidth and capacity, offers impressive performance but comes with significant power consumption and cost penalties. As a result, researchers and manufacturers are on the hunt for more efficient and powerful memory technologies.

Intel’s new Z-Angle Memory (ZAM), a vertically-stacked memory technology co-developed by Intel and its SoftBank subsidiary Saimemory, promises to revolutionize the way we think about memory. Designed to offer two to three times the capacity of HBM, operating at as little as half the power consumption, while being up to 60% cheaper to produce.

The concept of ZAM may seem like science fiction, but it’s based on real-world technology that Intel has been developing for years. The company’s Advanced Memory Technology R&D program, managed by the U.S. Department of Energy and National Nuclear Security Administration through the Sandia National Laboratory, identified a need for more efficient memory technologies.

“HBM has impressive bandwidth, but it trades that for lower capacity and weaker power efficiency,” said Dr. Joshua Fryman, Intel Fellow and CTO of Intel Government Technologies. “Intel’s Next Generation DRAM Bonding (NGDB) initiative has demonstrated a novel memory architecture and revolutionary assembly methodology that significantly increases DRAM performance, reduces power consumption, and optimizes memory costs.”

To achieve these goals, Intel had to design a new stacking approach and a different way of organizing the DRAM chips. Early prototypes confirmed it was possible to increase capacity through new stacking techniques, while recent developments have demonstrated that the necessary high performance is there.

Saimemory is slated to produce its first ZAM prototype sometime in 2027, with plans to develop a mass production line for the new memory by 2029. However, this venture isn’t designed to suddenly bring new DDR5 or HBM production online. It’s looking beyond what’s currently available to data center builders and hoping to provide what they might need next.

Other firms are backing the project, showcasing its impact and interest beyond the initial parties to the venture. Japanese IT hardware and services firm Fujitsu; PowerChip Semiconductor Manufacturing; Shinko Electric Industries; and the University of Tokyo are among the companies cooperating on the design, development, and manufacture of ZAM.

The various Japanese institutions involved highlight the importance of this venture to Softbank. In its release, it said, “SAIMEMORY’s development of next-generation memory technologies represents one of SoftBank’s key initiatives to support next-generation social infrastructure.”

By collaborating with Intel and other technology partners and research institutions in Japan and abroad, SoftBank will contribute to the creation of advanced, homegrown semiconductor technologies, and to the strengthening of Japan’s global competitiveness.

The development of ZAM represents a significant milestone in the evolution of memory technologies. It’s a testament to the power of collaboration between industry leaders, research institutions, and governments. As we look to the future, one thing is clear: memory will continue to play an increasingly important role in shaping our world.

With its higher capacity, greater bandwidth, and lower power consumption, ZAM has the potential to revolutionize the way we think about memory. The demand for AI continues to grow, and with companies like Intel and Softbank leading the charge, there’s no doubt that ZAM will play a critical role in shaping this future.

In an era where data is king, it’s time to rethink the way we think about memory. The potential impact of ZAM cannot be overstated. As we wait for the first real prototypes of ZAM to emerge, one thing is certain: the world of memory has never been more exciting.