SOCAMM2 Is The Memory Standard AI Is Looking For

AI infrastructure can't evolve as fast as model innovation. Memory architecture is one of the few levers capable of accelerating deployment cycles. Enter SOCAMM2 ...
Semiconductor Engineering

RPU: A Chiplet-Based Architecture To Address The Challenges of the Modern Memory Wall (Harvard University)

A Reasoning Processing Unit”. Abstract “Large language model (LLM) inference performance is increasingly bottlenecked by the memory wall. While GPUs continue to scale raw compute throughput, they ...
Hackaday

Capacitor Memory Makes Homebrew Relay Computer Historically Plausible

It’s one thing to create your own relay-based computer; that’s already impressive enough, but what really makes [DiPDoT]’s ...
techtimes

AMD Patents New DDR5 Memory Architecture to Double Data Rates, Boost Performance

AMD submitted a patent to the World Intellectual Property Organization (WIPO) for a groundbreaking new memory architecture that can significantly enhance the performance of the DDR5 standard. The ...
VentureBeat

GAM takes aim at “context rot”: A dual-agent memory architecture that outperforms long-context LLMs

For all their superhuman power, today’s AI models suffer from a surprisingly human flaw: They forget. Give an AI assistant a sprawling conversation, a multi-step reasoning task or a project spanning ...
Hosted on MSN

A unique active memory computer purpose-built for AI science applications

With the particular needs of scientists and engineers in mind, researchers at the Department of Energy's Pacific Northwest National Laboratory have co-designed with Micron a new hardware-software ...
Computerworld

Racetrack Memory — Computer Memory That’s 100,000 Times Faster Than Today’s — May Arrive in 5-7 Years

Computer memory and storage have always followed the Law of Closet Space. No matter how much you have, you shortly discover that it isn’t enough. So it’s good news that scientists in Switzerland are ...