HBM remains a hyperscaler-only memory tied tightly to AI accelerators

SPHBM4 cuts pin counts dramatically while preserving hyperscale-class bandwidth performanceOrganic substrates reduce ...
Tech Xplore

New ultrathin ferroelectric capacitors show promise for compact memory devices

An ultrathin ferroelectric capacitor, designed by researchers from Japan, demonstrates strong electric polarization despite ...
IEEE

3D-TokSIM: Stacking 3D Memory with Token-Stationary Compute-in-Memory for Speculative LLM Inference

Abstract: The LLM decoding process poses a significant challenge for memory bandwidth due to its autoregressive nature. Prior 2D memory solutions fail to overcome this memory bottleneck due to limited ...
The Verge

RAM price hikes: the latest on the global memory shortage

Random access memory, or RAM, is in just about every piece of technology we use. But it’s also the technology that AI companies like OpenAI, Anthropic, Google, and Meta are using to power the servers ...