Samsung Introduces LPDDR5X-PIM Memory with In-Memory Logic for AI Inference

LPDDR5X-PIM Introduction

Samsung introduced its LPDDR5X-PIM memory at Hot Chips 2026, a new memory technology that incorporates processing-in-memory (PIM) capabilities into the LPDDR5X standard. This development follows earlier demonstrations of PIM technology in HBM stacks, with the LPDDR5X variant now reaching product validation.

Technology and Performance

PIM technology embeds small logic units alongside DRAM cells, enabling basic computations to occur directly within the memory. This approach reduces the reliance on the main processor, mitigating bottlenecks and improving performance for specific tasks. Samsung states that LPDDR5X-PIM is 2.28x faster than standard LPDDR5X for AI inference workloads.

Addressing Cost and Power Concerns

The integration of PIM into LPDDR5X addresses the high cost and power consumption associated with HBM memory, which is a significant component of AI chip expenses. By bringing in-memory processing to a lower-power memory standard, Samsung aims to provide a more economical solution for AI acceleration.

Architectural Details

Samsung's LPDDR5X-PIM design includes a dedicated PIM unit within each memory bank, an advancement over previous HBM-PIM implementations. The memory can operate in either a traditional single-bank DRAM mode or a multi-bank PIM mode. To manage data reordering challenges with conventional DRAM controllers, Samsung employs an Address Align Mode (AAM) that maps DRAM addresses to MAC instructions.

Future Developments

Looking ahead, Samsung is also developing LPDDR6X-PIM and anticipates an initial specification from JEDEC for this technology within the current year. This indicates a continued focus on integrating processing capabilities directly into memory modules for future generations.