● Covered by 1 source · 1 reportMedium impact
SK hynix and TetraMem develop memristor-based SoC for AI edge devices
Key points
- Developed SoC accelerates neural network inference for AI devices.
- Chip optimized for depthwise convolution using memristor technology.
- Performance peaks at 2.54 TOPS, below large-scale AI requirements.
Overview of the New SoC
SK hynix, TetraMem, and the University of Southern California have collaborated to develop a memristor-based system-on-chip (SoC). This chip is designed to improve the efficiency of AI inference tasks on edge devices while using significantly less power than GPUs and NPUs.
Technical Architecture
The architecture employs in-memory computing (IMC) techniques to carry out analog computations within memory arrays, reducing the need for data movement and thus conserving energy.
Specifically, the SoC integrates a conventional IMC crossbar architecture and a custom memristor-based design optimized for depthwise convolution (DWC), enhancing the performance of lightweight neural networks.
Key Features of the SoC
The SoC is powered by an embedded RISC-V processor and incorporates 10 neural processing units (NPUs), with one dedicated to optimizing depthwise convolution. Each NPU has a 256 x 256 memristor crossbar for analog vector-matrix multiplication, along with DACs and ADCs for data conversion.
The DWC-optimized NPU innovatively replaces traditional crossbar layouts with a zig-zag topology to boost efficiency and data processing.
Performance and Implications
In theoretical scenarios, the SoC could achieve a maximum performance of 2.54 TOPS, which remains significantly lower than requirements set by advanced systems such as Microsoft's Copilot+. Thus, while the chip demonstrates advancements in energy efficiency, its performance benchmarks may limit immediate practical applications in high-demand scenarios.
✨ This summary was generated by AI from the outlets' reporting listed below. It is not independently verified and may contain errors — check the original sources. How BrevFeed works →
The daily brief
One email each morning: the day's tech stories, clustered across outlets and summarized. No account needed.
One email a day. Unsubscribe in one click, any time.
Today's brief
Spend a few minutes, get the whole day. Every topic's top stories in one hands-free rundown — listen, watch, or read the transcript.
▶ Play today's brief
New every morning, and the back catalogue is archived by date.
Reporting from
SK hynix and TetraMem have created a memristor-based in-memory computing SoC aimed at optimizing energy efficiency for AI edge devices. The architecture enhances performance for depthwise convolution while drastically reducing power consumption compared to traditional GPUs and NPUs, though it faces challenges in achieving competitive performance metrics.