Logo image
An Integer-floating-point Dual-mode Gain-cell Computing-in-Memory Macro for Advanced AI Edge Chips
期刊文章   同儕審查

An Integer-floating-point Dual-mode Gain-cell Computing-in-Memory Macro for Advanced AI Edge Chips

Jui-Jen Wu, Ho-Yu Chen, Chuan-Jia Jhang, Yu-Chen Chen, Zhao-En Ke, 孟凡 張, 仁碩 呂, Jun-Ming Hsu, Ping-Chun Wu, Ting-Chien Chiu, …
IEEE Journal of Solid-State Circuits, 卷.60(1), 頁碼.158-170
2025

摘要

Energy efficiency;Common Information Model (computing);Adders;Energy consumption;Artificial intelligence;Computational efficiency;Arrays , Accuracy;In-memory computing;FinFETs

This article presents a novel integer-floating-point (INT-FP) gain-cell (GC)-computing-in-memory (CIM) structure for high-precision multiply-and-accumulate (MAC) operations with high computational flexibility, energy efficiency, and inference accuracy. The proposed device employs: 1) a dual-mode zone-based input processing scheme (ZB-IPS) aimed at eliminating exponent subtraction in order to enhance energy and area efficiency (AEF); 2) a dual-mode local computing cell (DM-LCC) to reuse exponent addition as an adder tree stage for INT-MAC to enhance AEF in both INT and floating-point (FP) modes; and 3) a stationary-based two-port GC array (SB-TP-GCA) to enable concurrent data updates and computation while reducing system-to-CIM and internal data accesses to improve energy efficiency. A 16-nm FinFET 108-kb GC-CIM macro fabricated using 4T gain cells (GCs) achieved energy efficiency of 99.5 TOPS/W in INT-MAC operations involving 128 accumulations of 8b-input, 8b-weight, and 23b-output; and 46.4 TFLOPS/W in FP-MAC operations involving 64 accumulations of BF16-input, BF16-weight, and FP32-output.

相關連結

指標

1 檢視次數

詳細資料

Logo image