Logo image
A 128 x 128 Dual-Resolution CMOS Image Sensor With In-Sensor Temporal and Spatial Gradient Calculations for Optical Flow Pre-Processing
期刊文章   同儕審查

A 128 x 128 Dual-Resolution CMOS Image Sensor With In-Sensor Temporal and Spatial Gradient Calculations for Optical Flow Pre-Processing

Liang-Yu Huang, Guan-Cheng Chen, John Carl Joel Salao Marquez, Chung-Chuan Lo, Ren-Shuo Liu, Min Sun, Meng-Fan Chang, Kea-Tiong Tang 和 Chih-Cheng Hsieh
IEEE transactions on circuits and systems. I, Regular papers
12/08/2026
Web of Science ID: WOS:001850246400001

摘要

Engineering Engineering, Electrical & Electronic Science & Technology Technology
This paper presents a 128 & times;128 smart CMOS image sensor that utilizes the processing-in-sensor (PIS) technique for gradient-based pyramidal optical flow pre-processing in power-and bandwidth-constrained edge vision systems. By embedding motion feature extraction directly within the image sensor, the proposed design avoids complex computation and frequent frame-buffer access in digital processors. The sensor simultaneously outputs temporal gradients, two-dimensional spatial gradients, raw intensity images, and dual-resolution data within a single frame period. A multi-row access readout scheme enables concurrent availability of neighboring pixel data, while column-level time-domain processing circuits efficiently compute spatial gradients and 3 & times;3 binning without relying on power-hungry analog subtraction or extensive digital buffering. Fabricated in TSMC 0.18-mu m standard CMOS process, the prototype sensor operates at 198.44 mu W at 30 fps. Measurement results demonstrate accurate gradient and binning outputs, with root-mean-square errors of 0.4 LSB for spatial gradients and 1.6 LSB for binned images (8-bit). Using the measured gradients, off-chip optical flow computation achieves an end-point error of 0.375 pixel, and the proposed binning-based pyramidal scheme extends the detectable motion range by approximately three times. The proposed vision sensor achieves an iFoM of 0.1971pJ/pixel & sdot; frame & sdot; level, validating the effectiveness of the proposed PIS-based architecture for motion-aware edge vision applications.

相關連結

指標

1 檢視次數

詳細資料

Logo image