A 240-FPS In-Column Binarized Neural Network Processing in CMOS Image Sensors

Bohyeok Jeong, Jaehwan Lee, Suhyeon Lee, Soyeon Lee, Youngdoo Son, Soo Youn Kim

Research output: Contribution to journalArticlepeer-review

Abstract

This brief presents a CMOS image sensor (CIS) integrated with a binarized neural network (BNN) for face detection in always-on image classification applications. We propose a process variation-immune comparator-based row buffer generating edge images that are inputs of the BNN processor. To reduce the power consumption of column-parallel row buffers, we adopted comparator-based switched capacitor (CBSC) circuits. With a proposed auto-zeroed current source block circuit that operates with low supply voltages, we observed a low variation of row buffers' outputs. The measurement results showed that the σ /μ of the row buffers' output is decreased by 4% while reducing 28% of power consumption compared to conventional CBSC-based row buffers. The proposed CIS with an in-column BNN processor having a single channel and two hidden layers was fabricated in a 1-poly 4-metal 110nm CIS process. As a measurement result, we achieved an image classification accuracy is 97.75%. Furthermore, the image resolution is 120× 120 , and the total power consumption of the proposed CIS is 3.78 mW with supply voltages of 2.8 V and 1.5 V at 240 frames per second.

Original languageEnglish
Pages (from-to)3907-3911
Number of pages5
JournalIEEE Transactions on Circuits and Systems II: Express Briefs
Volume70
Issue number10
DOIs
StatePublished - 1 Oct 2023

Keywords

  • Always-on
  • binarized neural network
  • CMOS image sensor
  • edge mask
  • face detection
  • row buffer

Fingerprint

Dive into the research topics of 'A 240-FPS In-Column Binarized Neural Network Processing in CMOS Image Sensors'. Together they form a unique fingerprint.

Cite this