A Time-Memory-based CMOS Vision Sensor with In-Pixel Temporal Derivative Computing for Multi-Mode Image Processing

Dong Woo Jee; Seong Min Ko; Kishore Kasichainula; Injune Yeo; Yu Cao; Jae Sun Seo

doi:10.1109/esscirc59616.2023.10268817

A Time-Memory-based CMOS Vision Sensor with In-Pixel Temporal Derivative Computing for Multi-Mode Image Processing

Dong Woo Jee
, Seong Min Ko
, Kishore Kasichainula
, Injune Yeo
, Yu Cao
, Jae Sun Seo

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

1 Scopus citations

Abstract

This paper presents in-pixel and near-pixel processing circuit techniques for multi-mode processing CMOS vision sensor. The new design includes a checkerboard patch-based pixel circuit and column-shared frame difference processing circuits that detect a patch-level temporal change and generate lb event signal. In-pixel time memory circuit is proposed to process a temporal derivative of the event in both area and power efficient way. The 324× 252 vision sensor is implemented in 0.18 μ m CMOS process and consumes 4.79 μ W @12.5fps showing FoM of 42.2pJ/pix. frame in the patch mode operation for frame difference-based motion detection and temporal derivative generation.

Original language	English (US)
Title of host publication	ESSCIRC 2023 - IEEE 49th European Solid State Circuits Conference
Publisher	IEEE Computer Society
Pages	109-112
Number of pages	4
ISBN (Electronic)	9798350304206
DOIs	https://doi.org/10.1109/esscirc59616.2023.10268817
State	Published - 2023
Externally published	Yes
Event	49th IEEE European Solid State Circuits Conference, ESSCIRC 2023 - Lisbon, Portugal Duration: Sep 11 2023 → Sep 14 2023

Publication series

Name	European Solid-State Circuits Conference
Volume	2023-September
ISSN (Print)	1930-8833

Conference

Conference	49th IEEE European Solid State Circuits Conference, ESSCIRC 2023
Country/Territory	Portugal
City	Lisbon
Period	9/11/23 → 9/14/23

Bibliographical note

Publisher Copyright:
© 2023 IEEE.

Keywords

frame difference
in-pixel processing
in-sensor computing
multi-mode image processing
nearpixel processing
temporal derivative
vision sensor

Publisher link

10.1109/esscirc59616.2023.10268817

Find It

Find It at U of M Libraries

Cite this

Jee, D. W., Ko, S. M., Kasichainula, K., Yeo, I., Cao, Y., & Seo, J. S. (2023). A Time-Memory-based CMOS Vision Sensor with In-Pixel Temporal Derivative Computing for Multi-Mode Image Processing. In ESSCIRC 2023 - IEEE 49th European Solid State Circuits Conference (pp. 109-112). (European Solid-State Circuits Conference; Vol. 2023-September). IEEE Computer Society. https://doi.org/10.1109/esscirc59616.2023.10268817

A Time-Memory-based CMOS Vision Sensor with In-Pixel Temporal Derivative Computing for Multi-Mode Image Processing. / Jee, Dong Woo; Ko, Seong Min; Kasichainula, Kishore et al.
ESSCIRC 2023 - IEEE 49th European Solid State Circuits Conference. IEEE Computer Society, 2023. p. 109-112 (European Solid-State Circuits Conference; Vol. 2023-September).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Jee, DW, Ko, SM, Kasichainula, K, Yeo, I, Cao, Y & Seo, JS 2023, A Time-Memory-based CMOS Vision Sensor with In-Pixel Temporal Derivative Computing for Multi-Mode Image Processing. in ESSCIRC 2023 - IEEE 49th European Solid State Circuits Conference. European Solid-State Circuits Conference, vol. 2023-September, IEEE Computer Society, pp. 109-112, 49th IEEE European Solid State Circuits Conference, ESSCIRC 2023, Lisbon, Portugal, 9/11/23. https://doi.org/10.1109/esscirc59616.2023.10268817

@inproceedings{efa13bb5cc9e429bb83ed7d5b9719632,

title = "A Time-Memory-based CMOS Vision Sensor with In-Pixel Temporal Derivative Computing for Multi-Mode Image Processing",

abstract = "This paper presents in-pixel and near-pixel processing circuit techniques for multi-mode processing CMOS vision sensor. The new design includes a checkerboard patch-based pixel circuit and column-shared frame difference processing circuits that detect a patch-level temporal change and generate lb event signal. In-pixel time memory circuit is proposed to process a temporal derivative of the event in both area and power efficient way. The 324{\texttimes} 252 vision sensor is implemented in 0.18 μ m CMOS process and consumes 4.79 μ W @12.5fps showing FoM of 42.2pJ/pix. frame in the patch mode operation for frame difference-based motion detection and temporal derivative generation.",

keywords = "frame difference, in-pixel processing, in-sensor computing, multi-mode image processing, nearpixel processing, temporal derivative, vision sensor",

author = "Jee, \{Dong Woo\} and Ko, \{Seong Min\} and Kishore Kasichainula and Injune Yeo and Yu Cao and Seo, \{Jae Sun\}",

note = "Publisher Copyright: {\textcopyright} 2023 IEEE.; 49th IEEE European Solid State Circuits Conference, ESSCIRC 2023 ; Conference date: 11-09-2023 Through 14-09-2023",

year = "2023",

doi = "10.1109/esscirc59616.2023.10268817",

language = "English (US)",

series = "European Solid-State Circuits Conference",

publisher = "IEEE Computer Society",

pages = "109--112",

booktitle = "ESSCIRC 2023 - IEEE 49th European Solid State Circuits Conference",

}

TY - GEN

T1 - A Time-Memory-based CMOS Vision Sensor with In-Pixel Temporal Derivative Computing for Multi-Mode Image Processing

AU - Jee, Dong Woo

AU - Ko, Seong Min

AU - Kasichainula, Kishore

AU - Yeo, Injune

AU - Cao, Yu

AU - Seo, Jae Sun

PY - 2023

Y1 - 2023

N2 - This paper presents in-pixel and near-pixel processing circuit techniques for multi-mode processing CMOS vision sensor. The new design includes a checkerboard patch-based pixel circuit and column-shared frame difference processing circuits that detect a patch-level temporal change and generate lb event signal. In-pixel time memory circuit is proposed to process a temporal derivative of the event in both area and power efficient way. The 324× 252 vision sensor is implemented in 0.18 μ m CMOS process and consumes 4.79 μ W @12.5fps showing FoM of 42.2pJ/pix. frame in the patch mode operation for frame difference-based motion detection and temporal derivative generation.

AB - This paper presents in-pixel and near-pixel processing circuit techniques for multi-mode processing CMOS vision sensor. The new design includes a checkerboard patch-based pixel circuit and column-shared frame difference processing circuits that detect a patch-level temporal change and generate lb event signal. In-pixel time memory circuit is proposed to process a temporal derivative of the event in both area and power efficient way. The 324× 252 vision sensor is implemented in 0.18 μ m CMOS process and consumes 4.79 μ W @12.5fps showing FoM of 42.2pJ/pix. frame in the patch mode operation for frame difference-based motion detection and temporal derivative generation.

KW - frame difference

KW - in-pixel processing

KW - in-sensor computing

KW - multi-mode image processing

KW - nearpixel processing

KW - temporal derivative

KW - vision sensor

UR - https://www.scopus.com/pages/publications/85175233874

UR - https://www.scopus.com/pages/publications/85175233874#tab=citedBy

U2 - 10.1109/esscirc59616.2023.10268817

DO - 10.1109/esscirc59616.2023.10268817

M3 - Conference contribution

AN - SCOPUS:85175233874

T3 - European Solid-State Circuits Conference

SP - 109

EP - 112

BT - ESSCIRC 2023 - IEEE 49th European Solid State Circuits Conference

PB - IEEE Computer Society

T2 - 49th IEEE European Solid State Circuits Conference, ESSCIRC 2023

Y2 - 11 September 2023 through 14 September 2023

ER -

A Time-Memory-based CMOS Vision Sensor with In-Pixel Temporal Derivative Computing for Multi-Mode Image Processing

Abstract

Publication series

Conference

Bibliographical note

Keywords

Publisher link

Find It

Other files and links

Fingerprint

Cite this