A 128×128 Electronically Multi-Foveated Dynamic Vision Sensor With Real-Time Resolution Reconfiguration
This paper presents the design and implementation of a <inline-formula> <tex-math notation="LaTeX">$128\times 128$ </tex-math></inline-formula> electronically foveated dynamic vision sensor (EF-DVS) fabricated using 350 nm CMOS technology. The EF-DVS integrates a no...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
IEEE
2024-01-01
|
| Series: | IEEE Access |
| Subjects: | |
| Online Access: | https://ieeexplore.ieee.org/document/10804122/ |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1846109873582899200 |
|---|---|
| author | Farnaz Faramarzi Bernabe Linares-Barranco Teresa Serrano-Gotarredona |
| author_facet | Farnaz Faramarzi Bernabe Linares-Barranco Teresa Serrano-Gotarredona |
| author_sort | Farnaz Faramarzi |
| collection | DOAJ |
| description | This paper presents the design and implementation of a <inline-formula> <tex-math notation="LaTeX">$128\times 128$ </tex-math></inline-formula> electronically foveated dynamic vision sensor (EF-DVS) fabricated using 350 nm CMOS technology. The EF-DVS integrates a novel pixel grouping approach that permits real-time dynamic resolution adjustments via external digital signals. Previous approaches rely on physically crafting high- and low-resolution regions, which require a mechanical setup for tracking moving objects within the fovea. Here, our innovation supports flexible and fast operation modes, acting on amplified photocurrents, allowing the sensor to operate in both high-resolution and low-resolution settings, and to configure multiple high-resolution regions of interest (ROIs) with arbitrary shapes and sizes within the pixel array in real-time. Although the pixel circuitry is more complex than its un-foveated predecessor, we have kept the same pixel area, sacrificing slightly fixed pattern noise (FPN). The sensor achieves a latency of <inline-formula> <tex-math notation="LaTeX">$3.66~{\mu \text {s}}$ </tex-math></inline-formula> and demonstrates a contrast sensitivity down to 1.03%. It maintains a dynamic range exceeding 120 dB and an intra-scene dynamic range above 60 dB. Notably, the power consumption is reduced with respect to its predecessor, down to 0.7 mW at 100 Keps when configured in low-resolution mode with a <inline-formula> <tex-math notation="LaTeX">$2\times 2$ </tex-math></inline-formula> pixel grouping. The ability to dynamically adjust spatial resolution reduces noise event rates, enhances sensitivity, and lowers both data bandwidth and processing requirements. These features make the EF-DVS a suitable candidate for applications in robotics, surveillance, and real-time monitoring systems where efficient data processing and low latency are critical. |
| format | Article |
| id | doaj-art-a99f24f873eb438dad569a02c2bfedaa |
| institution | Kabale University |
| issn | 2169-3536 |
| language | English |
| publishDate | 2024-01-01 |
| publisher | IEEE |
| record_format | Article |
| series | IEEE Access |
| spelling | doaj-art-a99f24f873eb438dad569a02c2bfedaa2024-12-25T00:01:35ZengIEEEIEEE Access2169-35362024-01-011219265619267110.1109/ACCESS.2024.351903510804122A 128×128 Electronically Multi-Foveated Dynamic Vision Sensor With Real-Time Resolution ReconfigurationFarnaz Faramarzi0https://orcid.org/0000-0002-2737-979XBernabe Linares-Barranco1https://orcid.org/0000-0002-1813-4889Teresa Serrano-Gotarredona2https://orcid.org/0000-0001-5714-2526Instituto de Microelectrónica de Sevilla (IMSE-CNM), CSIC, Universidad de Sevilla, Seville, SpainInstituto de Microelectrónica de Sevilla (IMSE-CNM), CSIC, Universidad de Sevilla, Seville, SpainInstituto de Microelectrónica de Sevilla (IMSE-CNM), CSIC, Universidad de Sevilla, Seville, SpainThis paper presents the design and implementation of a <inline-formula> <tex-math notation="LaTeX">$128\times 128$ </tex-math></inline-formula> electronically foveated dynamic vision sensor (EF-DVS) fabricated using 350 nm CMOS technology. The EF-DVS integrates a novel pixel grouping approach that permits real-time dynamic resolution adjustments via external digital signals. Previous approaches rely on physically crafting high- and low-resolution regions, which require a mechanical setup for tracking moving objects within the fovea. Here, our innovation supports flexible and fast operation modes, acting on amplified photocurrents, allowing the sensor to operate in both high-resolution and low-resolution settings, and to configure multiple high-resolution regions of interest (ROIs) with arbitrary shapes and sizes within the pixel array in real-time. Although the pixel circuitry is more complex than its un-foveated predecessor, we have kept the same pixel area, sacrificing slightly fixed pattern noise (FPN). The sensor achieves a latency of <inline-formula> <tex-math notation="LaTeX">$3.66~{\mu \text {s}}$ </tex-math></inline-formula> and demonstrates a contrast sensitivity down to 1.03%. It maintains a dynamic range exceeding 120 dB and an intra-scene dynamic range above 60 dB. Notably, the power consumption is reduced with respect to its predecessor, down to 0.7 mW at 100 Keps when configured in low-resolution mode with a <inline-formula> <tex-math notation="LaTeX">$2\times 2$ </tex-math></inline-formula> pixel grouping. The ability to dynamically adjust spatial resolution reduces noise event rates, enhances sensitivity, and lowers both data bandwidth and processing requirements. These features make the EF-DVS a suitable candidate for applications in robotics, surveillance, and real-time monitoring systems where efficient data processing and low latency are critical.https://ieeexplore.ieee.org/document/10804122/Foveated dynamic vision sensorpixel groupingmacro-pixelfoveated visionmulti-fovea |
| spellingShingle | Farnaz Faramarzi Bernabe Linares-Barranco Teresa Serrano-Gotarredona A 128×128 Electronically Multi-Foveated Dynamic Vision Sensor With Real-Time Resolution Reconfiguration IEEE Access Foveated dynamic vision sensor pixel grouping macro-pixel foveated vision multi-fovea |
| title | A 128×128 Electronically Multi-Foveated Dynamic Vision Sensor With Real-Time Resolution Reconfiguration |
| title_full | A 128×128 Electronically Multi-Foveated Dynamic Vision Sensor With Real-Time Resolution Reconfiguration |
| title_fullStr | A 128×128 Electronically Multi-Foveated Dynamic Vision Sensor With Real-Time Resolution Reconfiguration |
| title_full_unstemmed | A 128×128 Electronically Multi-Foveated Dynamic Vision Sensor With Real-Time Resolution Reconfiguration |
| title_short | A 128×128 Electronically Multi-Foveated Dynamic Vision Sensor With Real-Time Resolution Reconfiguration |
| title_sort | 128 x00d7 128 electronically multi foveated dynamic vision sensor with real time resolution reconfiguration |
| topic | Foveated dynamic vision sensor pixel grouping macro-pixel foveated vision multi-fovea |
| url | https://ieeexplore.ieee.org/document/10804122/ |
| work_keys_str_mv | AT farnazfaramarzi a128x00d7128electronicallymultifoveateddynamicvisionsensorwithrealtimeresolutionreconfiguration AT bernabelinaresbarranco a128x00d7128electronicallymultifoveateddynamicvisionsensorwithrealtimeresolutionreconfiguration AT teresaserranogotarredona a128x00d7128electronicallymultifoveateddynamicvisionsensorwithrealtimeresolutionreconfiguration AT farnazfaramarzi 128x00d7128electronicallymultifoveateddynamicvisionsensorwithrealtimeresolutionreconfiguration AT bernabelinaresbarranco 128x00d7128electronicallymultifoveateddynamicvisionsensorwithrealtimeresolutionreconfiguration AT teresaserranogotarredona 128x00d7128electronicallymultifoveateddynamicvisionsensorwithrealtimeresolutionreconfiguration |