Tech Briefs Magazine - August 2024 - 13

This feature is particularly valuable in
scenarios involving rapid movements,
ensuring sharp image quality. New uses
that take advantage of this benefit are
being developed for cameras in smartphones,
for example Prophesee's partnership
with Qualcomm to integrate its
event-based technology with the popular
Snapdragon platform.
Further development in event sensors
for IoT involves adapting them for edge
vision tasks with limited onboard computing
capabilities due to acquiring sparse
data. However, challenges such as unconventional
data formats, variable data
rates, and non-standard interfaces have
hindered broader adoption. To address
this issue, the latest generation of event
sensors, exemplified by Prophesee's
GenX320, aims to enhance integration
and usability in embedded edge vision
systems by incorporating features
like
event data pre-processing and formatting,
compatible data interfaces, and low-latency
connectivity with various processing
platforms including energy-efficient neuromorphic
processors. For instance, the
GenX320 offers multiple pre-processing
functions, adaptable interfaces, and power
management options to cater to power-sensitive
vision applications efficiently.
Despite their operational efficiency,
optimizing event sensors for low-power
usage suitable for IoT setups remains
critical. Implementing a range of power
modes and application-specific operation
modes can enhance energy efficiency
significantly for 'always on' applications.
Utilizing on-chip intelligent power
management mechanisms and strategies
can further refine sensor flexibility and
usability;
Prophesee's
solutions have
demonstrated reduced power consumption
down to 36uW with smart wake-onevents
functionality enabled. Additionally
supporting deep sleep and standby
modes can be beneficial.
Specific considerations for an event
sensor targeting IoT applications include
achieving microsecond resolution timestamping
of events with minimal latency
along with seamless interfacing capabilities
with standard SoCs through integrated
event data preprocessing functions.
Leveraging MIPI or CPI output interfaces
ensures swift connectivity with embedded
processing platforms such as low-power
microcontrollers and modern neuromorphic
processor architectures. Sensor-level
privacy is ensured through the sparse
frameless event data of event sensors and
includes static scene removal.
Tech Briefs, August 2024
With a dynamic range exceeding 120dB, event-based cameras can function effectively even in environments
where traditional cameras struggle with varying lighting conditions - be it extremely
bright settings like public spaces or vehicles during the day or dimly lit scenarios such as nighttime
operations or dark factory settings where event sensors can be used for preventative maintenance
and safety monitoring tasks. (Image: Prophesee)
Event-based sensors continue to evolve to meet the needs of a wider range of applications. Prophesee's
most recent sensor, the Genx320, makes it well suited to the demands of many IoT use cases that
must operate in lower power and small form factor systems. (Image: Prophesee)
Event-based sensors are now being utilized
in a broader range of applications.
By integrating these sensors with IoT platforms,
product developers meet specific
market needs related to power consumption
and size. Use cases include foveated
rendering for enhanced AR/VR experiences,
eye tracking for human-machine
interfaces and safety applications like
driver monitoring systems and emotion
detection. They also support always-on
capabilities for security purposes such
as fall detection cameras and gesture/
hand tracking for immersive interfaces.
In the AR/VR domain, applications like
inside-out tracking and constellation
tracking based on flickering LCDs enable
precise object or controller tracking.
Further new use cases, enabled by enhancement
in silicon technology, are under
development, including high-speed
structured light 3D technology that enwww.techbriefs.com
ables
point cloud generation at kilohertz
repetition rates for industrial applications.
Privacy-conscious smart home
systems like fall detection units are also
proliferating more broadly as the vision
technology address privacy concerns by
not capturing or transmitting images.
Event based vision is well on its way to
establishing itself as a paradigm that will
create a new standard in many markets
requiring efficiency in how machines
can see. Over the past several years, it
has successfully evolved to meet a wider
range of uses. And by continuing to
adapt and address the requirements
of many applications, we will see more
event-based cameras all around us.
This article was written by Luca
Verre, CEO and Co-Founder, Prophesee
(Paris, France). For more information, visit
www.prophesee.ai.
13

http://www.prophesee.ai https://www.techbriefs.com

Tech Briefs Magazine - August 2024

Table of Contents for the Digital Edition of Tech Briefs Magazine - August 2024