i3 - November/December 2018 - 21

FROM GAZE TRACKING TO
EMOTION SENSING

"Once you have the camera or other sensors around
the vehicle, it's just software that's taking that information and doing different things with it. And so,
you're going to see an evolution of the vehicle continue ever after you have it," says Danny Shapiro,
senior director of automotive at NVIDIA Corp. in
Santa Clara, CA. "You're going to get updates that
will add new convenience features and new sensing
capabilities," he says. "The fundamental shift that's
enabling this is AI (artificial intelligence), and specifically deep learning is the ability to take that data
and make sense out of it and analyze it with superhuman levels of detection."
For example, Shapiro says a camera inside the
vehicle could determine a driver's attentiveness by
detecting their eye blink rate and sensing their
head pose. These checks could also determine if the
driver is close to falling asleep. This could be
merged with input from outside sensors that detect
a pedestrian preparing to cross the
car's path. And the car may then
determine if it needs to issue a
collision warning and autobrake sooner than it would

otherwise, to give a tired or distracted driver extra
time to react, Shapiro says.
Emotion-sensing technology could lead the car
to take actions proactively, such as playing certain
music or adjusting cabin temperature. Or it may
make suggestions and engage in a conversation
with a passenger, for instance, offering to lower a
window if lip-reading software senses someone
complaining about being hot.
To realize this vision, NVIDIA has brought to
market a new low-power (30 watt) computer system-on-a-chip named DRIVE Xavier and a complementary software development kit (SDK)
named DRIVE IX (Intelligent Experience) that
provides the building blocks for behavior understanding and action based on it.
The setup uses facial recognition technology to
unlock the car door for an approaching driver,
open the trunk if they are seen lugging grocery
bags, and keep a car door locked to prevent someone inside from opening it into the path of an
oncoming cyclist, Shapiro says. It
will be in new vehicles shortly,
he predicts. It was announced
at CES 2018 that Tier 1
auto industry suppliers

ARTS
By Robert E. Calem


http://www.nvidia.com

i3 - November/December 2018

Table of Contents for the Digital Edition of i3 - November/December 2018

Contents
i3 - November/December 2018 - Cover1
i3 - November/December 2018 - Cover2
i3 - November/December 2018 - Contents
i3 - November/December 2018 - 2
i3 - November/December 2018 - 3
i3 - November/December 2018 - 4
i3 - November/December 2018 - 5
i3 - November/December 2018 - 6
i3 - November/December 2018 - 7
i3 - November/December 2018 - 8
i3 - November/December 2018 - 9
i3 - November/December 2018 - 10
i3 - November/December 2018 - 11
i3 - November/December 2018 - 12
i3 - November/December 2018 - 13
i3 - November/December 2018 - 14
i3 - November/December 2018 - 15
i3 - November/December 2018 - 16
i3 - November/December 2018 - 17
i3 - November/December 2018 - 18
i3 - November/December 2018 - 19
i3 - November/December 2018 - 20
i3 - November/December 2018 - 21
i3 - November/December 2018 - 22
i3 - November/December 2018 - 23
i3 - November/December 2018 - 24
i3 - November/December 2018 - 25
i3 - November/December 2018 - 26
i3 - November/December 2018 - 27
i3 - November/December 2018 - 28
i3 - November/December 2018 - 29
i3 - November/December 2018 - 30
i3 - November/December 2018 - 31
i3 - November/December 2018 - 32
i3 - November/December 2018 - 33
i3 - November/December 2018 - 34
i3 - November/December 2018 - 35
i3 - November/December 2018 - 36
i3 - November/December 2018 - 37
i3 - November/December 2018 - 38
i3 - November/December 2018 - 39
i3 - November/December 2018 - 40
i3 - November/December 2018 - 41
i3 - November/December 2018 - 42
i3 - November/December 2018 - 43
i3 - November/December 2018 - 44
i3 - November/December 2018 - 45
i3 - November/December 2018 - 46
i3 - November/December 2018 - 47
i3 - November/December 2018 - 48
i3 - November/December 2018 - 49
i3 - November/December 2018 - 50
i3 - November/December 2018 - 51
i3 - November/December 2018 - 52
i3 - November/December 2018 - 53
i3 - November/December 2018 - 54
i3 - November/December 2018 - 55
i3 - November/December 2018 - 56
i3 - November/December 2018 - 57
i3 - November/December 2018 - 58
i3 - November/December 2018 - 59
i3 - November/December 2018 - 60
i3 - November/December 2018 - 61
i3 - November/December 2018 - 62
i3 - November/December 2018 - 63
i3 - November/December 2018 - 64
i3 - November/December 2018 - Cover3
i3 - November/December 2018 - Cover4
https://www.nxtbook.com/nxtbooks/manifest/i3_20210304
https://www.nxtbook.com/nxtbooks/manifest/i3_20210102
https://www.nxtbook.com/nxtbooks/manifest/i3_20201112
https://www.nxtbook.com/nxtbooks/manifest/i3_20200910
https://www.nxtbook.com/nxtbooks/manifest/i3_20200708
https://www.nxtbook.com/nxtbooks/manifest/i3_20200506
https://www.nxtbook.com/nxtbooks/manifest/i3_20200304
https://www.nxtbook.com/nxtbooks/manifest/i3_20200102
https://www.nxtbook.com/nxtbooks/manifest/i3_20191112
https://www.nxtbook.com/nxtbooks/manifest/i3_20190910
https://www.nxtbook.com/nxtbooks/manifest/i3_20190708
https://www.nxtbook.com/nxtbooks/manifest/i3_20190506
https://www.nxtbook.com/nxtbooks/manifest/i3_20190304
https://www.nxtbook.com/nxtbooks/manifest/i3_20190102
https://www.nxtbook.com/nxtbooks/manifest/i3_20181112
https://www.nxtbook.com/nxtbooks/manifest/i3_20180910
https://www.nxtbook.com/nxtbooks/manifest/i3_20180708
https://www.nxtbook.com/nxtbooks/manifest/i3_20180506
https://www.nxtbook.com/nxtbooks/manifest/i3_20180304
https://www.nxtbook.com/nxtbooks/manifest/i3_20180102
https://www.nxtbook.com/nxtbooks/manifest/i3_20171112
https://www.nxtbook.com/nxtbooks/manifest/i3_20170910
https://www.nxtbook.com/nxtbooks/manifest/i3_20170708
https://www.nxtbook.com/nxtbooks/manifest/i3_20160102
https://www.nxtbook.com/nxtbooks/manifest/i3_20160304
https://www.nxtbook.com/nxtbooks/manifest/i3_20160506
https://www.nxtbook.com/nxtbooks/manifest/i3_20160708
https://www.nxtbook.com/nxtbooks/manifest/i3_20170506
https://www.nxtbook.com/nxtbooks/manifest/i3_20170304
https://www.nxtbook.com/nxtbooks/manifest/i3_20170102
https://www.nxtbook.com/nxtbooks/manifest/i3_20161112
https://www.nxtbook.com/nxtbooks/manifest/i3_20160910
https://www.nxtbookmedia.com