IEEE Consumer Electronics Magazine - March 2018 - 91

©iStockphoto.com/jiraro praditcharoenkul

Advanced Interaction and VR/AR

Harnessing Audio
in Auto Control
The challenge of sonifying virtual objects
for gesture control of cars.

By Benjamin Bressolette,
Sébastien Denjean,
Vincent Roussarie,
Mitsuko Aramaki,
Sølvi Ystad, and
Richard Kronland-Martinet

T

his article presents
a gesture sonification
system for blind interface manipulation based
on interaction with a
virtual object (VO). Commands
are given through gestures, and sounds carry the feedback on
how the VO was affected. The sound feedback allows the
user to manipulate the interface without vision. Here, we
chose to focus on a swipe gesture. In the first part of the article, we study different curves that relate the VO parameters to
sound parameters to create the most natural association
between the two.
On the basis of this experiment, we undertook a second
experiment, comparing different sonification strategies for a
particular VO manipulation task. The results helped us to
classify the sound strategies and choose the most promising
ones for future studies.

Digital Object Identifier 10.1109/MCE.2017.2721678
Date of publication: 8 February 2018

2162-2248/18©2018IEEE

©iStockphoto.com/Goja1

THE RISE OF HIGH-TECH CARS
The automotive industry is increasingly integrating new
technologies to facilitate certain aspects of driving a car. In
recent years, for example, speed-control systems have been
introduced to make highway driving easier, and parking aid
systems have been engineered to automatically park cars
on city streets. These technologies also involve human-
machine interfaces (HMIs). The industry has introduced
touchscreens to replace the arrays of buttons that have increased with the available functions in vehicles. Touchscreens are now integrated in cars as a central multifunction
interface from which most of the vehicle systems are regulated. However, while buttons can be manipulated without
vision, which is convenient during driving, touchscreens
necessitate visual attention. In particular, the feedback on
the manipulated function is principally provided through
march 2018

^

IEEE Consumer Electronics Magazine

91


http://www.iStockphoto.com/jiraro http://www.iStockphoto.com/Goja1

Table of Contents for the Digital Edition of IEEE Consumer Electronics Magazine - March 2018

Contents
IEEE Consumer Electronics Magazine - March 2018 - Cover1
IEEE Consumer Electronics Magazine - March 2018 - Cover2
IEEE Consumer Electronics Magazine - March 2018 - Contents
IEEE Consumer Electronics Magazine - March 2018 - 2
IEEE Consumer Electronics Magazine - March 2018 - 3
IEEE Consumer Electronics Magazine - March 2018 - 4
IEEE Consumer Electronics Magazine - March 2018 - 5
IEEE Consumer Electronics Magazine - March 2018 - 6
IEEE Consumer Electronics Magazine - March 2018 - 7
IEEE Consumer Electronics Magazine - March 2018 - 8
IEEE Consumer Electronics Magazine - March 2018 - 9
IEEE Consumer Electronics Magazine - March 2018 - 10
IEEE Consumer Electronics Magazine - March 2018 - 11
IEEE Consumer Electronics Magazine - March 2018 - 12
IEEE Consumer Electronics Magazine - March 2018 - 13
IEEE Consumer Electronics Magazine - March 2018 - 14
IEEE Consumer Electronics Magazine - March 2018 - 15
IEEE Consumer Electronics Magazine - March 2018 - 16
IEEE Consumer Electronics Magazine - March 2018 - 17
IEEE Consumer Electronics Magazine - March 2018 - 18
IEEE Consumer Electronics Magazine - March 2018 - 19
IEEE Consumer Electronics Magazine - March 2018 - 20
IEEE Consumer Electronics Magazine - March 2018 - 21
IEEE Consumer Electronics Magazine - March 2018 - 22
IEEE Consumer Electronics Magazine - March 2018 - 23
IEEE Consumer Electronics Magazine - March 2018 - 24
IEEE Consumer Electronics Magazine - March 2018 - 25
IEEE Consumer Electronics Magazine - March 2018 - 26
IEEE Consumer Electronics Magazine - March 2018 - 27
IEEE Consumer Electronics Magazine - March 2018 - 28
IEEE Consumer Electronics Magazine - March 2018 - 29
IEEE Consumer Electronics Magazine - March 2018 - 30
IEEE Consumer Electronics Magazine - March 2018 - 31
IEEE Consumer Electronics Magazine - March 2018 - 32
IEEE Consumer Electronics Magazine - March 2018 - 33
IEEE Consumer Electronics Magazine - March 2018 - 34
IEEE Consumer Electronics Magazine - March 2018 - 35
IEEE Consumer Electronics Magazine - March 2018 - 36
IEEE Consumer Electronics Magazine - March 2018 - 37
IEEE Consumer Electronics Magazine - March 2018 - 38
IEEE Consumer Electronics Magazine - March 2018 - 39
IEEE Consumer Electronics Magazine - March 2018 - 40
IEEE Consumer Electronics Magazine - March 2018 - 41
IEEE Consumer Electronics Magazine - March 2018 - 42
IEEE Consumer Electronics Magazine - March 2018 - 43
IEEE Consumer Electronics Magazine - March 2018 - 44
IEEE Consumer Electronics Magazine - March 2018 - 45
IEEE Consumer Electronics Magazine - March 2018 - 46
IEEE Consumer Electronics Magazine - March 2018 - 47
IEEE Consumer Electronics Magazine - March 2018 - 48
IEEE Consumer Electronics Magazine - March 2018 - 49
IEEE Consumer Electronics Magazine - March 2018 - 50
IEEE Consumer Electronics Magazine - March 2018 - 51
IEEE Consumer Electronics Magazine - March 2018 - 52
IEEE Consumer Electronics Magazine - March 2018 - 53
IEEE Consumer Electronics Magazine - March 2018 - 54
IEEE Consumer Electronics Magazine - March 2018 - 55
IEEE Consumer Electronics Magazine - March 2018 - 56
IEEE Consumer Electronics Magazine - March 2018 - 57
IEEE Consumer Electronics Magazine - March 2018 - 58
IEEE Consumer Electronics Magazine - March 2018 - 59
IEEE Consumer Electronics Magazine - March 2018 - 60
IEEE Consumer Electronics Magazine - March 2018 - 61
IEEE Consumer Electronics Magazine - March 2018 - 62
IEEE Consumer Electronics Magazine - March 2018 - 63
IEEE Consumer Electronics Magazine - March 2018 - 64
IEEE Consumer Electronics Magazine - March 2018 - 65
IEEE Consumer Electronics Magazine - March 2018 - 66
IEEE Consumer Electronics Magazine - March 2018 - 67
IEEE Consumer Electronics Magazine - March 2018 - 68
IEEE Consumer Electronics Magazine - March 2018 - 69
IEEE Consumer Electronics Magazine - March 2018 - 70
IEEE Consumer Electronics Magazine - March 2018 - 71
IEEE Consumer Electronics Magazine - March 2018 - 72
IEEE Consumer Electronics Magazine - March 2018 - 73
IEEE Consumer Electronics Magazine - March 2018 - 74
IEEE Consumer Electronics Magazine - March 2018 - 75
IEEE Consumer Electronics Magazine - March 2018 - 76
IEEE Consumer Electronics Magazine - March 2018 - 77
IEEE Consumer Electronics Magazine - March 2018 - 78
IEEE Consumer Electronics Magazine - March 2018 - 79
IEEE Consumer Electronics Magazine - March 2018 - 80
IEEE Consumer Electronics Magazine - March 2018 - 81
IEEE Consumer Electronics Magazine - March 2018 - 82
IEEE Consumer Electronics Magazine - March 2018 - 83
IEEE Consumer Electronics Magazine - March 2018 - 84
IEEE Consumer Electronics Magazine - March 2018 - 85
IEEE Consumer Electronics Magazine - March 2018 - 86
IEEE Consumer Electronics Magazine - March 2018 - 87
IEEE Consumer Electronics Magazine - March 2018 - 88
IEEE Consumer Electronics Magazine - March 2018 - 89
IEEE Consumer Electronics Magazine - March 2018 - 90
IEEE Consumer Electronics Magazine - March 2018 - 91
IEEE Consumer Electronics Magazine - March 2018 - 92
IEEE Consumer Electronics Magazine - March 2018 - 93
IEEE Consumer Electronics Magazine - March 2018 - 94
IEEE Consumer Electronics Magazine - March 2018 - 95
IEEE Consumer Electronics Magazine - March 2018 - 96
IEEE Consumer Electronics Magazine - March 2018 - 97
IEEE Consumer Electronics Magazine - March 2018 - 98
IEEE Consumer Electronics Magazine - March 2018 - 99
IEEE Consumer Electronics Magazine - March 2018 - 100
IEEE Consumer Electronics Magazine - March 2018 - 101
IEEE Consumer Electronics Magazine - March 2018 - 102
IEEE Consumer Electronics Magazine - March 2018 - 103
IEEE Consumer Electronics Magazine - March 2018 - 104
IEEE Consumer Electronics Magazine - March 2018 - 105
IEEE Consumer Electronics Magazine - March 2018 - 106
IEEE Consumer Electronics Magazine - March 2018 - 107
IEEE Consumer Electronics Magazine - March 2018 - 108
IEEE Consumer Electronics Magazine - March 2018 - 109
IEEE Consumer Electronics Magazine - March 2018 - 110
IEEE Consumer Electronics Magazine - March 2018 - 111
IEEE Consumer Electronics Magazine - March 2018 - 112
IEEE Consumer Electronics Magazine - March 2018 - 113
IEEE Consumer Electronics Magazine - March 2018 - 114
IEEE Consumer Electronics Magazine - March 2018 - 115
IEEE Consumer Electronics Magazine - March 2018 - 116
IEEE Consumer Electronics Magazine - March 2018 - 117
IEEE Consumer Electronics Magazine - March 2018 - 118
IEEE Consumer Electronics Magazine - March 2018 - 119
IEEE Consumer Electronics Magazine - March 2018 - 120
IEEE Consumer Electronics Magazine - March 2018 - Cover3
IEEE Consumer Electronics Magazine - March 2018 - Cover4
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20240102
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20231112
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20230910
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20230708
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20230506
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20230304
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20230102
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20221112
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20220910
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20220708
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20220506
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20220304
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20220102
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20211112
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20210910
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20210708
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20210506
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20210304
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_202010
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_202009
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_202007
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_202004
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_202003
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_202001
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_201910
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_201909
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_201907
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_201905
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_201903
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_201901
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_201811
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_201809
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_201807
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_201805
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_201803
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_july2017
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_april2017
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_january2017
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_october2016
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_july2016
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_april2016
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_january2016
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_october2015
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_july2015
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_april2015
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_january2015
https://www.nxtbookmedia.com