IEEE Consumer Electronics Magazine - March 2018 - 71

50 45 130
40 135 140

Z

55

1,900
1,800
1,700
−350
−300

145

60

150

65
155

255 70
265
85 260
8075270 275

160
165
170

280
175

285

−200

0

−50

185
290
205
190
200
195
295
300
315
310
305

−250
X

180

ACKNOWLEDGMENTS

−100
−150

−150

This research is partially supported by the National Natural
Science Foundation of China (No. 61471260 and No.
61271324) and by the Natural Science Foundation of Tianjin
(No. 16JCYBJC16000).

Y

−200

−100

the valid input and invalid input in characters, two gestures are
defined in our method. Taking advantage of Hu moment invariance and neural network intelligence, we recognize these two
gestures with high accuracy. For valid gestures, we implement
stereo matching and 3-D coordinate calculation and line them
up to formulate characters that can be recognized by the OCR
technique. This method makes touchless interaction in VR possible, and its robustness enables free input.

(a)

Z

ABOUT THE AUTHORS

2,500
2,000
1,500
−500

80
90
85
95

290
300
295
285
280

−400

275

195
205
215
210

200

360

−300
X

170
175
180
335
340
260
345
185
265
105
190 350
110
125
120
115
355

100

270

0

365

−50

370
385
375
380

−200
−100

−250

−100

−150
−200
Y

(b)

Z

40
3545
30
25

3,000
2,000
215
220
225
230
1,000
−400
−350

50
55

125
130
135
140
235
240

60
65

145
150
250

−100

260
265
270
275

−250
−200

0
−50

255

−300
X

70
80
75

155
170
160
165

245

−150
−200

Y

−150 −250
(c)

FIGURE 13. (a)-(c) The recording trajectory of writing characters
facing to the right of the stereo camera, corresponding to S3.

can be more complex, which would make the algorithms a bit
slower than traditional ones.

CONCLUSION
In this article, we propose a natural 3-D input method based on
a stereo camera as an interface between human and machine.
We segment the hand using skin-color detection. To distinguish

Jiachen Yang (yangjiachen@tju.edu.cn) earned his M.S. and
Ph.D. degrees in communication and information engineering
in 2005 and 2009, respectively, from Tianjin University, China,
where he is currently an associate professor. His research interests include stereo cameras, stereo vision research, pattern recognition, stereo image display, and quality evaluation.
Yafang Wang (WangYF0739@tju.edu.cn) is an M.S. student in the School of Electronic Information Engineering,
Tianjin University, China. Her research interests include
intelligent transportation systems, machine learning, and stereo vision research.
Zhihan Lv (Z.Lu@cs.ucl.ac.uk) earned his Ph.D. degree in
computer-applied technology from Ocean University of
China, Qingdao. Since 2012, he has been an assistant professor at the Chinese Academy of Sciences, Beijing. His research
interests include virtual reality, augmented reality, multimedia, computer vision, and human-computer interaction.
Na Jiang (jiang_na@163.com) earned her B.S. degree
from the Communication and Information Engineering
School, Tianjin University of Technology, China. She is currently with the management services company of the first
mining area, Da Gang oilfield, PetroChina, Tianjin.
Anthony Steed (A.Steed@cs.ucl.ac.uk) is a professor and
head of the Virtual Environments and Computer Graphics
Group in the Department of Computer Science, University
College London, United Kingdom. His research interests
include real-time interactive virtual environments, with particular focus in mixed-reality systems, large-scale models, and
collaboration between immersive facilities.

REFERENCES
[1] C. Koverman, "Next-generation connected support in the age of IoT:
It's time to get proactive about customer support," IEEE Consum. Electron. Mag., vol. 5, no. 1, pp. 69-73, 2016.
[2] B. Markwalter, "Entertainment and immersive content: What's in
store for your viewing pleasure," IEEE Consum. Electron. Mag., vol. 4,
no. 1, pp. 83-86, 2015.
[3] L. Brun and A. Gasparini, "Enabling 360 visual communications:
Next-level applications and connections," IEEE Consum. Electron. Mag.,
vol. 5, no. 2, pp. 38-43, 2016.

MARCH 2018

^

IEEE Consumer Electronics Magazine

71



Table of Contents for the Digital Edition of IEEE Consumer Electronics Magazine - March 2018

Contents
IEEE Consumer Electronics Magazine - March 2018 - Cover1
IEEE Consumer Electronics Magazine - March 2018 - Cover2
IEEE Consumer Electronics Magazine - March 2018 - Contents
IEEE Consumer Electronics Magazine - March 2018 - 2
IEEE Consumer Electronics Magazine - March 2018 - 3
IEEE Consumer Electronics Magazine - March 2018 - 4
IEEE Consumer Electronics Magazine - March 2018 - 5
IEEE Consumer Electronics Magazine - March 2018 - 6
IEEE Consumer Electronics Magazine - March 2018 - 7
IEEE Consumer Electronics Magazine - March 2018 - 8
IEEE Consumer Electronics Magazine - March 2018 - 9
IEEE Consumer Electronics Magazine - March 2018 - 10
IEEE Consumer Electronics Magazine - March 2018 - 11
IEEE Consumer Electronics Magazine - March 2018 - 12
IEEE Consumer Electronics Magazine - March 2018 - 13
IEEE Consumer Electronics Magazine - March 2018 - 14
IEEE Consumer Electronics Magazine - March 2018 - 15
IEEE Consumer Electronics Magazine - March 2018 - 16
IEEE Consumer Electronics Magazine - March 2018 - 17
IEEE Consumer Electronics Magazine - March 2018 - 18
IEEE Consumer Electronics Magazine - March 2018 - 19
IEEE Consumer Electronics Magazine - March 2018 - 20
IEEE Consumer Electronics Magazine - March 2018 - 21
IEEE Consumer Electronics Magazine - March 2018 - 22
IEEE Consumer Electronics Magazine - March 2018 - 23
IEEE Consumer Electronics Magazine - March 2018 - 24
IEEE Consumer Electronics Magazine - March 2018 - 25
IEEE Consumer Electronics Magazine - March 2018 - 26
IEEE Consumer Electronics Magazine - March 2018 - 27
IEEE Consumer Electronics Magazine - March 2018 - 28
IEEE Consumer Electronics Magazine - March 2018 - 29
IEEE Consumer Electronics Magazine - March 2018 - 30
IEEE Consumer Electronics Magazine - March 2018 - 31
IEEE Consumer Electronics Magazine - March 2018 - 32
IEEE Consumer Electronics Magazine - March 2018 - 33
IEEE Consumer Electronics Magazine - March 2018 - 34
IEEE Consumer Electronics Magazine - March 2018 - 35
IEEE Consumer Electronics Magazine - March 2018 - 36
IEEE Consumer Electronics Magazine - March 2018 - 37
IEEE Consumer Electronics Magazine - March 2018 - 38
IEEE Consumer Electronics Magazine - March 2018 - 39
IEEE Consumer Electronics Magazine - March 2018 - 40
IEEE Consumer Electronics Magazine - March 2018 - 41
IEEE Consumer Electronics Magazine - March 2018 - 42
IEEE Consumer Electronics Magazine - March 2018 - 43
IEEE Consumer Electronics Magazine - March 2018 - 44
IEEE Consumer Electronics Magazine - March 2018 - 45
IEEE Consumer Electronics Magazine - March 2018 - 46
IEEE Consumer Electronics Magazine - March 2018 - 47
IEEE Consumer Electronics Magazine - March 2018 - 48
IEEE Consumer Electronics Magazine - March 2018 - 49
IEEE Consumer Electronics Magazine - March 2018 - 50
IEEE Consumer Electronics Magazine - March 2018 - 51
IEEE Consumer Electronics Magazine - March 2018 - 52
IEEE Consumer Electronics Magazine - March 2018 - 53
IEEE Consumer Electronics Magazine - March 2018 - 54
IEEE Consumer Electronics Magazine - March 2018 - 55
IEEE Consumer Electronics Magazine - March 2018 - 56
IEEE Consumer Electronics Magazine - March 2018 - 57
IEEE Consumer Electronics Magazine - March 2018 - 58
IEEE Consumer Electronics Magazine - March 2018 - 59
IEEE Consumer Electronics Magazine - March 2018 - 60
IEEE Consumer Electronics Magazine - March 2018 - 61
IEEE Consumer Electronics Magazine - March 2018 - 62
IEEE Consumer Electronics Magazine - March 2018 - 63
IEEE Consumer Electronics Magazine - March 2018 - 64
IEEE Consumer Electronics Magazine - March 2018 - 65
IEEE Consumer Electronics Magazine - March 2018 - 66
IEEE Consumer Electronics Magazine - March 2018 - 67
IEEE Consumer Electronics Magazine - March 2018 - 68
IEEE Consumer Electronics Magazine - March 2018 - 69
IEEE Consumer Electronics Magazine - March 2018 - 70
IEEE Consumer Electronics Magazine - March 2018 - 71
IEEE Consumer Electronics Magazine - March 2018 - 72
IEEE Consumer Electronics Magazine - March 2018 - 73
IEEE Consumer Electronics Magazine - March 2018 - 74
IEEE Consumer Electronics Magazine - March 2018 - 75
IEEE Consumer Electronics Magazine - March 2018 - 76
IEEE Consumer Electronics Magazine - March 2018 - 77
IEEE Consumer Electronics Magazine - March 2018 - 78
IEEE Consumer Electronics Magazine - March 2018 - 79
IEEE Consumer Electronics Magazine - March 2018 - 80
IEEE Consumer Electronics Magazine - March 2018 - 81
IEEE Consumer Electronics Magazine - March 2018 - 82
IEEE Consumer Electronics Magazine - March 2018 - 83
IEEE Consumer Electronics Magazine - March 2018 - 84
IEEE Consumer Electronics Magazine - March 2018 - 85
IEEE Consumer Electronics Magazine - March 2018 - 86
IEEE Consumer Electronics Magazine - March 2018 - 87
IEEE Consumer Electronics Magazine - March 2018 - 88
IEEE Consumer Electronics Magazine - March 2018 - 89
IEEE Consumer Electronics Magazine - March 2018 - 90
IEEE Consumer Electronics Magazine - March 2018 - 91
IEEE Consumer Electronics Magazine - March 2018 - 92
IEEE Consumer Electronics Magazine - March 2018 - 93
IEEE Consumer Electronics Magazine - March 2018 - 94
IEEE Consumer Electronics Magazine - March 2018 - 95
IEEE Consumer Electronics Magazine - March 2018 - 96
IEEE Consumer Electronics Magazine - March 2018 - 97
IEEE Consumer Electronics Magazine - March 2018 - 98
IEEE Consumer Electronics Magazine - March 2018 - 99
IEEE Consumer Electronics Magazine - March 2018 - 100
IEEE Consumer Electronics Magazine - March 2018 - 101
IEEE Consumer Electronics Magazine - March 2018 - 102
IEEE Consumer Electronics Magazine - March 2018 - 103
IEEE Consumer Electronics Magazine - March 2018 - 104
IEEE Consumer Electronics Magazine - March 2018 - 105
IEEE Consumer Electronics Magazine - March 2018 - 106
IEEE Consumer Electronics Magazine - March 2018 - 107
IEEE Consumer Electronics Magazine - March 2018 - 108
IEEE Consumer Electronics Magazine - March 2018 - 109
IEEE Consumer Electronics Magazine - March 2018 - 110
IEEE Consumer Electronics Magazine - March 2018 - 111
IEEE Consumer Electronics Magazine - March 2018 - 112
IEEE Consumer Electronics Magazine - March 2018 - 113
IEEE Consumer Electronics Magazine - March 2018 - 114
IEEE Consumer Electronics Magazine - March 2018 - 115
IEEE Consumer Electronics Magazine - March 2018 - 116
IEEE Consumer Electronics Magazine - March 2018 - 117
IEEE Consumer Electronics Magazine - March 2018 - 118
IEEE Consumer Electronics Magazine - March 2018 - 119
IEEE Consumer Electronics Magazine - March 2018 - 120
IEEE Consumer Electronics Magazine - March 2018 - Cover3
IEEE Consumer Electronics Magazine - March 2018 - Cover4
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20240102
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20231112
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20230910
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20230708
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20230506
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20230304
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20230102
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20221112
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20220910
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20220708
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20220506
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20220304
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20220102
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20211112
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20210910
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20210708
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20210506
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_20210304
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_202010
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_202009
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_202007
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_202004
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_202003
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_202001
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_201910
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_201909
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_201907
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_201905
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_201903
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_201901
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_201811
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_201809
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_201807
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_201805
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_201803
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_july2017
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_april2017
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_january2017
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_october2016
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_july2016
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_april2016
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_january2016
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_october2015
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_july2015
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_april2015
https://www.nxtbook.com/nxtbooks/ieee/consumerelectronics_january2015
https://www.nxtbookmedia.com