Instrumentation & Measurement Magazine 24-3 - 79

Fig. 1. Samples of multi-face tracking on our benchmark.

kind of feature-based approaches can be very successful in constraint settings where a single face has to be tracked or matched
with another face. They are usually preferable to simple colorbased trackers as used by Lo et al. [18] which need to integrate
different visual cues for speaker localization in video conferencing. Later, Cordea et al. [19] improve tracking accuracy with
an active appearance model for three-dimensional head tracking which enables them to recover facial expressions. Deng et al.
[20] used five cameras to capture a sleeper's face and also performed template matching for face tracking. Omidyeganeh et al.
[21] use the Viola-Jones [22] face detector to track faces of yawning drivers. Liu et al. [23] also use the Viola-Jones face detector
in pre-processing video frames in their pulse-rate detection
method. Arguably, object detectors using deep learning with a
matching strategy based on Deep SORT will offer better accuracy, faster tracking speed and will be simpler to implement.

Face Tracking
In this section, we describe in detail the methods that we
have chosen to build our multi-face tracker from standard
May 2021	

components. The overall multi-face detection and tracking
matching strategy that we decided to implement is summarized in the flow diagram in Fig. 2. The red boxes indicate the
specific adaption necessary to apply Deep SORT for multi-face
tracking.

Multi-Object Detectors
In general, in multi-object detection, the overall architecture
also known as the meta-architecture includes the regions of
interest generator, the feature extractor, classification and
regression. Under the same meta-architecture, the feature
extractor, or backbone, can be replaced by different CNNs.
The final classification of general purpose object-detectors needs to be modified for task-at-hand. While backbone
networks are commonly pre-trained to classify the 80 categories of COCO [24], the multi-class classifier needs to be
replaced with a binary classifier. This classifier is to be trained
to distinguish faces from other, non-face objects based on
ground-truth labels. Likewise, the loss functions can vary with
the same meta-architecture, which leads directly to different

IEEE Instrumentation & Measurement Magazine	79



Instrumentation & Measurement Magazine 24-3

Table of Contents for the Digital Edition of Instrumentation & Measurement Magazine 24-3

No label
Instrumentation & Measurement Magazine 24-3 - No label
Instrumentation & Measurement Magazine 24-3 - Cover2
Instrumentation & Measurement Magazine 24-3 - 1
Instrumentation & Measurement Magazine 24-3 - 2
Instrumentation & Measurement Magazine 24-3 - 3
Instrumentation & Measurement Magazine 24-3 - 4
Instrumentation & Measurement Magazine 24-3 - 5
Instrumentation & Measurement Magazine 24-3 - 6
Instrumentation & Measurement Magazine 24-3 - 7
Instrumentation & Measurement Magazine 24-3 - 8
Instrumentation & Measurement Magazine 24-3 - 9
Instrumentation & Measurement Magazine 24-3 - 10
Instrumentation & Measurement Magazine 24-3 - 11
Instrumentation & Measurement Magazine 24-3 - 12
Instrumentation & Measurement Magazine 24-3 - 13
Instrumentation & Measurement Magazine 24-3 - 14
Instrumentation & Measurement Magazine 24-3 - 15
Instrumentation & Measurement Magazine 24-3 - 16
Instrumentation & Measurement Magazine 24-3 - 17
Instrumentation & Measurement Magazine 24-3 - 18
Instrumentation & Measurement Magazine 24-3 - 19
Instrumentation & Measurement Magazine 24-3 - 20
Instrumentation & Measurement Magazine 24-3 - 21
Instrumentation & Measurement Magazine 24-3 - 22
Instrumentation & Measurement Magazine 24-3 - 23
Instrumentation & Measurement Magazine 24-3 - 24
Instrumentation & Measurement Magazine 24-3 - 25
Instrumentation & Measurement Magazine 24-3 - 26
Instrumentation & Measurement Magazine 24-3 - 27
Instrumentation & Measurement Magazine 24-3 - 28
Instrumentation & Measurement Magazine 24-3 - 29
Instrumentation & Measurement Magazine 24-3 - 30
Instrumentation & Measurement Magazine 24-3 - 31
Instrumentation & Measurement Magazine 24-3 - 32
Instrumentation & Measurement Magazine 24-3 - 33
Instrumentation & Measurement Magazine 24-3 - 34
Instrumentation & Measurement Magazine 24-3 - 35
Instrumentation & Measurement Magazine 24-3 - 36
Instrumentation & Measurement Magazine 24-3 - 37
Instrumentation & Measurement Magazine 24-3 - 38
Instrumentation & Measurement Magazine 24-3 - 39
Instrumentation & Measurement Magazine 24-3 - 40
Instrumentation & Measurement Magazine 24-3 - 41
Instrumentation & Measurement Magazine 24-3 - 42
Instrumentation & Measurement Magazine 24-3 - 43
Instrumentation & Measurement Magazine 24-3 - 44
Instrumentation & Measurement Magazine 24-3 - 45
Instrumentation & Measurement Magazine 24-3 - 46
Instrumentation & Measurement Magazine 24-3 - 47
Instrumentation & Measurement Magazine 24-3 - 48
Instrumentation & Measurement Magazine 24-3 - 49
Instrumentation & Measurement Magazine 24-3 - 50
Instrumentation & Measurement Magazine 24-3 - 51
Instrumentation & Measurement Magazine 24-3 - 52
Instrumentation & Measurement Magazine 24-3 - 53
Instrumentation & Measurement Magazine 24-3 - 54
Instrumentation & Measurement Magazine 24-3 - 55
Instrumentation & Measurement Magazine 24-3 - 56
Instrumentation & Measurement Magazine 24-3 - 57
Instrumentation & Measurement Magazine 24-3 - 58
Instrumentation & Measurement Magazine 24-3 - 59
Instrumentation & Measurement Magazine 24-3 - 60
Instrumentation & Measurement Magazine 24-3 - 61
Instrumentation & Measurement Magazine 24-3 - 62
Instrumentation & Measurement Magazine 24-3 - 63
Instrumentation & Measurement Magazine 24-3 - 64
Instrumentation & Measurement Magazine 24-3 - 65
Instrumentation & Measurement Magazine 24-3 - 66
Instrumentation & Measurement Magazine 24-3 - 67
Instrumentation & Measurement Magazine 24-3 - 68
Instrumentation & Measurement Magazine 24-3 - 69
Instrumentation & Measurement Magazine 24-3 - 70
Instrumentation & Measurement Magazine 24-3 - 71
Instrumentation & Measurement Magazine 24-3 - 72
Instrumentation & Measurement Magazine 24-3 - 73
Instrumentation & Measurement Magazine 24-3 - 74
Instrumentation & Measurement Magazine 24-3 - 75
Instrumentation & Measurement Magazine 24-3 - 76
Instrumentation & Measurement Magazine 24-3 - 77
Instrumentation & Measurement Magazine 24-3 - 78
Instrumentation & Measurement Magazine 24-3 - 79
Instrumentation & Measurement Magazine 24-3 - 80
Instrumentation & Measurement Magazine 24-3 - 81
Instrumentation & Measurement Magazine 24-3 - 82
Instrumentation & Measurement Magazine 24-3 - 83
Instrumentation & Measurement Magazine 24-3 - 84
Instrumentation & Measurement Magazine 24-3 - 85
Instrumentation & Measurement Magazine 24-3 - 86
Instrumentation & Measurement Magazine 24-3 - 87
Instrumentation & Measurement Magazine 24-3 - 88
Instrumentation & Measurement Magazine 24-3 - 89
Instrumentation & Measurement Magazine 24-3 - 90
Instrumentation & Measurement Magazine 24-3 - 91
Instrumentation & Measurement Magazine 24-3 - 92
Instrumentation & Measurement Magazine 24-3 - 93
Instrumentation & Measurement Magazine 24-3 - 94
Instrumentation & Measurement Magazine 24-3 - 95
Instrumentation & Measurement Magazine 24-3 - 96
Instrumentation & Measurement Magazine 24-3 - 97
Instrumentation & Measurement Magazine 24-3 - 98
Instrumentation & Measurement Magazine 24-3 - 99
Instrumentation & Measurement Magazine 24-3 - 100
Instrumentation & Measurement Magazine 24-3 - Cover3
Instrumentation & Measurement Magazine 24-3 - Cover4
https://www.nxtbook.com/allen/iamm/26-6
https://www.nxtbook.com/allen/iamm/26-5
https://www.nxtbook.com/allen/iamm/26-4
https://www.nxtbook.com/allen/iamm/26-3
https://www.nxtbook.com/allen/iamm/26-2
https://www.nxtbook.com/allen/iamm/26-1
https://www.nxtbook.com/allen/iamm/25-9
https://www.nxtbook.com/allen/iamm/25-8
https://www.nxtbook.com/allen/iamm/25-7
https://www.nxtbook.com/allen/iamm/25-6
https://www.nxtbook.com/allen/iamm/25-5
https://www.nxtbook.com/allen/iamm/25-4
https://www.nxtbook.com/allen/iamm/25-3
https://www.nxtbook.com/allen/iamm/instrumentation-measurement-magazine-25-2
https://www.nxtbook.com/allen/iamm/25-1
https://www.nxtbook.com/allen/iamm/24-9
https://www.nxtbook.com/allen/iamm/24-7
https://www.nxtbook.com/allen/iamm/24-8
https://www.nxtbook.com/allen/iamm/24-6
https://www.nxtbook.com/allen/iamm/24-5
https://www.nxtbook.com/allen/iamm/24-4
https://www.nxtbook.com/allen/iamm/24-3
https://www.nxtbook.com/allen/iamm/24-2
https://www.nxtbook.com/allen/iamm/24-1
https://www.nxtbook.com/allen/iamm/23-9
https://www.nxtbook.com/allen/iamm/23-8
https://www.nxtbook.com/allen/iamm/23-6
https://www.nxtbook.com/allen/iamm/23-5
https://www.nxtbook.com/allen/iamm/23-2
https://www.nxtbook.com/allen/iamm/23-3
https://www.nxtbook.com/allen/iamm/23-4
https://www.nxtbookmedia.com