IEEE Systems, Man and Cybernetics Magazine - April 2022 - 14

framework and ICD approach as
an enduring strategy with guiding
principles for the development of
the NATO standards " Guidance on
Sense and Avoid for UAS " and
" Human Systems Integration Guidance
for UAS " to support the
efforts of integrating UASs into the
nonsegregated civilian airspace
[37], [38]. The related IAS design
and development processes have
been regarded as validated best
practices and advocated through
the invited NATO Lecture Series
on UAS technical challenges, concepts
of operations, and regulatory
issues [39]-[41].
An effective IAS
should enable
machine adaptivity
through dynamic
interactions between
humans and machines
and, thus, foster
the development,
maintenance, and
assurance of
mutual trust.
Impacts: A Trust Model for
Human-Machine Symbiotic
Partnership
An IAS requires active human-machine interactivity at the
highest level where both human and machine support each
other proactively. It means that system control (authority)
and responsibilities can be transferred safely between the
partners whenever necessary. Thus, a trusted relationship
needs to be built and maintained through dynamic interactions.
Trust has then been identified as a key element and a
" fundamental enabler " of a collaborative IAS decisionmaking
capability [42].
Trust is a psychosocial relationship between entities or
agents capable of acting. It is commonly understood as a
cognitive process and a relational mediator for interactions
among humans, humans and organizations, and
human-machine teaming. A variety of models examines
trust factors and describes the development of trust in
automation, cloud computing,
blockchains, and Industry 4.0
smart manufacturing [4], [43]-[45].
However,
these trust models,
although comprehensive, may not
consider dimensions related to the
ever-increasing AI capabilities and
their impacts on the aggregated
decision-making powers that
reside in IASs.
The IMPACTS Trust Model
As machines evolve into highly
autonomous functions of IASs
with greater AI decision-making
capabilities, the studies in [42] and
[46] have suggested that the
human-machine trust relationship
should more closely mi r ror
human-to-human trust to reflect
the dynamic and complex nature
Performance
Measurability
Intention
Transparency
Communication
Adaptivity
Security
of human-autonomy teaming. Trust is a function of
capability and integrity for human relationships [42].
Human trust in technologies cannot exist without either of
these two variables. Technologically, IASs with AI-enabled
autonomous functions are more capable than their human
partners in certain areas. To build up human-like integrity,
the IMPACTS model has been developed for IASs to exhibit
seven characteristics to gain actual trust from humans
[42]. As illustrated in Figure 3, the defining integrity
characteristics of the model are shared intention, performance
measurability, predictable and reliable performance,
context adaptivity, bidirectional communication,
optimal transparency, and protective security.
◆ Intention: A collaborative partnership should have the
desire for mutual support. The chosen desires are
defined as intentions to which a machine commits
efforts and resources for achieving the goals to help its
human partners. The machine should know what
humans are trying to achieve such that it may pursue
actions that achieve its intention to help. Meanwhile,
understanding a machine's supportive intention
toward a common goal serves as a starting point for
humans to trust their machine partner. Thus, the
design of an IAS should allow the demonstration of
shared intentions of humans and machines through
their social interactions.
Trust
Figure 3. An IMPACTS trust model to exhibit the seven
integrity characteristics of an IAS based on ICD
methodology.
14 IEEE SYSTEMS, MAN, & CYBERNETICS MAGAZINE April 2022
◆ Measurability: The development of trust is a dynamic
process and should not be undermined by a single
instant. One may not trust words and may even question
actions, but one should not doubt patterns. The
same human-human relational philosophy can be
applied to the human-machine partnership, where
an AI entity may be complex and opaque. AI entities
should be measurable such that their behaviors may
be observed, their actions measured, and their
IEEE Systems, Man and Cybernetics Magazine - April 2022

Table of Contents for the Digital Edition of IEEE Systems, Man and Cybernetics Magazine - April 2022
