Systems, Man & Cybernetics - January 2017 - 17

shortcomings, equipping HOTL RAS with full autonomy has
become the Holy Grail.
Legal and regulatory frameworks need to be revised to
keep up with the technological advances. The current lack
of clarity in the legislation and laws in handling incidents
pertaining to HOTL RAS technologies poses an important
issue that needs to be resolved. Nevertheless, there is no
doubt that humans and RAS should work in harmony,
maximizing the strength of both. Indeed, the real frontier
is collaboration between RAS and humans, which includes
trusted autonomy. However, different levels of autonomy
in different RAS technologies should be imposed under the
control of a human supervisor. It is imperative that the
human component be at the heart of RAS capabilities.
As it is inconvenient and in some cases unsafe to use
untested RAS close to humans or where human lives are
involved, RAS must be deployed with restricted functionality as assistants to humans until a testing procedure is
completed in the future. Therefore, newly produced HOTL
RAS should operate only under supervision by humans for
all the critical tasks where humans could be at risk, and
they should be given more duties only when their ethical
decision making, evaluation, and learning algorithms
become more effective and efficient.

Transfer Group. Horsham, U.K. [Online]. Available: https://connect.innovateuk.org/
documents/2903012/16074728/RAS%20UK%20Strategy?version=1.0
[10] S. Welsh. (2016, Jan. 28). We need to keep humans in the loop when robots fight
wars. The Conversation. [Online]. Available: http://theconversation.com/we-needto-keep-humans-in-the-loop-when-robots-fight-wars-53641
[11] D. G. Johnson and M. E. Noorman, "Responsibility practices in robotic warfare,"
Military Rev., vol. 94, no. 3, pp. 12-21, May-June 2014.
[12] J. D. Lee and K. A. See, "Trust in automation: Designing for appropriate reliance,"
Human Factors: J. Human Factors and Ergonom. Soc., vol. 46, no. 1, pp.
50-80, Mar. 2004.
[13] A. Lacher, R. Grabowski, and S. Cook, "Autonomy, trust, and transportation,"
in Proc. 2014 Assoc. Advancement Artificial Intelligence Spring Symp.
Series, pp. 42-49.
[14] S. Behere and M. Törngren, "A functional reference architecture for autonomous
driving," Inform. Software Technol., vol. 73, pp. 136-150, May 2016.
[15] J. R. Boyd, "The essence of winning and losing," unpublished lecture notes, 1996.
[16] W. C. Marra and S. K. McNeil. (2012, May). "Understanding 'the loop': Autonomy,
system decision-making, and the next generation of war machines." Lawfare Research
Paper Series, Research Paper No. 1-2012. [Online]. Available: https://lawfare.s3-uswest-2.amazonaws.com/staging/s3fs-public/uploads/2012/05/SSRN-id2051596.pdf
[17] B. T. Thomas, "Autonomous weapon systems: The anatomy of autonomy and the
legality of lethality," Houston J. Int. Law, vol. 37, no. 1, Jan. 2015.
[18] S. E. McIntosh, "The wingman-philosopher of MiG Alley: John Boyd and the OODA
loop," Air Power Hist., vol. 58, no. 4, pp. 24, Dec. 2011.
[19] M. Endsley, "Autonomous horizons: System autonomy in the Air Force-A path

About the Author
Saeid Nahavandi (saeid.nahavandi@deakin.edu.au) is
with the Institute for Intelligent Systems Research and
Innovation, Deakin University, Victoria, Australia.

to the future (Volume I: Human autonomy teaming)," Dept. Chief Scientist, U.S. Air
Force, Washington, D.C., Rep. No. AF/ST TR 15-01, June 2015.
[20] T. B. Sheridan, T. Vámos, and S. Aida, "Adapting automation to man, culture and
society," Automatica, vol. 19, no. 6, pp. 605-612, Nov. 1983.
[21] K. A. Hoff and M. Bashir, "Trust in automation integrating empirical evidence

References

on factors that influence trust," Human Factors: J. Human Factors and

[1] D. P. Watson and D. H. Scheidt, "Autonomous systems," Johns Hopkins APL

Ergonom. Soc., vol. 57, no. 3, pp. 407-434, May 2014.

Tech. Dig., vol. 26, no. 4, pp. 368-376, 2005.

[22] M. Fisher, L. Dennis, and M. Webster, "Verifying autonomous systems," Commun.

[2] J. Beer, A. D. Fisk, and W. A. Rogers, "Toward a framework for levels of robot

ACM, vol. 56, no. 9, pp. 84-93, Sep. 2013.

autonomy in human-robot interaction," J. Human-Robot Interaction, vol. 3, no. 2,

[23] T. B. Sheridan, "Human-robot interaction: Status and challenges," Human Fac-

pp. 74-99, 2014.

tors: J. Human Factors and Ergonom. Soc., vol. 58, no. 4, pp. 525-532, June

[3] P. Scharre and M. Horowitz, "An introduction to autonomy in weapon systems"

2016.

(working paper), Center for a New American Security, Washington, D.C., Feb. 2015.

[24] M. Barnes and F. Jentsch, Eds., Human-Robot Interactions in Future Mili-

[4] D. H. McKnight and N. L. Chervany, "What trust means in e-commerce customer

tary Operations. Boca Raton, FL: CRC, 2010.

relationships: An interdisciplinary conceptual typology," Int. J. Electron. Com-

[25] D. Feil-Seifer and M. J. Mataric,´ "Human-robot interaction," in Encyclopedia of

merce, vol. 6, no. 2, pp. 35-59, Dec. 2001.

Complexity and Systems Science. New York: Springer-Verlag, 2009, pp. 4643-4659.

[5] M. Aitken, N. Ahmed, D. Lawrence, B. Argrow, and E. Frew, "Assurances and machine

[26] B. Durán and S. Thill, "Rob's robot: Current and future challenges for humanoid

self-confidence for enhanced trust in autonomous systems," in Proc. Robotics: Science

robots," in The Future of Humanoid Robots: Research and Applications,

and Systems Workshop on Social Trust in Autonomous Systems, Ann Arbor, MI, 2016.

Riadh Zaier, Ed. Rijeka, Croatia: INTECH Open, 2012.

[6] A. Smith and J. Anderson. (2014, Aug.). AI, robotics, and the future of jobs. Pew

[27] I. J. Cox and G. Wilfong, Eds., Autonomous Robot Vehicles. New York:

Research Center. Washington, D.C. [Online]. Available: http://www.pewinternet.org/

Springer-Verlag, 1990.

files/2014/08/Future-of-AI-Robotics-and-Jobs.pdf

[28] S. Nahavandi, "Robot-based motion simulators using washout filtering: Dynamic,

[7] R. Siegwart, I. R. Nourbakhsh, and D. Scaramuzza, Introduction to Autono-

immersive land, air, and sea vehicle training, vehicle virtual prototyping, and testing,"

mous Mobile Robots. Cambridge, MA: MIT Press, 2011.

IEEE Syst., Man, Cybern. Mag., vol. 2, no. 3, pp. 6-10, July 2016.

[8] J. Manyika, M. Chui, J. Bughin, R. Dobbs, P. Bisson, and A. Marrs. (2013, May).

[29] K. Koscher, A. Czeskis, F. Roesner, S. Patel, T. Kohno, S. Checkoway, D. McCoy, B.

Disruptive technologies: Advances that will transform life, business, and the global

Kantor, D. Anderson, H. Shacham, and S. Savage, "Experimental security analysis of a

economy. McKinsey Global Institute. San Francisco, CA. [Online]. Available: http://

modern automobile," in Proc. 2010 IEEE Symp. Security and Privacy, 2010,

www.mckinsey.com/business-functions/digital-mckinsey/our-insights/disruptive-

pp. 447-462.

technologies

[30] S. Russell. (2015, May 27). Ethics of artificial intelligence. Nature. [Online].

[9] D. Lane and R. Buckingham. (2014, July). RAS 2020: Robotics and autonomous

Available: losnuevosguerreros.org/pluginfile.php/16/mod_glossary/attachment/1279/

systems. Robotics and Autonomous Systems Special Interest Group, The Knowledge

Ethics%20of%20artificial%20intelligence.pdf

Ja nu a r y 2017

IEEE SyStEmS, man, & CybErnEtICS magazInE

17
https://connect.innovateuk.org/ http://www.theconversation.com/we-need https://www.lawfare.s3-us http://west-2.amazonaws.com/staging/s3fs-public/uploads/2012/05/SSRN-id2051596.pdf http://www.pewinternet.org/ http://http:// http://www.mckinsey.com/business-functions/digital-mckinsey/our-insights/disruptive http://www.losnuevosguerreros.org/pluginfile.php/16/mod_glossary/attachment/1279/
Table of Contents for the Digital Edition of Systems, Man & Cybernetics - January 2017
