IEEE Systems, Man and Cybernetics Magazine - January 2020 - 43

initial success of the so-called intelligent space and ubiquitous computing concepts in robotics [1], several elaborated
implementations emerged, demonstrating distributed architectures supporting robotic research [2]. Component-based
software frameworks, such as the Robotic Operating System (ROS) [3], [4] and RT-Middleware [4], are good bases for
considering scalable cloud services; however, the original
designs of these middlewares do not consider the clouddriven use case. Regardless, there are some promising
efforts built around utilizing ROS as the backbone for cloudpowered setups [5], [6]. Among the numerous workarounds,
Rosbridge [7], [8] and RobotWebTools (roslibjs) [9] have
been proven to be the most propitious.
Considering the cloud computing paradigms, various
goals can be defined within cloud-related robotics research.
On the one hand, the robotics analogy of the Software as a
Service (SaaS) concept can be defined as Skill as a Service. On the other hand, let us consider an inverted scenario where the physical robots represent the infrastructure
with minimal onboard functionality in which those robots
are animated by the high-level control manifested in complex cloud services (like Skynet in the Terminator movies
[10]). This conceptual framework is depicted in Figure 1.
This article is aimed at finding a good balance between
onboard and cloud execution. After the general discussions, a real-world industrial example is reviewed that
uses cloud resources to deal with the unstructured environment effectively.

approach that puts everything onboard to the entirely
cloud-based robots where the physical device is only
responsible for sensing and actuation. Let us refer to this
latter case as a puppet robot.
Virtual assistants, like Amazon's Alexa or the Google
Home devices, are precursors of the puppet robotics era.
These units currently lack motion capabilities, but it is
easy to imagine the next level when digital assistant technology and the Internet of Skills move into mechanically
capable humanoids.
Architectural Challenges and Key
Technologies
Very few, if any, technologies exist that were specially tailored for cloud robotics. Nevertheless, many existing frameworks and techniques contribute to the field. In this section,
I mention some of these for reference, focusing on their
future perspectives.
Before reviewing the technological pieces, I will define
two distinct sets of cloud robotics services (skills) and
consider their contextual conditions.
◆ Context-free services: These services neither need
much information about the current state nor the internal specifics of the target application. Typical
examples are text-to-speech, speech-to-text, or even

b
ra
lne
Vu isk
R
m
co )
fo G
In ., 5
.g
(e

ds

en

Tr

Motion
Interpolation
Safety
SLAM
Functions
Servo
Loops
Motion
HMI Planning

y

Required Data Rate

Onboard

ilit

Cloud
Vision-Based
Object Recognition
Speech
Processing

Acceptable Latency
Figure 2. The tradeoff between real-time requirements

Cloud Robotics
All Functions Are
Onboard

Puppet
Robots

and cloud execution. HMI: human-machine interface.

Conventional
Robotics

Balance of Onboard and Cloud Execution
In system design, engineers must decide where to execute
a given computation considering the practical aspects of a
highly complex system. Without the claim to completeness, onboard battery capacity, CPU performance, and
memory and storage limitations are the primary features
opposed to network latency/throughput and requirements
of real-time operation. Figure 2 provides a qualitative overview inspired by the RoboEarth project [11], [12], a pioneer
of cloud robotics, which made significant advancements in
the elaboration of the so-called train one, train all knowledge-sharing concept.
In an ideal situation (such as unlimited bandwidth and
zero latency), the curve could meet the vertical axis. One
focus of 5G mobile communication is to provide suitable
qualities even for applications that include fastidious forcebased interactions [13], bringing the so-called tactile Internet concept into reality [14]. The current situation is not as
bright: safety-critical functionalities and real-time features
are still running onboard, and there is no chance of changing it quickly even after the debut of 5G in 2020. However, a
very useful set of noncritical features, such as speech processing, mapping, and path/motion planning can be cloud
sourced. This is an obvious manifestation of the Internet of
Skills paradigm [13].
As Figure 3 suggests, the onboard versus cloud-sourced
spectrum spreads from the conventional industrial

Only Sensing and
Actuation Onboard

Figure 3. The extremities of robot control implemen-

tations on the spectrum of onboard versus cloud
execution.

Ja nu a r y 2020

IEEE SYSTEMS, MAN, & CYBERNETICS MAGAZINE

43



IEEE Systems, Man and Cybernetics Magazine - January 2020

Table of Contents for the Digital Edition of IEEE Systems, Man and Cybernetics Magazine - January 2020

Contents
IEEE Systems, Man and Cybernetics Magazine - January 2020 - Cover1
IEEE Systems, Man and Cybernetics Magazine - January 2020 - Cover2
IEEE Systems, Man and Cybernetics Magazine - January 2020 - Contents
IEEE Systems, Man and Cybernetics Magazine - January 2020 - 2
IEEE Systems, Man and Cybernetics Magazine - January 2020 - 3
IEEE Systems, Man and Cybernetics Magazine - January 2020 - 4
IEEE Systems, Man and Cybernetics Magazine - January 2020 - 5
IEEE Systems, Man and Cybernetics Magazine - January 2020 - 6
IEEE Systems, Man and Cybernetics Magazine - January 2020 - 7
IEEE Systems, Man and Cybernetics Magazine - January 2020 - 8
IEEE Systems, Man and Cybernetics Magazine - January 2020 - 9
IEEE Systems, Man and Cybernetics Magazine - January 2020 - 10
IEEE Systems, Man and Cybernetics Magazine - January 2020 - 11
IEEE Systems, Man and Cybernetics Magazine - January 2020 - 12
IEEE Systems, Man and Cybernetics Magazine - January 2020 - 13
IEEE Systems, Man and Cybernetics Magazine - January 2020 - 14
IEEE Systems, Man and Cybernetics Magazine - January 2020 - 15
IEEE Systems, Man and Cybernetics Magazine - January 2020 - 16
IEEE Systems, Man and Cybernetics Magazine - January 2020 - 17
IEEE Systems, Man and Cybernetics Magazine - January 2020 - 18
IEEE Systems, Man and Cybernetics Magazine - January 2020 - 19
IEEE Systems, Man and Cybernetics Magazine - January 2020 - 20
IEEE Systems, Man and Cybernetics Magazine - January 2020 - 21
IEEE Systems, Man and Cybernetics Magazine - January 2020 - 22
IEEE Systems, Man and Cybernetics Magazine - January 2020 - 23
IEEE Systems, Man and Cybernetics Magazine - January 2020 - 24
IEEE Systems, Man and Cybernetics Magazine - January 2020 - 25
IEEE Systems, Man and Cybernetics Magazine - January 2020 - 26
IEEE Systems, Man and Cybernetics Magazine - January 2020 - 27
IEEE Systems, Man and Cybernetics Magazine - January 2020 - 28
IEEE Systems, Man and Cybernetics Magazine - January 2020 - 29
IEEE Systems, Man and Cybernetics Magazine - January 2020 - 30
IEEE Systems, Man and Cybernetics Magazine - January 2020 - 31
IEEE Systems, Man and Cybernetics Magazine - January 2020 - 32
IEEE Systems, Man and Cybernetics Magazine - January 2020 - 33
IEEE Systems, Man and Cybernetics Magazine - January 2020 - 34
IEEE Systems, Man and Cybernetics Magazine - January 2020 - 35
IEEE Systems, Man and Cybernetics Magazine - January 2020 - 36
IEEE Systems, Man and Cybernetics Magazine - January 2020 - 37
IEEE Systems, Man and Cybernetics Magazine - January 2020 - 38
IEEE Systems, Man and Cybernetics Magazine - January 2020 - 39
IEEE Systems, Man and Cybernetics Magazine - January 2020 - 40
IEEE Systems, Man and Cybernetics Magazine - January 2020 - 41
IEEE Systems, Man and Cybernetics Magazine - January 2020 - 42
IEEE Systems, Man and Cybernetics Magazine - January 2020 - 43
IEEE Systems, Man and Cybernetics Magazine - January 2020 - 44
IEEE Systems, Man and Cybernetics Magazine - January 2020 - 45
IEEE Systems, Man and Cybernetics Magazine - January 2020 - 46
IEEE Systems, Man and Cybernetics Magazine - January 2020 - 47
IEEE Systems, Man and Cybernetics Magazine - January 2020 - 48
IEEE Systems, Man and Cybernetics Magazine - January 2020 - 49
IEEE Systems, Man and Cybernetics Magazine - January 2020 - 50
IEEE Systems, Man and Cybernetics Magazine - January 2020 - 51
IEEE Systems, Man and Cybernetics Magazine - January 2020 - 52
IEEE Systems, Man and Cybernetics Magazine - January 2020 - 53
IEEE Systems, Man and Cybernetics Magazine - January 2020 - 54
IEEE Systems, Man and Cybernetics Magazine - January 2020 - 55
IEEE Systems, Man and Cybernetics Magazine - January 2020 - 56
IEEE Systems, Man and Cybernetics Magazine - January 2020 - Cover3
IEEE Systems, Man and Cybernetics Magazine - January 2020 - Cover4
https://www.nxtbook.com/nxtbooks/ieee/smc_202310
https://www.nxtbook.com/nxtbooks/ieee/smc_202307
https://www.nxtbook.com/nxtbooks/ieee/smc_202304
https://www.nxtbook.com/nxtbooks/ieee/smc_202301
https://www.nxtbook.com/nxtbooks/ieee/smc_202210
https://www.nxtbook.com/nxtbooks/ieee/smc_202207
https://www.nxtbook.com/nxtbooks/ieee/smc_202204
https://www.nxtbook.com/nxtbooks/ieee/smc_202201
https://www.nxtbook.com/nxtbooks/ieee/smc_202110
https://www.nxtbook.com/nxtbooks/ieee/smc_202107
https://www.nxtbook.com/nxtbooks/ieee/smc_202104
https://www.nxtbook.com/nxtbooks/ieee/smc_202101
https://www.nxtbook.com/nxtbooks/ieee/smc_202010
https://www.nxtbook.com/nxtbooks/ieee/smc_202007
https://www.nxtbook.com/nxtbooks/ieee/smc_202004
https://www.nxtbook.com/nxtbooks/ieee/smc_202001
https://www.nxtbook.com/nxtbooks/ieee/smc_201910
https://www.nxtbook.com/nxtbooks/ieee/smc_201907
https://www.nxtbook.com/nxtbooks/ieee/smc_201904
https://www.nxtbook.com/nxtbooks/ieee/smc_201901
https://www.nxtbook.com/nxtbooks/ieee/smc_201810
https://www.nxtbook.com/nxtbooks/ieee/smc_201807
https://www.nxtbook.com/nxtbooks/ieee/smc_201804
https://www.nxtbook.com/nxtbooks/ieee/smc_201801
https://www.nxtbook.com/nxtbooks/ieee/systems_man_cybernetics_1017
https://www.nxtbook.com/nxtbooks/ieee/systems_man_cybernetics_0717
https://www.nxtbook.com/nxtbooks/ieee/systems_man_cybernetics_0417
https://www.nxtbook.com/nxtbooks/ieee/systems_man_cybernetics_0117
https://www.nxtbook.com/nxtbooks/ieee/systems_man_cybernetics_1016
https://www.nxtbook.com/nxtbooks/ieee/systems_man_cybernetics_0716
https://www.nxtbook.com/nxtbooks/ieee/systems_man_cybernetics_0416
https://www.nxtbook.com/nxtbooks/ieee/systems_man_cybernetics_0116
https://www.nxtbook.com/nxtbooks/ieee/systems_man_cybernetics_1015
https://www.nxtbook.com/nxtbooks/ieee/systems_man_cybernetics_0715
https://www.nxtbook.com/nxtbooks/ieee/systems_man_cybernetics_0415
https://www.nxtbook.com/nxtbooks/ieee/systems_man_cybernetics_0115
https://www.nxtbookmedia.com