IEEE Robotics & Automation Magazine - September 2021 - 53

well as on the modes that can be profitably used to grasp
them. Picking tasks, the vast majority of which are currently
executed by human operators, can be classified into two
main categories: those that can be accomplished with one
hand and those that must be accomplished with two hands.
The problem of picking objects with a single end effector
has been extensively treated in the literature and in previous
articles of ours [42], [15]. The present article focuses
on the problem of picking objects that humans cannot pick
with one hand. Notably, the solution proposed here will
accomplish both categories of picking tasks. In the following,
a list of items that represents 40% of the volume of a
food warehouse is reported together with their main features.
Note that the food and beverage segment is one of
the market segments most affected by the e-commerce revolution,
which today allows customers to have their shopping
bags delivered directly to their homes. In the next
sections, we consider the functional requirements a picking
system should satisfy in order to work in such a warehouse
profitably. Finally, we describe the main challenges to be
tackled in the design and realization of this device.
Objects
The complete list of objects to be picked, along with their
size and weight, is reported in Figure 2. The objects can be
grouped into two sets depending on their shape: boxes or
cylinders. For the boxes, the values for the length (L),
height (H), and width (W) expressed in centimeters are
reported, while for the cylinders, the values for the diameter
(D) and height (H) are listed.
Functional Requirements
A list of functional requirements that a picking system
should match is reported in Table 1. It is important to stress
that these should not be taken as absolute values for every
intralogistics company but, rather, for operators that manage
a set of objects comparable to the one reported in Figure
2. These requirements are grouped into key
performance areas and indicators. Their quantitative value
should be considered as a target for the picking system.
Productivity performance indicators have been computed
based on the fact that such a robot would be economically
sustainable if it were able to perform three picking
movements every minute (corresponding to 180 picks per
hour). Given that a Euro-pallet (80- × 120-cm base piled up
to 1.5 m high) may contain up to 627 of the smallest or 115
of the largest among the objects reported in Figure 2, the
time needed to empty a pallet can be evaluated in 209 or
38 min, respectively. The average of these two values gives
the productivity performance indicator reported in Table 1.
The picking success rate takes into account the grasping
system without considering the vision system.
Challenges
The main challenges of the picking phase can be identified
as follows:
●
Boxes are often very close to each other, and the two
opposite sides, which are the most desirable for a reliable
and robust grasp, are usually not easily accessible. Hence,
to be properly handled, such boxes should first be moved
to guarantee that two opposite faces are accessible and
then picked.
●
Some items do not have a top surface, or the top surface
may not be suitable for grasping the object. These objects
cannot be grasped with vacuum grippers.
●
The bottom side of some objects is recessed under the
upper side of the objects that they lie under-or, more
generally, they cannot slide. This means that the objects
can translate only along the vertical direction or rotate
about a horizontal axis.
Human Picking Skills
There is no systematic method to synthesize all the requirements
listed in the section " Problem Definition " ; one of the
reasons is that it would
simultaneously involve the
codesign of the robot's
structure, planning, and
control. Hence, we ob -
served skilled human
operators at a food warehouse
during the exe -
cution of manipulation
tasks when picking the
objects listed in Figure 2.
That is, we recorded two
human operators from a
food warehouse while
performing the picking
action. Each picking action was repeated three times. These
live observations and the analysis of the video recordings
led to two lessons learned.
1) Bi-manual manipulation has a crucial role in picking operations
since humans use both hands to manipulate and handle
objects. In the majority of tasks, one hand is used to
move the object, and the other hand is used as a support.
Picking tasks, the vast
majority of which are
currently executed by
human operators, can be
classified into two
main categories.
2) The strategies human operators use to pick items are
classifiable into three main categories, as depending on
object shape and form, as depicted in Figure 3: rotation
about the horizontal axis, rotation about the vertical axis,
and sliding.
Rotation About the Horizontal Axis
In the case of thin boxes, i.e., H > W, H > L, and cylindrical
objects or if the support surface of an object cannot slide,
the operators use one hand to rotate the goods about a horizontal
axis and to put the object on the supporting hand
[see Figure 3(a)-(d)].
Rotation About the Vertical Axis
For thick boxes (H < W, H < L) with no constraints at the
base, the horizontal rotation is not convenient because of
SEPTEMBER 2021 * IEEE ROBOTICS & AUTOMATION MAGAZINE *
53

IEEE Robotics & Automation Magazine - September 2021

Table of Contents for the Digital Edition of IEEE Robotics & Automation Magazine - September 2021

Contents
IEEE Robotics & Automation Magazine - September 2021 - Cover1
IEEE Robotics & Automation Magazine - September 2021 - Cover2
IEEE Robotics & Automation Magazine - September 2021 - Contents
IEEE Robotics & Automation Magazine - September 2021 - 2
IEEE Robotics & Automation Magazine - September 2021 - 3
IEEE Robotics & Automation Magazine - September 2021 - 4
IEEE Robotics & Automation Magazine - September 2021 - 5
IEEE Robotics & Automation Magazine - September 2021 - 6
IEEE Robotics & Automation Magazine - September 2021 - 7
IEEE Robotics & Automation Magazine - September 2021 - 8
IEEE Robotics & Automation Magazine - September 2021 - 9
IEEE Robotics & Automation Magazine - September 2021 - 10
IEEE Robotics & Automation Magazine - September 2021 - 11
IEEE Robotics & Automation Magazine - September 2021 - 12
IEEE Robotics & Automation Magazine - September 2021 - 13
IEEE Robotics & Automation Magazine - September 2021 - 14
IEEE Robotics & Automation Magazine - September 2021 - 15
IEEE Robotics & Automation Magazine - September 2021 - 16
IEEE Robotics & Automation Magazine - September 2021 - 17
IEEE Robotics & Automation Magazine - September 2021 - 18
IEEE Robotics & Automation Magazine - September 2021 - 19
IEEE Robotics & Automation Magazine - September 2021 - 20
IEEE Robotics & Automation Magazine - September 2021 - 21
IEEE Robotics & Automation Magazine - September 2021 - 22
IEEE Robotics & Automation Magazine - September 2021 - 23
IEEE Robotics & Automation Magazine - September 2021 - 24
IEEE Robotics & Automation Magazine - September 2021 - 25
IEEE Robotics & Automation Magazine - September 2021 - 26
IEEE Robotics & Automation Magazine - September 2021 - 27
IEEE Robotics & Automation Magazine - September 2021 - 28
IEEE Robotics & Automation Magazine - September 2021 - 29
IEEE Robotics & Automation Magazine - September 2021 - 30
IEEE Robotics & Automation Magazine - September 2021 - 31
IEEE Robotics & Automation Magazine - September 2021 - 32
IEEE Robotics & Automation Magazine - September 2021 - 33
IEEE Robotics & Automation Magazine - September 2021 - 34
IEEE Robotics & Automation Magazine - September 2021 - 35
IEEE Robotics & Automation Magazine - September 2021 - 36
IEEE Robotics & Automation Magazine - September 2021 - 37
IEEE Robotics & Automation Magazine - September 2021 - 38
IEEE Robotics & Automation Magazine - September 2021 - 39
IEEE Robotics & Automation Magazine - September 2021 - 40
IEEE Robotics & Automation Magazine - September 2021 - 41
IEEE Robotics & Automation Magazine - September 2021 - 42
IEEE Robotics & Automation Magazine - September 2021 - 43
IEEE Robotics & Automation Magazine - September 2021 - 44
IEEE Robotics & Automation Magazine - September 2021 - 45
IEEE Robotics & Automation Magazine - September 2021 - 46
IEEE Robotics & Automation Magazine - September 2021 - 47
IEEE Robotics & Automation Magazine - September 2021 - 48
IEEE Robotics & Automation Magazine - September 2021 - 49
IEEE Robotics & Automation Magazine - September 2021 - 50
IEEE Robotics & Automation Magazine - September 2021 - 51
IEEE Robotics & Automation Magazine - September 2021 - 52
IEEE Robotics & Automation Magazine - September 2021 - 53
IEEE Robotics & Automation Magazine - September 2021 - 54
IEEE Robotics & Automation Magazine - September 2021 - 55
IEEE Robotics & Automation Magazine - September 2021 - 56
IEEE Robotics & Automation Magazine - September 2021 - 57
IEEE Robotics & Automation Magazine - September 2021 - 58
IEEE Robotics & Automation Magazine - September 2021 - 59
IEEE Robotics & Automation Magazine - September 2021 - 60
IEEE Robotics & Automation Magazine - September 2021 - 61
IEEE Robotics & Automation Magazine - September 2021 - 62
IEEE Robotics & Automation Magazine - September 2021 - 63
IEEE Robotics & Automation Magazine - September 2021 - 64
IEEE Robotics & Automation Magazine - September 2021 - 65
IEEE Robotics & Automation Magazine - September 2021 - 66
IEEE Robotics & Automation Magazine - September 2021 - 67
IEEE Robotics & Automation Magazine - September 2021 - 68
IEEE Robotics & Automation Magazine - September 2021 - 69
IEEE Robotics & Automation Magazine - September 2021 - 70
IEEE Robotics & Automation Magazine - September 2021 - 71
IEEE Robotics & Automation Magazine - September 2021 - 72
IEEE Robotics & Automation Magazine - September 2021 - 73
IEEE Robotics & Automation Magazine - September 2021 - 74
IEEE Robotics & Automation Magazine - September 2021 - 75
IEEE Robotics & Automation Magazine - September 2021 - 76
IEEE Robotics & Automation Magazine - September 2021 - 77
IEEE Robotics & Automation Magazine - September 2021 - 78
IEEE Robotics & Automation Magazine - September 2021 - 79
IEEE Robotics & Automation Magazine - September 2021 - 80
IEEE Robotics & Automation Magazine - September 2021 - 81
IEEE Robotics & Automation Magazine - September 2021 - 82
IEEE Robotics & Automation Magazine - September 2021 - 83
IEEE Robotics & Automation Magazine - September 2021 - 84
IEEE Robotics & Automation Magazine - September 2021 - 85
IEEE Robotics & Automation Magazine - September 2021 - 86
IEEE Robotics & Automation Magazine - September 2021 - 87
IEEE Robotics & Automation Magazine - September 2021 - 88
IEEE Robotics & Automation Magazine - September 2021 - 89
IEEE Robotics & Automation Magazine - September 2021 - 90
IEEE Robotics & Automation Magazine - September 2021 - 91
IEEE Robotics & Automation Magazine - September 2021 - 92
IEEE Robotics & Automation Magazine - September 2021 - 93
IEEE Robotics & Automation Magazine - September 2021 - 94
IEEE Robotics & Automation Magazine - September 2021 - 95
IEEE Robotics & Automation Magazine - September 2021 - 96
IEEE Robotics & Automation Magazine - September 2021 - 97
IEEE Robotics & Automation Magazine - September 2021 - 98
IEEE Robotics & Automation Magazine - September 2021 - 99
IEEE Robotics & Automation Magazine - September 2021 - 100
IEEE Robotics & Automation Magazine - September 2021 - 101
IEEE Robotics & Automation Magazine - September 2021 - 102
IEEE Robotics & Automation Magazine - September 2021 - 103
IEEE Robotics & Automation Magazine - September 2021 - 104
IEEE Robotics & Automation Magazine - September 2021 - 105
IEEE Robotics & Automation Magazine - September 2021 - 106
IEEE Robotics & Automation Magazine - September 2021 - 107
IEEE Robotics & Automation Magazine - September 2021 - 108
IEEE Robotics & Automation Magazine - September 2021 - 109
IEEE Robotics & Automation Magazine - September 2021 - 110
IEEE Robotics & Automation Magazine - September 2021 - 111
IEEE Robotics & Automation Magazine - September 2021 - 112
IEEE Robotics & Automation Magazine - September 2021 - 113
IEEE Robotics & Automation Magazine - September 2021 - 114
IEEE Robotics & Automation Magazine - September 2021 - 115
IEEE Robotics & Automation Magazine - September 2021 - 116
IEEE Robotics & Automation Magazine - September 2021 - 117
IEEE Robotics & Automation Magazine - September 2021 - 118
IEEE Robotics & Automation Magazine - September 2021 - 119
IEEE Robotics & Automation Magazine - September 2021 - 120
IEEE Robotics & Automation Magazine - September 2021 - 121
IEEE Robotics & Automation Magazine - September 2021 - 122
IEEE Robotics & Automation Magazine - September 2021 - 123
IEEE Robotics & Automation Magazine - September 2021 - 124
IEEE Robotics & Automation Magazine - September 2021 - 125
IEEE Robotics & Automation Magazine - September 2021 - 126
IEEE Robotics & Automation Magazine - September 2021 - 127
IEEE Robotics & Automation Magazine - September 2021 - 128
IEEE Robotics & Automation Magazine - September 2021 - 129
IEEE Robotics & Automation Magazine - September 2021 - 130
IEEE Robotics & Automation Magazine - September 2021 - 131
IEEE Robotics & Automation Magazine - September 2021 - 132
IEEE Robotics & Automation Magazine - September 2021 - 133
IEEE Robotics & Automation Magazine - September 2021 - 134
IEEE Robotics & Automation Magazine - September 2021 - 135
IEEE Robotics & Automation Magazine - September 2021 - 136
IEEE Robotics & Automation Magazine - September 2021 - 137
IEEE Robotics & Automation Magazine - September 2021 - 138
IEEE Robotics & Automation Magazine - September 2021 - 139
IEEE Robotics & Automation Magazine - September 2021 - 140
IEEE Robotics & Automation Magazine - September 2021 - 141
IEEE Robotics & Automation Magazine - September 2021 - 142
IEEE Robotics & Automation Magazine - September 2021 - 143
IEEE Robotics & Automation Magazine - September 2021 - 144
IEEE Robotics & Automation Magazine - September 2021 - 145
IEEE Robotics & Automation Magazine - September 2021 - 146
IEEE Robotics & Automation Magazine - September 2021 - 147
IEEE Robotics & Automation Magazine - September 2021 - 148
IEEE Robotics & Automation Magazine - September 2021 - 149
IEEE Robotics & Automation Magazine - September 2021 - 150
IEEE Robotics & Automation Magazine - September 2021 - 151
IEEE Robotics & Automation Magazine - September 2021 - 152
IEEE Robotics & Automation Magazine - September 2021 - 153
IEEE Robotics & Automation Magazine - September 2021 - 154
IEEE Robotics & Automation Magazine - September 2021 - 155
IEEE Robotics & Automation Magazine - September 2021 - 156
IEEE Robotics & Automation Magazine - September 2021 - 157
IEEE Robotics & Automation Magazine - September 2021 - 158
IEEE Robotics & Automation Magazine - September 2021 - 159
IEEE Robotics & Automation Magazine - September 2021 - 160
IEEE Robotics & Automation Magazine - September 2021 - 161
IEEE Robotics & Automation Magazine - September 2021 - 162
IEEE Robotics & Automation Magazine - September 2021 - 163
IEEE Robotics & Automation Magazine - September 2021 - 164
IEEE Robotics & Automation Magazine - September 2021 - 165
IEEE Robotics & Automation Magazine - September 2021 - 166
IEEE Robotics & Automation Magazine - September 2021 - 167
IEEE Robotics & Automation Magazine - September 2021 - 168
IEEE Robotics & Automation Magazine - September 2021 - 169
IEEE Robotics & Automation Magazine - September 2021 - 170
IEEE Robotics & Automation Magazine - September 2021 - 171
IEEE Robotics & Automation Magazine - September 2021 - 172
IEEE Robotics & Automation Magazine - September 2021 - 173
IEEE Robotics & Automation Magazine - September 2021 - 174
IEEE Robotics & Automation Magazine - September 2021 - 175
IEEE Robotics & Automation Magazine - September 2021 - 176
IEEE Robotics & Automation Magazine - September 2021 - 177
IEEE Robotics & Automation Magazine - September 2021 - 178
IEEE Robotics & Automation Magazine - September 2021 - 179
IEEE Robotics & Automation Magazine - September 2021 - 180
IEEE Robotics & Automation Magazine - September 2021 - 181
IEEE Robotics & Automation Magazine - September 2021 - 182
IEEE Robotics & Automation Magazine - September 2021 - 183
IEEE Robotics & Automation Magazine - September 2021 - 184
IEEE Robotics & Automation Magazine - September 2021 - 185
IEEE Robotics & Automation Magazine - September 2021 - 186
IEEE Robotics & Automation Magazine - September 2021 - 187
IEEE Robotics & Automation Magazine - September 2021 - 188
IEEE Robotics & Automation Magazine - September 2021 - 189
IEEE Robotics & Automation Magazine - September 2021 - 190
IEEE Robotics & Automation Magazine - September 2021 - 191
IEEE Robotics & Automation Magazine - September 2021 - 192
IEEE Robotics & Automation Magazine - September 2021 - Cover3
IEEE Robotics & Automation Magazine - September 2021 - Cover4
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_december2023
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_september2023
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_june2023
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_march2023
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_december2022
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_september2022
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_june2022
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_march2022
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_december2021
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_september2021
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_june2021
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_march2021
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_december2020
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_september2020
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_june2020
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_march2020
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_december2019
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_september2019
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_june2019
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_march2019
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_december2018
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_september2018
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_june2018
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_march2018
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_december2017
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_september2017
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_june2017
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_march2017
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_december2016
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_september2016
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_june2016
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_march2016
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_december2015
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_september2015
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_june2015
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_march2015
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_december2014
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_september2014
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_june2014
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_march2014
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_december2013
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_september2013
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_june2013
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_march2013
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_december2012
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_september2012
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_june2012
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_march2012
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_december2011
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_september2011
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_june2011
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_march2011
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_december2010
https://www.nxtbook.com/nxtbooks/ieee/roboticsautomation_september2010
https://www.nxtbookmedia.com