Cooperative Cloud Robotics Architecture For The Coordination of multi-AGV Systems in Industrial Warehouse
Cooperative Cloud Robotics Architecture For The Coordination of multi-AGV Systems in Industrial Warehouse
Mechatronics
journal homepage: www.elsevier.com/locate/mechatronics
a r t i c l e i n f o a b s t r a c t
Article history: In this paper we introduce a novel cloud robotics architecture that provides different functionalities to
Received 11 May 2016 support enhanced coordination of groups of Automated Guided Vehicles (AGVs) used for industrial logis-
Revised 15 February 2017
tics. In particular, we define a cooperative data fusion system that, gathering data from different sensing
Accepted 7 April 2017
sources, provides a constantly updated global live view of the industrial environment, for coordinating
the motion of the AGVs in an optimized manner. In fact, local sensing capabilities are complemented
Keywords: with global information, thus extending the field of view of each AGV. This knowledge extension allows
Logistics systems to support a cooperative and flexible global route assignment and local path planning in order to avoid
Multi-AGV systems congestion zones, obstacles reported in the global live view map and deal with unexpected obstacles in
Cloud robotics
the current path. The proposed methodology is validated in a real industrial environment, allowing an
Data fusion
AGV to safely perform an obstacle avoidance procedure.
Path-planning
© 2017 Elsevier Ltd. All rights reserved.
1. Introduction gistic operations. AGV systems (Fig. 1) are employed for managing
the automatic transportation of raw materials and final products
Factory logistics is a crucial aspect for the production flow in among different locations of an industrial site and they are typ-
industrial plants: since the transportation of raw materials and ically employed to pick up a pallet of goods from the end of an
final products is a very frequent operation in a warehouse, any automated production line, and bring it to the warehouse, or from
bottleneck and inefficiency strongly affect the overall energy con- the warehouse to the shipment [3,4]. A complete survey relative to
sumption, impacting on the factory productivity and competitive- the principal technologies employed for the AGVs deployment in
ness on the market. In the last decades the goods production flow industrial plants is presented in [13]. The use of AGVs is becoming
in industrial environments has reached high levels of automation widespread in the last few decades: Amazon Robotics [5–7] is one
in all manufacturing processes, allowing to improve the safety for of the most popular solutions adopted in distribution centers for
workers, increase the efficiency of the production and reduce costs. handling the goods delivery. Because of the presence of huge and
However, factory logistics is still marginally integrated in auto- heavy loads to be managed [8], the complete automation in factory
mated manufacturing processes and it involves manual operations logistics is still not achievable within real production plants, there-
performed by human workers and manually driven forklifts: this fore, it is mandatory to have human workers and hand-driven fork-
arouses inefficiencies together with high risky working conditions lifts that cooperate with the AGV systems. In order to avoid dan-
for workers [1] and problems in product traceability. To cope with gerous working situations for human operators, AGVs are equipped
the lack of efficiency and flexibility in factory logistics, warehous- with certified laser scanners designed to guarantee the detection of
ing in modern industries can rely on Automated Guided Vehicles all unforeseen obstacles in the neighbourhood of each AGV. More-
(AGVs) [2], and integrated systems for the complete handling of lo- over, to enhance safety in the presence of unpredictable events, ad-
ditional constraints are applied to the motion of the AGVs, defining
a roadmap [9–12], that is a set of predetermined paths along which
AGVs are constrained to move (Fig. 2) in order to perform their
R
This paper was recommended for publication by Associate Editor Prof. Nariman tasks. As illustrated in [13], in most of modern automatic ware-
Sepehri. houses the use of a roadmap is a common strategy, that allows to
∗
Corresponding author.
reduce the complexity of the optimization problem for the coor-
E-mail addresses: [email protected] (E. Cardarelli),
[email protected] (V. Digani), [email protected] (L. Sabattini), dination of the AGV systems. The AGV fleets are typically handled
[email protected] (C. Secchi), [email protected] (C. Fantuzzi). by a centralized control system, usually referred to as Warehouse
http://dx.doi.org/10.1016/j.mechatronics.2017.04.005
0957-4158/© 2017 Elsevier Ltd. All rights reserved.
2 E. Cardarelli et al. / Mechatronics 45 (2017) 1–13
Fig. 1. AGVs fleet employed for the automated transportation of goods in a modern factory.
Management System (WMS), that is in charge of assigning the tasks data fusion, mission assignment, time synchronization, visual data
(usually referred to as missions) to the AGVs and coordinating their representation, global navigation and local path planning.
motion. The paper is organized as follows. In Section 2 we present an
The contribution of this paper concerns with the definition of overview of the system under consideration, highlighting the moti-
a centralized and cooperative architecture designed to enhance the vation of the principal technologies integrated to enhance the per-
coordination of AGVs in real industrial environments. Some prelim- formance. Subsequently, Section 3 introduces the main architecture
inary results have been presented in [14] and [15]. In this paper of the cloud system, whose implementation strategy is illustrated
we describe in detail the centralized cloud system responsible for in Section 4. The experimental validation of the system is reported
providing several services over the network of AGVs: multi-sensor
E. Cardarelli et al. / Mechatronics 45 (2017) 1–13 3
2. System overview
Despite the fact that the AGV systems are a very attractive so-
lution for increasing the level of automation in factory logistics,
their market share is still limited to few thousands vehicles sold
every year: some technological issues related to the plant instal-
lation costs, the flexibility of the coordination strategies and the
safety of the perception systems still need to be addressed to allow
a pervasive diffusion of AGVs in modern factories. The PAN-Robots
project focused on the development of novel sensing and control
technologies for AGV systems, to increase the degree of automa-
tion in factory logistics, allowing to improve the overall system
performance in terms of productivity, speed, accuracy, and flexi-
bility. The technological solutions proposed within PAN-Robots and
discussed in this paper concern with the development of a flexible
control system to handle the motion coordination of the AGVs, the
introduction of an advanced perception system to provide a safe
shared environment among the humans and the autonomous vehi-
cles and, finally, a centralized system, that is in charge of receiving
data from different sources, opportunely merging them, and mak-
ing them available for the AGV control system.
(c) Obstacle collision in the computation (d) Global information from the cloud sys-
of local deviation exploiting local sensing. tem.
Fig. 4. Motivating example for the development of advanced perception systems.
house, representing the geometric layout of the plant itself, in- stacle detection, tracking and classification [19] with a position
cluding the position of all points of interest and structural el- and velocity tracking accuracy of, respectively, 0.098 m at 1σ
ements placed inside it [18]. The system provides a mapping and 0.22 m/s at 1σ .
accuracy of ±5 cm at 1σ . • An on-board perception system, composed by a safety laser scan-
• A laser based infrastructure perception system, used to monitor ner, supplemented by another laser scanner and by an omni-
intersections and blind spots (Fig. 5b), providing runtime ob- directional stereo vision subsystem consisting of two omnidi-
E. Cardarelli et al. / Mechatronics 45 (2017) 1–13 5
rectional lenses and two cameras mounted on the top of the with in an automated manner, exploiting sensing devices, in sev-
AGV (Fig. 5c). The system allows to detect, classify and track eral cases the human intervention is mandatory. Hence, it is nec-
objects [20] in the 360° area around the AGV: 11 m in front of essary for the system to provide human operators with an efficient
the AGV, 8 m in the back and 5 m on the left/right side. The supervision interface, to let them effectively assess the behavior of
detection, tracking and classification performance were evalu- the overall system. The Human Machine Interface (HMI) proposed
ated in different scenarios [21]: the provided detection rate is within PAN-Robots [22] provides the operator with a constantly
92.8%, with a correct tracking rate of 95%. The measured av- updated three-dimensional view of the overall system, giving the
erage localization error is 3% at 1σ and the velocity error is workers the possibility of being aware, in an intuitive manner, of
± 0.38 m/s at 1σ . The running time is about 95 ms. the behavior of the multi-vehicle system. The operator also has the
possibility of modifying this behavior, defining custom missions to
be executed.
2.4. Global Live View
3. Control Center
As shown in Fig. 4, system safety could not be guaranteed when
the collision avoidance strategy of a specific AGV only relies on
All the functionalities developed within PAN-Robots to sup-
the data perceived in the single vehicle surrounding area: there-
port intelligent AGV navigation are combined in the Control Center
fore, it is necessary to support data sharing among AGVs in or-
(Fig. 6), that is responsible for:
der to increase the safety level of the system. A possible solu-
tion could be based on the broadcasting towards the fleet of all • Improving safety and efficiency in the computation of local de-
data locally perceived by each AGV: integrating data coming from viation maneuvers for avoiding obstacles (Local Path Planning);
the infrastructural sensors and from the other AGVs, each vehicle • Optimizing the motion coordination of the AGVs for accom-
is constantly updated about the status of the whole plant. Since, plishing their tasks (Autonomous Global Navigation);
for this solution, a large quantity of data need to be simultane- • Offering to the PAN-Robots AGV an updated map of the indus-
ously transmitted over the network, it is necessary to reserve a trial environment (Global Live View);
huge amount of communication bandwidth in order to cope with • Providing an intuitive Human Machine Interface (HMI), that al-
the high transmission overhead and provide a reliable communi- lows human operators to interact with the system and receive
cation among AGVs. Moreover, since obstacle information is pro- constantly updated information regarding the fleet of AGVs and
vided by several sources, each AGV needs to be equipped with high the status of the industrial environment;
performance processing units, in charge of calculating the collision • supervising the AGV fleet by managing their missions and dif-
avoidance strategy combining and processing all data received and ferent types of operation points (Mission Manager).
resolving problems as data redundancy, inconsistency, ambiguity,
As represented in Fig. 6, the architecture of the Control Center
noise and incompleteness: equipping an industrial fleet of AGVs
is divided in a data processing layer, where the processing of re-
with high performance computation systems may involve a sig-
ceived data takes place, and an application layer that provides ac-
nificant cost for the factory. While the communication overhead
cess to external entities, like a human operator or the Warehouse
within broadcasting based solutions could be reduced limiting the
Management System.
data exchange among close AGVs, the costs related to the AGVs
In the data processing layer, the Control Center manages the
equipment and setup could be reduced introducing, within the sys-
layered map provided by the plant exploration system and adds,
tem, a separate module in charge of collecting all data perceived
through the Global Live View, a further layer for the representa-
by the sensors and combining them in a unique and complete rep-
tion of the dynamic objects perceived by the on-board and infras-
resentation to be shared to the AGVs. This centralized system, re-
tructure sensing systems. In the application layer the Mission Man-
ferred to as Global Live View [14,15], enhances the quality of the
ager module is in charge of assigning missions from the Ware-
information providing to the AGV control system a global updated
house Management System (or manually defined using the HMI
map representing the static entities (the 3D map of the plant, the
connected via Ethernet) to each AGV. Based on the mission as-
route map), the dynamic entities (the current position and veloc-
signment, the motion of the AGVs on the roadmap is coordinated
ity of the AGVs, the position and velocity of currently identified
by the Global Navigation. All relevant information is distributed to
objects), the congestion zones and the status of the monitored in-
the AGVs via wireless communication in a local network. Beside
tersections.
managing the interaction of the components, the Control Center is
The Global Live View extends the local sensing capabilities, in-
moreover responsible for synchronizing the AGVs and infrastruc-
tegrating data coming from all perception systems, namely the on-
ture perception systems, distributing via wireless a global time ref-
board and the infrastructure ones (Fig. 4d), allowing to improve
erence through the Time Server service.
the overall safety of the system. The choice of a centralized system
The PAN-Robots system can be considered as cloud robotics
is preferable for industrial environments where preventing danger-
architecture according to the definition provided by the National
ous situations is a priority with respect to the lack of flexibility:
Institute of Standards and Technology (NIST), that defines the
for this reason, in the presence of an obstacle, when the commu-
cloud computing as “a model for enabling ubiquitous, convenient,
nication with the Global Live View is poor or broken, obstacle de-
on-demand network access to a shared pool of configurable resources
tection is demanded to the local sensing of each AGV, forcing the
(e.g., servers, storage, networks, applications, and services) that can be
vehicle to stop and wait until the obstacle has been removed.
rapidly provisioned and released with minimal management effort or
service provider interaction” [23]. As the DAvinCi server of the cloud
2.5. Human Machine Interface computing framework presented in [24], the Control Center acts
as a service provider that collects data from heterogeneous net-
Since industrial plants are highly dynamic environments, shared worked agents represented by AGVs, users and perception systems
among AGVs and human workers, they define a very complex sys- and provides them all the functionalities presented as real time
tem, difficult to be controlled in a fully automated manner: distur- services. Therefore, the Control Center runs several services imple-
bances on the nominal behavior of the system may appear, such as mented as parallel threads communicating via socket over the pri-
the presence of obstacles on the AGVs’ path, or necessity to change vate cloud; the use of a private network is motivated by security
missions for the AGVs. While the presence of obstacles can be dealt constraints: since the environment is shared among vehicles and
6 E. Cardarelli et al. / Mechatronics 45 (2017) 1–13
Fig. 6. The cooperative architecture of the Control Center as a centralized cloud service.
humans, disrupted functionalities and damaged facilities caused by and by the infrastructure perception system and sends to the HMI
undesired remote attacks could generate dangerous situations for the list of classified entities to be graphically represented, namely
workers. In the designed architecture machine-to-machine com- infrastructural elements, AGVs, static and dynamic objects.
munication (M2M in [25]) among the AGVs is not implemented: The coordination of the AGVs (Fig. 8) is composed of two main
for safety reasons, in case of failures or unavailable access it is modules: Mission Manager and Global Navigation.
preferable adopting a conservative approach, where each AGV re- The list of operational tasks to be performed by the fleet
lies on its local sensing and stops until an object has been re- of AGVs are collected and stored into the Warehouse Manage-
moved, rather than handling high latencies generated by routing ment System (WMS), that is a centralized and constantly updated
protocols [26] necessary to maintain the reachability of each node database, connected to the production system. The Mission Man-
over a M2M communication network. ager is then in charge of querying the WMS to receive missions,
Providing the Global Live View service, the Control Center al- and assign them to specific AGVs. Mission assignment is performed
lows the AGVs to share and extend their knowledge about the en- exploiting the Hungarian Algorithm that, as is well known, repre-
vironment, integrating local sensing data with information coming sents the optimal algorithm for solving the assignment problem.
from the other perception systems (Fig. 4d). Therefore, exploiting Specifically, the Hungarian Algorithm is utilized for assigning a cer-
completely the perception capabilities of the whole network, it is tain number of activities (i.e. the missions) to a certain number of
possible to solve cooperatively some complex tasks, as local path agents (i.e. the AGVs). The proposed methodology, described in de-
planning computation and global navigation. tails in [17], performs assignment minimizing the overall cost, that
According to the definition in [27] a cloud robot and automa- do not depend only on the distance to be traveled, but also on the
tion system is “Any robot or automation system that relies on ei- current traffic condition.
ther data or code from a network to support its operation, i.e., where Based on the result of the mission assignment, the Global Nav-
not all sensing, computation, and memory is integrated into a single igation module is in charge of defining the path to be traveled by
standalone system”; although the Control Center is the core of the each AGV along the roadmap. Specifically, global navigation is the
cloud computing architecture, not all computation, memory and problem of assigning a path along the roadmap to each AGV, in
programming is concentrated in it. For instance, obstacle detection such a way that missions are completed while minimizing the to-
for the reconstruction of global live view is performed indepen- tal traveling time and avoiding conflicts. The problem consists then
dently by the AGVs, that are focused on sensing their neighbor- of planning a path for a fleet of AGVs in a 2D static environment
hood with a low consumption of resources, while data fusion and to avoid conflicts and deadlocks. Each AGV starts its path in an ini-
computationally intensive algorithms are delegated to the Control tial position, and has to reach its own final position. The proposed
Center. The capability of offloading computationally expensive al- methodology, described in details in [11], solves the path planning
gorithm to the cloud allows to save costs employing AGVs with problem on two levels:
low computation power and memory requirements: this is one of
the benefits of the cloud computing, as highlighted in [25]. 1. In the high level, or Topology level, the environment is parti-
The UML sequence diagrams in Figs. 9, 8 and 7, represent the tioned into sectors, that are bounded areas of limited dimen-
interaction among the principal threads running on the Control sion. The planning algorithm then searches for the best path to
Center: Global Live View, Local Path Planning, Autonomous Global the final goal (actually to the final sector where the real goal
Navigation, Mission Manager and HMI. is) from the current sector. A receding horizon approach is uti-
In order to provide human workers with an intuitive and ef- lized, together with a graph search algorithm, to allow path re-
fective HMI (Fig. 7), the Global Live View fuses runtime the infor- planning if necessary. The path on this layer is composed of a
mation about the obstacles detected by the AGV on-board system sequence of sectors the AGV has to cross.
E. Cardarelli et al. / Mechatronics 45 (2017) 1–13 7
• Multiple level fusion: based on the processing of data provided Algorithm 1 Geometric level data fusion.
at different levels of abstraction.
Require: obj_list_from_infrastructure, obj_list_from_onboard
Considering the point where data fusion is performed it is pos- 1: procedure Data alignment
sible to distinguish three types of architectures: centralized, dis- 2: for all infra_obj ∈ obj_list_from_infrastructure do
tributed and hierarchical. A centralized architecture is based on 3: Convert_to_Global_reference(infra_obj)
the presence of a single node responsible for making decisions 4: for all on_board_obj ∈ obj_list_from_on_board do
according to the data collected from the input sources. The pos- 5: Convert_to_Global_reference(on_board_obj)
sibility of communication bottlenecks and the large consumption 6: procedure Data association
of bandwidth for transmitting raw data over the network are the 7: for all infra_obj ∈ obj_list_from_infrastructure do
principal drawbacks of this solution. In a distributed architecture 8: for all on_board_obj ∈ obj_list_from_on_board do
each single source node processes independently raw data and 9: Evaluate_overlap(infra_obj, on_board_obj)
provides to the multisensor fusion a local estimation of the object 10: return obj_fused_list
status. In hierarchical architectures data fusion is performed at dif- 11: procedure Static and dynamic discrimination
ferent levels, combining decentralized and distributed nodes. Dif- 12: for all fused_obj ∈ obj_fused_list do
ferent approaches have been considered to implement multisensor 13: if velocity(fused_obj ) < th then
data fusion within the Global Live View [14], such as occupancy 14: fused_obj is static
grids [30,31], feature-based approaches [32] and octrees [33]. 15: else
Compared with feature-based approaches, occupancy grids al- 16: fused_obj is dynamic
low to reach more flexibility and robustness in the fusion of noisy
information, allowing to integrate heterogeneous input data in the
same framework according to the inherent uncertainty of each in-
according to a global positional and temporal reference system
put sensor. On the other hand, the mapping algorithms commonly
(lines 3 and 5 in Algorithm 1). Then, processing the position and
employed for updating the cells of the occupancy grids, such as
orientation of the bounding boxes related to the area covered by
fast inverse models [31,34] or forward models[35] involve costly
the detected objects, it is possible to compute their occupational
operations and large memory requirements, especially during their
overlapping (line 9) and discriminate among bounding boxes rep-
initialization and updating phases, when the map is extended and
resenting different views of the same object or separated elements.
the mapped environments are not known beforehand. Octrees al-
This allows to obtain a preliminary list of fused objects (line 10),
low to cope with these limitations but despite the accuracy, flexi-
on which the information about the estimated velocities and di-
bility and robustness provided, all these approaches consist in the
rections are integrated in order to discriminate among static and
fusion of low level data (images, 3D point clouds, laser raw data)
dynamic obstacles (see procedure in line 11). The information rep-
and for the application we are considering we assume to pro-
resenting the fused obstacles detected runtime is then fused with
cess, for each obstacle candidate, geometric/tracking features (ID,
the static 3D map processed by the semi-autonomous plant explo-
age, position, orientation, velocity and size) and decision level fea-
ration system, modeling a grid map on which free space, occupied
tures (class and classification quality) in order to optimize the data
and unknown regions are represented. This allows to support both
transmission time and reduce the network overhead. Hence, the
local path planning and autonomous global navigation capabilities.
Global Live View is implemented as a hierarchical data fusion ar-
chitecture that deals separately with geometric and decision level
data fusion. 4.2. Decision fusion
(a) Sensing area covered by the infrastruc- (b) Field of view of the on-board extero-
tural laser scanner (in green) ceptive sensors (in red)
Fig. 10. Sensing area of the advanced perception systems.
Fig. 11. Evaluation scenario observed from the on-board sensing system.
for each possible class of the system (human, manual forklift, AGV, Table 1
Single transmission scenario.
other dynamic object, static object) to be the correct class for the
unknown input pattern. The classification results provided by the Message type Description Value
sensors are combined with the rough class values obtained at geo- Pallet position
metric level, exploiting, at measurement level [40], the average-rule Update rate: 50 Hz
aggregation scheme: for each fused object, the average of the scores Packet loss: 0%
assigned to each class is computed, and the most voted class is Message correctness: 100%
Received messages: 4278
considered the correct one for the object. Despite its simplicity, the
Sent messages: 4278
average-rule aggregation scheme competes with the most sophisti- Operation point
cated combination methods, as highlighted in [41]. Update rate: 50 Hz
Packet loss: 0%
5. Results Message correctness: 100%
Received messages: 4314
Sent messages: 4314
Two principal aspects have been considered for the validation Route
of the system: first, demonstrating that the presented architecture Update rate: 50 Hz
is based on a reliable, robust and efficient communication network Packet loss: 0%
and, second, highlighting with an experimental scenario the ad- Message correctness: 100%
Received messages: 4156
vantages in terms of safety and flexibility introduced by the cloud
Sent messages: 4156
based methodology.
Since for both cases we obtained 0% of packet loss and 100% • Route: it represents the map of the segments that the AGVs
data correctness, we increased to 50 Hz the data transmission have to follow during the path.
rate, obtaining the results summarized in Table 1. Particularly,
Table 1 shows the data measured for the most computationally ex-
pensive and frequently exchanged message types: Concerning the test with simultaneous message exchanging, we
considered a sending rate of 20 Hz measuring the network per-
• Pallet position: it defines the geometric position of the pallet to formance after 30 min: about 36,0 0 0 packets were simultaneously
pick/place. transmitted with 100% correctness and 0% of packet loss. As for
• Operation point: it represents the position that the AGV has to the single transmission scenario, to further stress the system the
reach during the picking/placing operation. It does not corre- update rate has been increased to 50 Hz: the results obtained for
spond to the geometric position of the pallet, but it is the ge- the most frequently exchanged and computational costly messages
ometric position of the logical point, that is the point in which are summarized in Table 2. Finally, the sending rate has been in-
the AGV can stop to pick/place the load. creased to 120 Hz: in this case the measured packet loss is about
1%; this is a limit of the software for data transmission and it is 5.2. Experimental validation
not related to the network congestion.
Moreover, we tested the transmission latency relative to obsta- The experimental validation of the proposed methodology was
cle detection, measuring, in presence of an obstacle, the difference carried on in a real industrial warehouse, where measurements
between the timestamp of the message sent by the on-board sys- were acquired by:
tem to Global Live View and the timestamp of the message relative
to the updated obstacles list sent by the Global Live View to the • An infrastructural laser scanner, mounted on a corner of the
AGV: the measured latency, after 50 tests, is averagely 43ms with warehouse (whose field of view is represented in green in
a standard deviation of 33ms. Fig. 10a);
All the obtained results demonstrate that the communication • An on-board sensing system, namely laser scanners and cam-
network is suitable for a real operational scenario, where the re- eras, installed on an AGV (whose sensing area is highlighted in
quested update rate is 10 Hz. red in Fig. 10b).
Table 2 Acknowledgment
Simultaneous transmission scenario.
Message type Description Value This paper is written within PAN-Robots project. The re-
Pallet position search leading to these results has received funding from the
Update rate: 50 Hz European Union Seventh Framework Programme (FP7/2007-2013)
Packet loss: 0% under grant agreement n. 314193.
Message correctness: 100%
Received messages: 7537
Sent messages: 7537 References
Operation point
Update rate: 50 Hz
[1] Eurostat. http://ec.europa.eu/eurostat;
Packet loss: 0%
[2] Sabattini L, Digani V, Secchi C, Cotena G, Ronzoni D, Foppoli M, et al. Tech-
Message correctness: 100% nological roadmap to boost the introduction of AGVS in industrial applications
Received messages: 7651 IEEE international conference on intelligent computer communication and pro-
Sent messages: 7651 cessing (ICCP); 2013.
Route [3] Mahadevan B, Narendran TT. Design of an automated guided vehicle-based
Update rate: 50 Hz material handling system for a flexible manufacturing system. Int J Prod Res
Packet loss: 0% 1990;28(9):1611–22.
Message correctness: 100% [4] Berman S, Edan Y. Decentralized autonomous AGV system for material han-
Received messages: 7322 dling. Int J Prod Res 2002;40(15):3995–4006.
Sent messages: 7322 [5] Wurman PR, D’Andrea R, Mountz M. Coordinating hundreds of cooperative, au-
tonomous vehicles in warehouses. AI Mag 2008;29(1):9.
[6] D’Andrea R. Guest editorial: a revolution in the warehouse: a retrospective
on kiva systems and the grand challenges ahead. IEEE Trans Autom Sci Eng
2012;9(4):638–9.
The sensing systems were used to acquired information about [7] Guizzo E. Three engineers, hundreds of robots, one warehouse. Spectr IEEE
static and dynamic entities in the environment. In particular, 2008;45(7):26–34.
[8] Oleari F, Magnani M, Ronzoni D, Sabattini L. Industrial AGVs: toward a perva-
Fig. 11 shows an evaluation scenario observed from the on-board sive diffusion in modern factory warehouses. In: Proceedings of the IEEE in-
perception system. The bounding boxes of the objects detected by ternational conference on intelligent computer communication and processing
the infrastructure and by the on-board sensing systems are shown, (ICCP). Cluj-Napoca, Romania; 2014. p. 233–8.
[9] Digani V, Sabattini L, Secchi C, Fantuzzi C. Hierarchical traffic control for
respectively, in Fig. 12a and b. The centralized data fusion cloud
partially decentralized coordination of multi agv systems in industrial envi-
aligns these data according to a global reference and temporal ronments. IEEE international conference on robotics and automation (ICRA);
frame (Fig. 13a) in order to allow the processing of their geometri- 2014a.
[10] Digani V, Sabattini L, Secchi C, Fantuzzi C. An automatic approach for the gen-
cal overlaps (Fig. 13b) and reducing noisy contribution.
eration of the roadmap for multi-agv systems in an industrial environment. In:
Concerning the performance evaluation, the measured update IEEE International Conference on Intelligent Robots and Systems (IROS); 2014b.
rate of the Global Live View is approximately 60 Hz, and the over- [11] Digani V, Sabattini L, Secchi C, Fantuzzi C. Ensemble coordination approach in
all processing time is 15 ms. The overall classification rate is equal multi-agv systems applied to industrial warehouses. IEEE Trans Autom Sci Eng
2015;12(3):922–34.
to 93.2%. [12] Beinschob P, Meyer M, Reinke C, Digani V, Secchi C, Sabattini L. Semi-auto-
The results relative to the validation of the local path planning mated map creation for fast deployment of AGV fleets in modern logistics.
strategies are shown in the accompanying video. It is important to Robot Auton Syst 2017;87:281–95.
[13] Vis IF. Survey of research in the design and control of automated guided vehi-
note that without advanced sensing and data fusion technologies, cle systems. Eur J Oper Res 2006b;170(3):677–709. doi:10.1016/j.ejor.2004.09.
in the presence of an obstacle the AGV is forced to stop until a hu- 020.
man operator manually removes it to allow the AGV to move on [14] Cardarelli E, Sabattini L, Secchi C, Fantuzzi C. Multisensor data fusion for ob-
stacle detection in automated factory logistics. IEEE international conference
its predetermined route. With the proposed technological solution, on intelligent computer communication and processing (ICCP). IEEE; 2014.
the AGV is able to autonomously and safely compute local devia- [15] Cardarelli E, Sabattini L, Secchi C, Fantuzzi C. Cloud robotics paradigm for en-
tions to pass the obstacle. hanced navigation of autonomous vehicles in real world industrial applica-
tions. In: Proceedings of the IEEE/RSJ international conference on intelligent
robots and systems (IROS). Hamburg, Germany; 2015.
[16] Digani V, Caramaschi F, Sabattini L, Secchi C, Fantuzzi C. Obstacle avoidance for
industrial AGVs. In: Proceedings of the IEEE international conference on intel-
6. Conclusion
ligent computer communication and processing (ICCP). Cluj-Napoca, Romania;
2014c. p. 227–32.
In this paper we introduced a cloud robotics architecture that [17] Sabattini L, Digani V, Lucchi M, Secchi C, Fantuzzi C. Mission assignment for
gathers information from different sensing sources. A global live multi-vehicle systems in industrial environments. IFAC symposium on robot
control (SYROCO). Salvador, Brazil; 2015.
view of the environment is then defined, that contains informa- [18] Beinschob P, Reinke C. Advances in 3d data acquisition, mapping and local-
tion regarding all the entities in the industrial environment. This ization in modern large-scale warehouses. In: Intelligent computer commu-
system is then used for enhancing the local sensing capabilities of nication and processing (ICCP), 2014 IEEE international conference on; 2014.
p. 265–71.
the AGVs, thus increasing the efficiency and the flexibility of the [19] Boehning M. Improving safety and efficiency of agvs at warehouse black spots.
AGV motion coordination. In: Intelligent computer communication and processing (ICCP), 2014 IEEE in-
Multisensor data fusion is achieved, to define the global live ternational conference on; 2014. p. 245–9.
[20] Drulea M, Szakats I, Vatavu A, Nedevschi S. Omnidirectional stereo vision using
view, combining sensing data after local processing, that provides fisheye lenses. In: Intelligent computer communication and processing (ICCP),
geometric and decision level data. 2014 IEEE international conference on; 2014. p. 251–8.
The proposed architecture was validated in a real industrial en- [21] Vatavu A, Costea D, Nedevschi S. Modeling and tracking of dynamic obsta-
cles for logistic plants using omnidirectional stereo vision. In: Proceedings of
vironment, where multiple sensors were deployed. In particular,
the IEEE/RSJ international conference on intelligent robots and systems (IROS).
the global live view was utilized for letting an AGV safely perform Hamburg, Germany; 2015.
an obstacle avoidance procedure. [22] Cardarelli E, Sabattini L, Digani V, Secchi C, Fantuzzi C. Interacting with a multi
AGV system. In: Proceedings of the IEEE international conference on intelligent
While the proposed architecture considered only warehouse en-
computer communication and processing (ICCP). Cluj-Napoca, Romania; 2015.
vironments, the concept can be extended to more generic intelli- [23] Mell PM, Grance T. Sp 800-145. the nist definition of cloud computing. Tech.
gent factory applications. Along these lines, future work will aim Rep.. Gaithersburg, MD, United States; 2011.
at including, inside the global live view, information regarding the [24] Arumugam R, Enti VR, Bingbing L, Xiaojun W, Baskaran K, Kong FF, et al.
Davinci: a cloud computing framework for service robots. In: Robotics and
status of the production lines and machines, providing support for automation (ICRA), 2010 IEEE international conference on; 2010. p. 3084–9.
optimization of the overall factory workflow. doi:10.1109/ROBOT.2010.5509469.
E. Cardarelli et al. / Mechatronics 45 (2017) 1–13 13