6_A Review of Point Cloud Registration Algorithms for Mobile Robotics
6_A Review of Point Cloud Registration Algorithms for Mobile Robotics
1561/2300000035
François Pomerleau
Autonomous Space Robotics Laboratory
University of Toronto
Toronto, Canada
[email protected]
Francis Colas
Inria, Villers-lès-Nancy, F-54600
CNRS, Loria, UMR 7503, Vandœuvre-lès-Nancy, F-54500
Université de Lorraine, Vandœuvre-lès-Nancy, F-54500
France
[email protected]
Roland Siegwart
Autonomous Systems Lab
ETH Zurich
Zurich, Switzerland
[email protected]
Boston — Delft
Full text available at: http://dx.doi.org/10.1561/2300000035
All rights reserved. No part of this publication may be reproduced, stored in a retrieval
system, or transmitted in any form or by any means, mechanical, photocopying, recording
or otherwise, without prior written permission of the publishers.
Photocopying. In the USA: This journal is registered at the Copyright Clearance Cen-
ter, Inc., 222 Rosewood Drive, Danvers, MA 01923. Authorization to photocopy items for
internal or personal use, or the internal or personal use of specific clients, is granted by
now Publishers Inc for users registered with the Copyright Clearance Center (CCC). The
‘services’ for users can be found on the internet at: www.copyright.com
For those organizations that have been granted a photocopy license, a separate system
of payment has been arranged. Authorization does not extend to other kinds of copy-
ing, such as that for general distribution, for advertising or promotional purposes, for
creating new collective works, or for resale. In the rest of the world: Permission to pho-
tocopy must be obtained from the copyright owner. Please apply to now Publishers Inc.,
PO Box 1024, Hanover, MA 02339, USA; Tel. +1 781 871 0245; www.nowpublishers.com;
[email protected]
now Publishers Inc. has an exclusive license to publish this material worldwide. Permission
to use this content must be obtained from the copyright license holder. Please apply to
now Publishers, PO Box 179, 2600 AD Delft, The Netherlands, www.nowpublishers.com;
e-mail: [email protected]
Full text available at: http://dx.doi.org/10.1561/2300000035
Editors-in-Chief
Editors
Editorial Scope
Topics
• Industrial robotics
• Artificial intelligence in
robotics • Service robotics
François Pomerleau
Autonomous Space Robotics Laboratory
University of Toronto
Toronto, Canada
[email protected]
Francis Colas
Inria, Villers-lès-Nancy, F-54600
CNRS, Loria, UMR 7503, Vandœuvre-lès-Nancy, F-54500
Université de Lorraine, Vandœuvre-lès-Nancy, F-54500
France
[email protected]
Roland Siegwart
Autonomous Systems Lab
ETH Zurich
Zurich, Switzerland
[email protected]
Full text available at: http://dx.doi.org/10.1561/2300000035
Contents
ii
Full text available at: http://dx.doi.org/10.1561/2300000035
iii
4 Conclusion 84
Acknowledgements 90
Appendices 91
References 95
Full text available at: http://dx.doi.org/10.1561/2300000035
Abstract
1
Twenty years of Iterative Closest Point (ICP):
The Legacy
2
Full text available at: http://dx.doi.org/10.1561/2300000035
1
In general, image registration often has access to labelled points, which is less
the case for geometric registration, either in 2D or 3D.
Full text available at: http://dx.doi.org/10.1561/2300000035
Figure 1.3: Theseus adjusting Procrustes to the size of his bed. Photograph pro-
vided by Marie-Lan Nguyen / Wikimedia Commons.
Within only two years, four main application types already emerged
from the possibilities to register 3D point clouds: object reconstructions
[Chen and Medioni, 1991], non-contact inspections [Besl and McKay,
1992], medical and surgery support [Champleboux et al., 1992] and au-
tonomous vehicle navigation [Zhang, 1993]. Publications in specialized
journals for computer vision, robotics and medical imaging slowly di-
vided the types of interesting problems to be solved. We can still read
in current literature that the credits for being the first article to provide
a solution differ from authors in different fields.
The field of registration crystalized with its first survey on med-
ical image registration covering the years 1993 to 1998 [Maintz and
Viergever, 1998]. It took 12 years for a specialized survey of 3D regis-
tration in computer vision to appear [Bowyer et al., 2006]. This work
intends to be the first large scale review adapted for Robotics applica-
tion.
ICP is a popular algorithm due to its simplicity: its general idea is
easy to understand and to implement. However, the basic algorithm
only works well in ideal cases. This led to hundreds3 of variations
around the original algorithm that were published on numerous dif-
ferent experimental scenarios (see Figure 1.4). This highlights both the
usefulness of ICP and the difficulty to find a single versatile version.
3
Close to 450 papers based on IEEE Xplore and around 1350 based on Scopus,
between 1992 and 2013.
Full text available at: http://dx.doi.org/10.1561/2300000035
180
144
Number of papers
108
72
36
0
1992
1993
1994
1995
1996
1997
1998
1999
2000
2001
2002
2003
2004
2005
2006
2007
2008
2009
2010
2011
2012
2013
Years
Figure 1.4: Evolution of the number of publications over the years. Results were
obtained for the keywords Iterative Closest Point appearing in the abstract or the
title of publications. The dark blue area is computed based on IEEE Xplore database
and the light green area from the Scopus database.
IEEE Xplore Advance search request: ( "Document Title":"Iterative Closest Point" OR "Abstract":"Iterativ
B A
A T̂ = arg min error T P , BQ (1.1)
T
In order to make this error function more robust, outliers are some-
times identified and removed from the list of matches. In addition,
weights W = outlier(M) = {w(p, q) : ∀(p, q) ∈ M} can be associated
to the matches so as to increase or decrease their influence in the error
function: X
error(P, Q) = w(p, q) d(p, q).
(p,q)∈M
i 3 2
where i−1 T = ··· ◦ 2T ◦ 1T is the iterative composition of the
i
transformations, and Tinit an initial transformation.
The generic procedure is summarized in Algorithm 1 and shown as
a chart in Figure 1.5.
Initial
Transformation
Data Outlier
Reading
Filter(s) Filter(s)
Association Error
Solver Minimization
Data Outlier
Reference
Filter(s) Filter(s)
Legend:
References
95
Full text available at: http://dx.doi.org/10.1561/2300000035
96 References
References 97
98 References
References 99
100 References
Ce Li, Jianru Xue, Shaoyi Y Du, and Nanning Zheng. A Fast Multi-Resolution
Iterative Closest Point Algorithm. In Pattern Recognition, 2010. Proceed-
ings of the Chinese Conference on, pages 1–5, 2010.
Yonghuai Liu. Automatic Range Image Registration in the Markov Chain.
Pattern Analysis and Machine Intelligence, IEEE Transactions on, 32(1):
12–29, 2010.
D Lowe. Distinctive image features from scale-invariant keypoints. Interna-
tional Journal of Computer Vision, 60(2):91–110, 2004.
F Lu and E Milios. Globally Consistent Range Scan Alignment for Environ-
ment Mapping. Autonomous Robots, 4(4):333–349, 1997.
M Magnusson, Andreas Nüchter, C Lorken, A Lilienthal, and J Hertzberg.
Evaluation of 3D registration reliability and speed - A comparison of ICP
and NDT. In Robotics and Automation, 2009. Proceedings of the IEEE
International Conference on, pages 3907–3912, 2009.
J B Antoine Maintz and Max A Viergever. A survey of medical image regis-
tration. Medical Image Analysis, 2(1):1–36, March 1998.
P Markelj, D Tomaževič, B Likar, and F Pernuš. A review of 3D/2D regis-
tration methods for image-guided interventions. Medical Image Analysis,
16(3):642–661, April 2012.
T Masuda. Generation of geometric model by registration and integration
of multiple range images. In 3-D Digital Imaging and Modeling, 2001.
Proceedings of the Third International Conference on, pages 254–261, 2001.
T Masuda, K Sakaue, and N Yokoya. Registration and integration of multiple
range images for 3-D model construction. In Pattern Recognition, 1996.
Proceedings of the 13th International Conference on, pages 879–883 vol.1,
1996.
C R Jr Maurer, G B Aboutanos, B M Dawant, R J Maciunas, and J M
Fitzpatrick. Registration of 3-D images using weighted geometrical features.
Medical Imaging, IEEE Transactions on, 15(6):836–849, 1996.
G Medioni, C K Tang, and M S Lee. Tensor voting: Theory and applications.
In Reconnaissance des formes et Intelligence Artificielle, 2000. Proceedings
of the Conference on, 2000.
Helena Mitasova, Margery F Overton, Juan José Recalde, David J Bernstein,
and Christopher W Freeman. Raster-Based Analysis of Coastal Terrain
Dynamics from Multitemporal Lidar Data. Journal of Coastal Research,
252:507–514, March 2009.
Full text available at: http://dx.doi.org/10.1561/2300000035
References 101
102 References
References 103
104 References