Orthogonal 20 Distance 20 Fitting 20 of 20 Implicit 20 Curves 20 and 20 Surfaces
Orthogonal 20 Distance 20 Fitting 20 of 20 Implicit 20 Curves 20 and 20 Surfaces
net/publication/3193385
CITATIONS READS
114 650
4 authors, including:
Hyungsuck Cho
Korea Advanced Institute of Science and Technology
141 PUBLICATIONS 2,317 CITATIONS
SEE PROFILE
Some of the authors of this publication are also working on these related projects:
All content following this page was uploaded by Sung Joon Ahn on 03 September 2013.
AbstractÐDimensional model fitting finds its applications in various fields of science and engineering and is a relevant subject in
computer/machine vision and coordinate metrology. In this paper, we present two new fitting algorithms, distance-based and
coordinate-based algorithm, for implicit surfaces and plane curves, which minimize the square sum of the orthogonal error distances
between the model feature and the given data points. Each of the two algorithms has its own advantages and is to be purposefully
applied to a specific fitting task, considering the implementation and memory space cost, and possibilities of observation weighting. By
the new algorithms, the model feature parameters are grouped and simultaneously estimated in terms of form, position, and rotation
parameters. The form parameters determine the shape of the model feature and the position/rotation parameters describe the rigid
body motion of the model feature. The proposed algorithms are applicable to any kind of implicit surface and plane curve. In this paper,
we also describe algorithm implementation and show various examples of orthogonal distance fit.
Index TermsÐImplicit curve, implicit surface, curve fitting, surface fitting, orthogonal distance fitting, geometric distance, orthogonal
contacting, nonlinear least squares, parameter estimation, Gauss-Newton method, parameter constraint, parametric model recovery,
object segmentation, object classification, object reconstruction.
1 INTRODUCTION
xi R
Xi Xo ;
9
we determine the orthogonal contacting point x0i
on the
standard model feature (6). Then, the orthogonal contacting
point X0i in frame XYZ from the given point Xi will be
obtained through a backward transformation of x0i into XYZ.
For some implicit features (e.g., circle, sphere, cylinder, cone,
Fig. 1. Implicit features and the orthogonal contacting point x0i in frame and torus), the orthogonal contacting point x0i can be
xyz from the given point Xi in frame XYZ: (a) plane curve and (b) surface. determined in closed form at a low computing cost.
However, in general, we must iteratively find x0i satisfying
rotation parameters ar , describe the rigid body motion of the appropriate orthogonal contacting conditions. We describe
model feature f in machine coordinate system XYZ two algorithms for finding the orthogonal contacting point x0i
in frame xyz. The first algorithm is derived from the general
X R 1 x Xo or x R
X Xo ; where
7
properties of the shortest distance point. The second
algorithm is based on a constrained minimization method,
R R R' R!
r1 r2 r3 T ; R 1
RT ; the method of Lagrange multipliers [20]. Within the follow-
8 ing sections, the orthogonal contacting point is marked with a
ap Xo
Xo ; Yo ; Zo T ; and ar
!; '; T :
prime, as X0i in frame XYZ and as x0i in frame xyz, once it has
We characterize the form parameters as intrinsic parameters been determined and is ready to be used. Otherwise, it is
and the position/rotation parameters as extrinsic parameters of notated with the general coordinate vector X or x.
the model feature according to their context. In this paper, we
intend to simultaneously estimate all these parameters 2.1 Direct Method
A necessary condition for the shortest distance point x on
aT
aT T T
g ; ap ; ar the implicit model feature (6) from the given point xi is that
a1 ; . . . ; al ; Xo ; Yo ; Zo ; !; ';
a1 ; . . . ; aq : the connecting line of xi with x should be parallel to the
feature normal rf at x (Fig. 1):
For plane curve fitting, we simply ignore all terms concerning
z, Z, !, and '. We may try to describe the model feature F with rf
xi x 0 ; where r
@=@x; @=@y; @=@zT :
algebraic parameters b in machine coordinate system XYZ
10
although this has no interest for us from the viewpoint of rx f=
xi x ry f=
yi y rz f=
zi z
our model fitting algorithms. and only two of three equation rows of (10) are indepen-
In comparison with other dimensional model fitting dent. Equation (10) describes a space curve as the
algorithms, our algorithms simultaneously estimate the intersection of two implicit surfaces defined in frame xyz
physical parameters a of the model feature in terms of
by two independent equation rows of (10). We can find that
form ag , position ap , and rotation parameters ar , thus
(10) generally satisfies the parallel condition of the vector
providing very useful algorithmic features for various
xi x to the feature normal rf of the iso-feature of (6)
applications, e.g., with robot vision, motion analysis, and
coordinate metrology. For such applications, algebraic para- f
ag ; x const 0:
11
meters b must be converted into physical parameters a even
though the conversion is not an easy task for general model As the constant in (11) is continuously varying, the
features. trajectories of the points lying on (11) and satisfying (10)
The novelty of our algorithms, as will be described in draw a curve described by (10). We name the curve (10)
Section 3, is that the necessary derivative values for nonlinear centrortho-curve about the point xi to the iso-features (11).
iteration are to be obtained from the standard model feature Our aim is to find the intersection of the centrortho-curve
equation (6) and from the coordinate transformation equa- (10) with the implicit model feature (6). In other words, we
tions (7). For application of our algorithms to a new model would like to find the point x which simultaneously
feature, we need merely to provide the first and the second satisfies (6) and (10) (orthogonal contacting condition, see
derivatives of the standard model feature equation (6) Fig. 2 for the case of a plane curve, an ellipse):
AHN ET AL.: ORTHOGONAL DISTANCE FITTING OF IMPLICIT CURVES AND SURFACES 623
Fig. 2. Isocurves x2 =64 y2 =16 const 0 (const > 0) and the trajec- the isocurve tangent in xy-plane [3], [4]. From this fact and for
tories (centrortho-curves)
3x 8
3y 2 16 0 (thick line) and
3x 8y 0 (broken line) of the orthogonal contacting points on the
the sake of a common program module for curves and
isocurves from the point (2, 2) and (2, 0), respectively. surfaces, we interchange the second and the fourth row of
(12). Then, for the case of plane curves, we activate only the
f first two rows of the modified equation (12) in the program
f
ag ; xi ; x 0 with xi R
Xi Xo :
rf
xi x
module (see Appendix A and Fig. 2 for an ellipse).
12
2.2 Constrained Minimization
Orthogonal contacting equation (12) governs the variational
Alternatively, we can find the orthogonal contacting point
behavior of the orthogonal contacting point in frame xyz
minimizing the Lagrangian function [20]
relative to the differential change of the feature parameters a
and will play an important role with the coordinate-based L
; x
xi xT
xi x f:
14
algorithm to be described in Section 3.2.
We directly solve (12) for x by using a generalized The first order necessary condition for a minimum of the
Newton method starting from the initial point of x0 xi Lagrangian function (14) is
(Fig. 3) (how to compute the matrix @f =@x will be shown in
rL 2
xi x rf
Section 3.2): @L 0:
15
@ f
@f We iteratively solve (15) for x and [27], [39]
x f
xk ; xk1 xk x:
13
@x
k 2I H rf x
If necessary, especially in order to prevent the point update rTf 0
x from heading for divergence zone with an implicit
16
2
xi x rf @
feature having very high local curvature, we underweight ; where H rf:
f @x
the on-the-feature condition in (12) as below:
In practice, we have observed that, once the second term of
wf the Lagrangian function (14) becomes negative (the first term
f
ag ; xi ; x 0; with 0 < w 1:
rf
xi x
is always nonnegative), it is occasionally prone to become
In the first iteration cycle with the starting point of x0 xi , more negative (i.e., diverging) in the succeeding iteration
the linear system (13) and its solution (i.e., the first moving cycles of (16) to minimize (14), although the second term is
step) are equivalent to commanded to be zero. Consequently, the convergence of
f iteration (16) is very affected by the selection of the initial
rf x f
and x rf : values. From this observation and with a hint at determining
rf x xi 0 xi krfk2
x i the first moving step size taken from the direct method
It should be noted that the first moving step is the negative described in Section 2.1, we use the following initial values for
of the normalized algebraic error vector shown in the x and :
second formula of (1) which has been regarded in the 8
> 2
literature [36], [40] as a good approximation of the < f=krfk : x0 xi
xi
geometric error vector. 0 1 : x0 6 xi and f
ag ; x0 0
>
:
For plane curves on the xy-plane (i.e., z 0), we simply 1 : x0 6 xi and f
ag ; x0 < 0:
ignore the second and the third row of (12), which have terms
17
of coordinate z in the cross product and have been
automatically satisfied, then the fourth row of (12) without Iteration (16) with the initial values in (17) converges
terms of coordinate z in the cross product is nothing other relatively fast. Nevertheless, if the convergence of iteration
than the orthogonality condition of the error vector
xi x to (16) fails, we catch it using the direct method.
624 IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, VOL. 24, NO. 5, MAY 2002
@X0 generality, the second and the fourth row of (12). Then, for
J ; PJjk a P
X X0 jk ; ak1 ak a;
28
@a plane curve fitting, we consider only the first two rows of the
with break conditions modified equation (12), in other words, we consider only the
upper-left block of the FHG matrix in (31) (see Appendix A).
kJT PT P
X X0 k 0 or kak 0 or 20 k 20 k1 0
3.3 Comparison of the Two Algorithms
and with the Jacobian matrices of each orthogonal contacting Each of the distance-based and coordinate-based algorithms
point X0i on the current model feature, directly derived for orthogonal distance fitting of implicit features is versatile
from (7), and very efficient from the viewpoint of application to a new
model feature. We would like to stress that only the standard
@X 1 @x @R 1 @Xo model feature equation (6), without involvement of the
JX0i ;a R x
@a XX0 @a @a @a xx0 position/rotation parameters, is required in (31) for imple-
i
i
29 mentationofeitherofthetwoalgorithmstoanewmodelfeature
1 @x @R 1 0 (the second derivatives @rf=@ag is required only for coordi-
R 0 I x :
@axx0 @ar i
nate-based algorithm). The overall structure of our algorithms
i
remains unchanged for all dimensional fitting problems of
The derivative matrix @x=@a at x x0i in (29) describes the implicit features. All that is necessary for orthogonal distance
variational behavior of the orthogonal contacting point x0i in fitting of a new implicit model feature is to derive the
frame xyz relative to the differential changes of the FHG matrix of (31) from (6) of the new model feature and to
parameters vector a. Purposefully, we obtain @x=@a from supply a proper set of initial parameter values a0 for iterations
the orthogonal contacting equation (12). Because (12) has an (24) and (28). This fact makes possible a realization of versatile
implicit form, its derivatives lead to and very efficient orthogonal distance fitting algorithms for
implicit surfaces and plane curves. An overall schematic
@f @x @f @xi @f @f @x @f @xi @f information flow is shown in Fig. 6 (coordinate-based
0 or ; algorithm). We compare the two algorithms from the view-
@x @a @xi @a @a @x @a @xi @a @a
point of implementation and computing cost as follows:
30
. Common features
where @xi =@a is, from (9),
- For implementation to a new model feature,
@xi @R @Xo
Xi Xo R only the standard model feature equation (6) is
@a @a @a eventually required;
@R
0 R Xi Xo : - Computing time and memory space cost are
@ar
proportional to the number of the data points;
The other three matrices @f =@x, @f =@xi , and @f =@a in (13) and - The two algorithms demand about the same
(30) are to be directly derived from (12). The elements of these computing cost because the time-consuming
part of the overall procedure is the finding of
three matrices are composed of simple linear combinations of
the orthogonal contacting points.
components of the error vector
xi x with elements of the
. Different features
following three vector/matrices rf, H, and G (FHG matrix):
- The distance-based algorithm demands smaller
@f @f @f T @ @ f memory space (with plane curve fitting one half
rf ; ; ; H rf; G ;
31
@x @y @z @x @ag rf and with surface fitting one third of what the
0 1 coordinate-based algorithm does);
0 0 0
- To a new model feature, the implementation of
@f B B i y y
x i x 0 C
C the distance-based algorithm is relatively easy
B CH
@x @
zi z 0 xi x A because it does not require the second deriva-
0 zi z
yi y tives @rf=@ag of the model feature;
0 @f @f @f 1 0 1 - With the coordinate-based algorithm, each co-
0 0 0
B
@x @y @z
C ordinate Xi ; Yi ; Zi of a measurement point can
B B @f @f
0 C
B
@f
@y
@f
@x 0 CC @f B @y @x C be individually weighted, while only pointwise
B C; B C
@f C; weighting is possible with the distance-
B @f
0 @f C @xi B
@
@f
0 @x A
@ @z @x A @z
based algorithm. This algorithmic feature of
@f @f
0 @f @f 0 @z @y the coordinate-based algorithm is practical
@z @y
0 1 for measuring equipment whose measuring
1 0 0 0
accuracy is not identical between measuring
@f B
B0 yi y
xi x 0 C
C axes. From this fact, we can say the coordinate-
B C
G 0 0 :
@a @ 0
zi z 0 xi x A based algorithm is the more general one than
0 0 zi z
yi y the distance-based algorithm;
- A comparison between (26) and (29) reveals
Now, (30) can be solved for @x=@a at x x0i and, conse-
quently, the Jacobian matrix (29) and the linear system (28) di NT
i
Xi X0i ; Jdi ;a NT
i JX0i ;a ;
can be completed and solved for parameter update a. Xi X0i
For the sake of a common program module for surfaces where Ni :
kXi X0i k
and plane curves, we have interchanged, without loss of
AHN ET AL.: ORTHOGONAL DISTANCE FITTING OF IMPLICIT CURVES AND SURFACES 627
Fig. 6. Information flow for orthogonal distance fitting of implicit features (coordinate-based algorithm).
3.4 Parameter Constraint PJ
UWVT
If any parameter constraint (e.g., on size, area, volume, Wc Jc
position, orientation of the model feature) with UT U VT V I; W diag
w1 ; . . . ; wq ;
fcj
a constj 0; j 1; . . . ; n;
32 and now the linear systems (34) and (35) can be solved for
or, in vector form, a. After a successful termination of iterations (34) and (35),
along with the performance index 20 , the Jacobian matrix
f c
a const 0 provides useful information about the quality of parameter
is to be additionally applied, we append any following estimations as follows:
n equations (33) with the large weighting values wc to the
linear systems (24) and (28): . Covariance matrix:
" T # 1
@fcj PJ PJ
wcj a wcj fcj
a constj ; j 1; . . . ; n:
33 Cov
^a VW 2 VT ;
@a Wc Jc Wc Jc
Considering parameter constraints (32), we can rewrite the
performance indexes (3) and (4) and the linear systems (24) . Parameter covariance:
and (28) as follows:
Xq
T Vji Vki
Pd Pd aj ; a^k
Cov
^ ; j; k 1; . . . ; q ;
36
20 ; i1
w2i
Wc
f c
a const Wc
f c
a const
PJ Pd
34
a ; . Variance of parameters:
Wc Jc Wc
f c
a const
@d @f c 20
J ; Jc 2
^
aj aj ; a^j ;
Cov
^ j 1; . . . ; q ;
@a @a mn q
for the distance-based algorithm and
T . Correlation coefficients:
P
X X0 P
X X0
20
; Cov
^ aj ; a^k
Wc
f c
a const Wc
f c
a const aj ; a^k p ;
^ j; k 1; . . . ; q:
Cov
^ aj ; a^j Cov
^ ak ; a^k
PJ P
X X0
35
a ;
Wc Jc Wc
f c
a const
Using the above information, we can test the reliability of
@X0 @f c
J ; Jc the estimated parameters ^ a and the propriety of the model
@a @a
selection (object classification). For example, we may try to
for the coordinate-based algorithm. fit an ellipsoid to a set of measurement points of a sphere-
3.5 Parameter Test and Object Classification like object surface. Then, besides a b c and the existence
The Jacobian matrix in (34) and (35) will be decomposed by of strong correlations between the rotation parameters and
SVD [25], [33], the other parameters, we get relatively large variances of
628 IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, VOL. 24, NO. 5, MAY 2002
Fig. 7. Orthogonal distance fit to the points set in Table 1: (a) Circle fit. (b) Ellipse fit. (c) Superellipse fit. (d) Convergence of the fit. Iteration number 0-6:
circle, 7-21: ellipse, and 22-: superellipse fit.
the rotation parameters. In this case, the rotation parameters processing and pattern recognition is very desirable because
are redundant here (overparameterized) and, although the superellipse can represent various 2D-features, e.g., rectangle
fitting of an ellipsoid to the points set has better (" 1), ellipse (" 1), and star (" > 2). Many researchers
performance than a sphere fitting according to the have tried to fit a superellipse by using the moment method
performance index 20 , the proper (reliable) model feature [10], [43] or using the LSM with algebraic distances [34].
for the points set is a sphere. In order to demonstrate the outstanding performance of
The parameter covariance (36) with the distance-based our geometric fitting algorithms, we fit an extreme shape of a
algorithm is generally a little larger than that with the superellipse, a rectangle. We obtain the initial parameter
coordinate-based algorithm. If 20 is small enough, justifying values with " 1 from a circle fitting and an ellipse fitting,
ignoring of the second derivatives term in (24) and (28), successively. In detail, we use the gravitational center and rms
there is practically no difference of the parameter covar- central distance of the given points set as the initial parameter
iance (36) between the two algorithms. values for circle fitting, circle parameters for ellipse fitting [3],
[4], and, finally, ellipse parameters for superellipse fitting
(Fig. 7, Table 2). Superellipse fitting to the eight points in
4 FITTING EXAMPLES
Table 1 representing a rectangle terminated after seven
4.1 Superellipse Fitting iteration cycles for kak 7:8 10 9 (Fig. 7d, Table 2).
A superellipse [22] is a generalization of an ellipse and it is
described by
TABLE 1
f
a; b; "; x
jxj=a2="
jyj=b2=" 1 0; Eight Coordinate Pairs Representing a Rectangle
where a, b are the axis lengths and exponent " is the shape
coefficient. The use of superellipses in applications of image
AHN ET AL.: ORTHOGONAL DISTANCE FITTING OF IMPLICIT CURVES AND SURFACES 629
TABLE 2
Results of the Orthogonal Distance Fitting to the Points Set in Table 1
4.2 Cone Fitting the constraint weighting value wc is large and, thus, locks the
The standard model feature of a cone in frame xyz can be parameters from changing. If we perturb this quasi-equili-
described below: brium state, similarly to the random walking technique,
through adding a small artifact error to the initial parameter
f
; x x2 y2
z tan
=22 0;
values, then we could expect a faster convergence. With a
where , the only form parameter, is the vertex angle of a nonzero initial vertex angle value of =10, the iteration
cone. The position Xo , the origin of frame xyz, is defined at terminates after only 13 cycles for kak 2:9 10 6 (Fig. 8d).
the vertex. The orientation of a cone is represented by the
direction cosines of the z-axis, r3 in (8). However, from the 4.3 Torus Fitting
viewpoint of coordinate metrology [30], a better parameter- A torus is a quartic surface, and is described by
ization of a cone is
f
r1 ; r2 ; x x4 y4 z4 2
x2 y2 y2 z2 z2 x2
2 2 2
f
; r; x x y
r z tan
=2 0; 2
r22 r21
x2 y2 2
r22 r21 z2
r22 r21 2 0;
with a constraint on the position and rotation parameters where r1 is the radius of the circular section of the tube and
(see (32)) r2 is the mean radius of the ring. We obtain the initial
parameter values from a 3D-circle fitting [5] (Fig. 9) with
fc
ap ; ar
Xo XT r3
!; ' 0;
q
where the second form parameter r is the sectional radius of r1 20;circle =m; r2 rcircle :
a cone cut by the xy-plane (z 0) and X is the gravitational
center of the given points set. Torus fitting to the 10 points in Table 5 representing a half
As one of the test data sets used in an authorized torus is terminated after nine iteration cycles for kak
1:4 10 7 (Fig. 9d, Table 6).
certification [18], [30] process of our algorithms, the 10 points
in Table 3 representing only a quarter of a cone slice were 4.4 Superquadric Fitting
prepared by the German federal authority PTB (Physikalisch- A superquadric (superellipsoid) [9] is a generalization of an
Technische Bundesanstalt). We have obtained the initial ellipsoid and is described by
parameter values with 0 from a 3D-circle fitting [5] and
a cylinder fitting, successively (Fig. 8, Table 4). The cone fitting f
a; b; c; "1 ; "2 ; x
"1 ="2
to the points set in Table 3 with the constraint weighting
jxj=a2="1
jyj=b2="1
jzj=c2="2 1 0;
value wc 1 is terminated after 60 iteration cycles for
kak 2:3 10 7 . The convergence is somehow slow because where a, b, c are the axis lengths and exponents "1 , "2 are the
the initial cone parameters (i.e., the cylinder parameters) seem shape coefficients. In comparison with the algebraic fitting
to already provide a local minimum and it is especially slow if algorithm [37], our algorithms can also fit extreme shapes of
TABLE 3
Ten Coordinate Triples Representing a Quarter of a Cone Slice
630 IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, VOL. 24, NO. 5, MAY 2002
Fig. 8. Orthogonal distance fit to the points set in Table 3: (a) 3D-circle fit. (b) Circular cylinder fit. (c) Circular cone fit. (d) Convergence of the fit.
Iteration number 0-4: 3D-circle, 5-16: cylinder, and 17-:cone fit with the initial value of =10.
a superquadric (e.g., a box with "1;2 1 or a star with Superquadric fitting to the 30 points in Table 7 representing
"1;2 > 2). After a series of experiments with numerous sets a box is terminated after 18 iteration cycles for kak
of data points, we have concluded that our algorithms 7:9 10 7 (Fig. 10d). The intermediate ellipsoid fitting
safely converge with the parameter zone (a b c) showed a slow convergence in its second half-
phase (iteration number 10 to 42 in Fig. 10d) because of a
0:002
"1 and "2 10 and "1 ="2 500:
relatively large variance of the estimated major axis length a^ of
Otherwise, there is a danger of data overflow destroying the the ellipsoid caused by the distribution of the given points. In
Jacobian matrices of linear systems (13), (16), (24), and (28).
other words, the performance index 20 is not being changed
Additionally, a sharp increase of the computing cost with
very much by the variation of a^ (compare the standard
inner iteration is unavoidable. We obtain the initial
parameter values with "1 "2 1 from a sphere fitting deviation
^ aellip: 13:4393
a of the intermediate ellipsoid
^
and an ellipsoid fitting, successively (Fig. 10, Table 8). with that of the superquadric
^ aSQ 0:1034).
TABLE 4
Results of the Coordinate-Based Orthogonal Distance Fitting to the Points Set in Table 3
AHN ET AL.: ORTHOGONAL DISTANCE FITTING OF IMPLICIT CURVES AND SURFACES 631
Fig. 9. Orthogonal distance fit to the points set in Table 5: (a) 3D-circle fit. (b) Initial torus. (c) Torus fit. (d) Convergence of the fit. Iteration number 0-6:
3D-circle, and 7-: torus fit.
5 REAL DATA FITTING because they distort the fitting results. Conceptually, our
5.1 Data Acquisition algorithms possess very advantageous algorithmic features
In order to show how our algorithms perform on real data, a for segmentation and outlier detection of dimensional
sphere and an ellipsoid will be fitted to the same set of measurement data, namely, the geometric error definition
measurement points of a sphere-like object surface (Fig. 11a). and the parameters grouping in terms of form, position, and
The points set is acquired by our stripe projecting rotation. In this paper, utilizing these algorithmic features, we
3D-measurement system with the Coded-Light-Approach
used the following interactive procedure between segmenta-
(CLA) [7], [44] using the Gray code [26]. The measuring
system consists of a standard CCD camera and an LCD stripe tion, outlier detection, and fitting of the measurement points:
projector of ABW [1] and is calibrated by photogrammetric
1. From the following procedure, exclude the measure-
bundle adjustment using the circular coded targets for
ment points which belong to the known objects, e.g.,
automation of the calibration procedure [2], [6]. Our measuring stage or already detected and identified
3D-measurement software determines the coordinates of objects.
the object surface points along the stripe edges. The number 2. Initialize the model feature parameters through a
of the measured surface points is about 29,400 (Fig. 11b), model fitting to a well-conditioned object portion or
from which every eighth point (subtotal 3,675 points) is used through a fitting of a simple model feature, e.g. a
for the sphere and the ellipsoid fitting in this section (Fig. 12). sphere instead of the target ellipsoid. Also, initialize
5.2 Segmentation, Outlier Detection, and the safety margin t of the point searching domain
Model Fitting volume to be used in the next step, e.g., t0 r=2 for a
sphere.
With real data fitting, we have to find an effective search
3. For the current model feature, determine the
(segmentation) method for the measurement points which
orthogonal error distances di of each measurement
potentially belong to the target model feature. And, outliers point lying inside the domain volume (see the next
should be detected and excluded from the model fitting section for a detailed description) and evaluate the
rms error distance
TABLE 5 s
Ten Coordinate Triples Representing a Half Torus 1X m
error d2 ;
m i1 i
TABLE 6
Results of the Coordinate-Based Orthogonal Distance Fitting to the Points Set in Table 5
Fig. 10. Orthogonal distance fit to the points set in Table 7: (a) Sphere fit. (b) Ellipsoid fit. (c) Superquadric fit. (d) Convergence of the fit. Iteration
number 0-42: ellipsoid and 43-: superquadric fit.
4. Determine the inliers set of measurement points accuracy of the measuring system, terminate the
lying inside the domain volume and having error procedure.
distances of di tthreshold error , where tthreshold is the 6. Update the safety margin t tgrowing tthreshold
outlier threshold factor (we used tthreshold 2:5, i.e., fit error of the domain volume, where tgrowing is
we assumed 1.24 percent outlier probability in the the domain growing factor (we used tgrowing 1:0).
domain volume according to the Gaussian error 7. Repeat again from the third step.
distribution). Optionally, if there is no change in the
5.3 Domain Volume for Measurement Points
inliers set, terminate the procedure.
In the first step of the procedure described in the previous
5. Fit the model feature to the inliers set and save the
section, 256 of 3,675 measurement points were detected and
resulting rms error distance fit error . If fit error is removed from the points list as they belong to the measuring
smaller than a given error level concerning the stage (Z 0). In order to not only exclude the outliers from
the model fitting but also avoid unnecessary determination of
TABLE 7 the orthogonal contacting points in the third step of the
Thirty Coordinate Triples Representing a Box procedure, we applied a two-step domain volume criterion.
First, we restrict the measurement points domain within a
box with a safety margin t containing the interest portion of the
standard model feature (6) defined in frame xyz. In particular,
for an ellipsoid, the domain box can be defined below:
TABLE 8
Results of the Coordinate-Based Orthogonal Distance Fitting to the Points Set in Table 7
large set of measurement points at minimal computing cost grouping in terms of form, position, and rotation, makes
(for each measurement point, we need only a few multi- possible a simple and inexpensive search for the measure-
plications for coordinate transformation). ment point candidates which potentially belong to the model
Next, of the measurement points lying inside the domain feature. The time-consuming determination of the orthogo-
box, we actually determine the orthogonal contacting point nal contacting points, which is necessary for the outlier
if the measurement point also lies between two iso-features detection, is to be carried out only for the measurement point
(11) with constinner < 0 and constouter > 0, respectively. In candidates lying inside the domain volume.
particular, for an ellipsoid, we use
5.4 Fitting Results
constinner f
ag ; xinner with With the ellipsoid fitting, we have applied the parameter
8 T constraints of ! 0 and ' 0 with a weighting value of wc
<
max
a=2; a t; 0; 0
> : a min
a; b; c
xinner
0; max
b=2; b t; 0T 1:0 108 (see Section 3.4) since the object surface seems to be
: b min
a; b; c
>
: the top face of a horizontally lying ellipsoid. The computing
0; 0; max
c=2; c tT : c min
a; b; c; time with a Pentium III 866 MHz PC was a total of 7.8 s for
and 17 rounds of sphere fitting with a final parameter update size
of kak 3:7 10 7 and a total of 94.1 s for 26 rounds of
constouter f
ag ; xouter with ellipsoid fitting with kak 6:5 10 7 . The number of the
8 T
<
a t; 0; 0
> : a min
a; b; c outliers (including the out-of-domain points) was 727 for
xouter
0; b t; 0 T
: b min
a; b; c error 0:0596 mm and 1,005 for error 0:0309 mm with the
>
:
0; 0; c t T
: c min
a; b; c: sphere and the ellipsoid fitting, respectively (Fig. 12d). If we
compare Fig. 12b and Fig. 12c, an ellipsoid seems to be the
The above two-step criterion, defining the domain better model feature than a sphere for the measured object
volume at a low computing cost by utilizing the parameters surface. However, a look at Table 9 and Table 11 reveals the
Fig. 11. Sphere-like object surface: (a) Stripe projection. (b) Measured points cloud.
634 IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE, VOL. 24, NO. 5, MAY 2002
Fig. 12. Results of the model fitting to the points cloud (3; 419 3; 675 256 points) from Fig. 11b. Distance error bars are 10 times elongated.
(a) Sphere fit without and (b) with outlier elimination. (c) Ellipsoid fit with outlier elimination under the constraints of ! 0 and ' 0. (d) Convergence
of the fit with outlier elimination. Iteration number 0-51: 17 rounds of sphere fitting and 52-162: 26 rounds of ellipsoid fitting. The initial sphere
parameters are taken from the gravitational center and the rms central distance of the data points. After the first round of the sphere fitting, the initial
number of the outliers (including the out-of-domain points) Noutlier 2; 515 is reduced to 177 and, thereafter, increased.
TABLE 9
Results of the Coordinate-Based Orthogonal Distance Fitting to the Points Cloud
of Fig. 12b (Sphere Fitting) and Fig. 12c (Ellipsoid Fitting)
AHN ET AL.: ORTHOGONAL DISTANCE FITTING OF IMPLICIT CURVES AND SURFACES 635
TABLE 10 TABLE 11
Correlation Coefficients of the Sphere Parameters in Table 9 Correlation Coefficients of the Ellipsoid Parameters in Table 9
[38] D. Sourlier, ªThree Dimensional Feature Independent Bestfit in Hyung Suck Cho received the BS degree from
Coordinate Metrology,º PhD Thesis no. 11319, ETH Zurich, Seoul National University, Korea in 1971, the MS
Switzerland, 1995. degree from Northwestern University Evanston,
[39] S. Sullivan, L. Sandford, and J. Ponce, ªUsing Geometric Distance Illinois, in 1973, and the PhD degree from the
Fits for 3-D Object Modeling and Recognition,º IEEE Trans. Pattern University of California at Berkeley in 1977. From
Analysis and Machine Intelligence, vol. 16, no. 12, pp. 1183-1196, 1977 to 1978, he was a postdoctoral fellow in the
Dec. 1994. Department of Mechanical Engineering, Univer-
[40] G. Taubin, ªEstimation of Planar Curves, Surfaces, and Nonplanar sity of California at Berkeley. Since 1978, he has
Space Curves Defined by Implicit Equations with Applications to been a professor in the Department of Production
Edge and Range Image Segmentation,º IEEE Trans. Pattern Engineering, Department of Automation and De-
Analysis and Machine Intelligence, vol. 13, no. 11, pp. 1115-1138, sign, Seoul Campus, and is currently with the Department of Mechanical
Nov. 1991. Engineering, Korea Advanced Institute of Science and Technology
[41] D.A. Turner, ªThe Approximation of Cartesian Coordinate Data by (KAIST), Korea. From 1984 to 1985, he was a visiting scholar at the
Parametric Orthogonal Distance Regression,º PhD thesis, School of Fraunhofer Institute for Manufacturing Engineering and Automation (IPA),
Computing and Math., Univ. of Huddersfield, U.K., 1999. Germany, where he carried out research on robot-based assembly. He
[42] K. Voss and H. SuÈûe, ºInvariant Fitting of Planar Objects by has been invited as a short-term visiting scholar to several universities:
Primitives,º IEEE Trans. Pattern Analysis and Machine Intelligence, Ritsumeikan University, Japan, the University of Paderborn, Germany,
vol. 19, no. 1, pp. 80-84, Jan. 1997. and the New Jersey Institute of Technology, in 1987, 1992, 1998,
[43] K. Voss and H. SuÈûe, ªA New One-Parametric Fitting Method for respectively. From 1995 to 1996, as a visiting professor, he participated in
Planar Objects,º IEEE Trans. Pattern Analysis and Machine graduate school education for the Advanced Manufacturing Program
Intelligence, vol. 21, no. 7, pp. 646-651, July 1999. (AMP) of the University of California, San Diego. Dr. Cho's research
[44] F.M. Wahl, ªA Coded-Light Approach for 3-Dimensional (3D) interests are focused on the area of environment perception and
Vision,º Research Report no. 1452, IBM Zurich Research Labora- recognition for mobile robots, machine vision and pattern classification,
tory, Switzerland, Sept. 1984. and application of artificial intelligence/machine intelligence. During his
research career, he has published six book chapters and more than 346
Sung Joon Ahn received the BS degree in research papers (276 papers in international journals and conferences
mechanical design and production engineering and 66 papers in Korean journals). He now serves on the editorial boards
from Seoul National University in South Korea in of five international journals, including Control Engineering Practice
1985. He received the MS degree in production (IFAC). In addition to his academic activities, he serves and/or has served
engineering from the Korea Advanced Institute of on a few technical committees (TC) of IFAC and IMEKO: TC on Robotics,
Science and Technology (KAIST) in 1987. He TC on Advanced Manufacturing (IFAC), and Measurements on Robotics
worked as a junior research scientist at the (IMEKO). He has been general chair and/or cochair of several interna-
research center of LG Electronics from 1987 to tional conferences, including SPIE-Opto Mechatronic Systems (2000,
1990. Since 1991, he has been working as a 2001) and IEEE/RSJ IROS (1999). For his achievements in research
research scientist for the Fraunhofer Institute for works in the fields of robotics and automation, Dr. Cho has been endowed
Manufacturing Engineering and Automation (IPA) in Stuttgart, Germany. with a POSCO professorship from Pohang Steel Company, Korea, since
His research interests include pattern recognition, optical 3D-measure- 1995. In 1998, he was awarded the Thatcher Brothers Prize from the
ment, close-range photogrammetry, camera calibration, and 3D-informa- Institution of Mechanical Engineers, United Kingdom, and he also
tion processing. received the fellowship of Alexander von Humboldt of Germany in 1984.
He is a member of the IEEE.
Wolfgang Rauh received the Doctorate degree Hans-JuÈrgen Warnecke studied mechanical
in 1993 from the University of Stuttgart. He engineering at the Technical University of
worked at the University of Stuttgart from 1984 Braunschweig, Germany. He was a research
until 1989 after having received the Diploma engineer at the Institute for Machine Tools and
degree in mechanical engineering from the Manufacturing afterward, from 1965 to 1970, a
University of Karlsruhe in 1984. He then became managing director for planning and manufactur-
head of the Industrial Image Processing Group ing at the Rollei-Werke, Braunschweig, a camera
at the Fraunhofer Institute for Manufacturing factory. Since 1971, he has been a full professor
Engineering and Automation (IPA). In 1991, he for industrial manufacturing and management,
was made head of the Information Processing University of Stuttgart, and the head of the
Department at the same institute. In this department, a wide variety of Fraunhofer Institute for Manufacturing Engineering and Automation
projects in the area of image processing are carried out. (IPA) of the Fraunhofer Society for Applied Research. His main fields of
research and development are management and organization of
industrial companies, computer integrated manufacturing, computer-
aided planning of material flow, simulation, production planning and
control, manufacturing processes, flexible manufacturing systems,
industrial robots, automation of handling and assembly, quality control,
industrial measurement, cleanroom manufacturing, semiconductor
manufacturing automation, and maintenance. He has published
10 books with many publications in the field of production, industrial
engineering, and automation. Since 1 October 1993, he has been the
president of the Fraunhofer Society, the largest institution for applied
research and development in Europe with a budget of EUR 0.9 billion, of
which EUR 300 million are proceeds from 3,000 private enterprises.
There are 11,000 employees in 56 institutes. In the years 1995 to1997,
he was the president of VDI, the Association of German Engineers, the
largest institution of this kind in Europe.