Measuring Fiber Orientations in Nonwoven Web Images Using Corner Detection by Be Zier Fitting Curves
Measuring Fiber Orientations in Nonwoven Web Images Using Corner Detection by Be Zier Fitting Curves
Abstract
This paper describes a novel method for measuring fiber orientations in nonwoven web images by using Bézier fitting
curves to detect corners of fiber edges and to separate crossing fiber edges. First, the Canny detector was adopted to
extract fiber edges. Second, Bézier curve fitting was used to fit each fiber edge for calculating the curvature of every point
on the edge. Third, corner points were detected by locating points where the curvatures were minimal on various edges
and below the threshold to divide edges into segments for orientation calculations. Last, a formula calculating the fiber
orientation statistics based on the Euclidean distance was established. The experiment results demonstrated that the
proposed method is robust for analyzing different nonwoven web images, and has a high accuracy for corner detection
and fiber orientation calculation.
Keywords
fiber orientation, corner detection, Bézier curve, nonwoven
Measuring fiber orientations in nonwoven webs is an colleagues proposed a multi-focus image fusion techni-
important task in evaluating performance of nonwoven que to generate a sharp image from sequential images
products. Varying degrees of fiber anisotropy in non- focused at different depths for measuring fiber orienta-
woven webs impart unique material properties to the tions in thick nonwovens.9 However, most of these
construct.1 Two of the main ways that are currently existing image-analysis algorithms regarded a nonwo-
used to measure fiber orientations in a nonwoven web ven web as a single structure without dissecting fibers
are mechanical testing and image analysis. Recently, that were bonded or intersected with others before cal-
image analysis has become more popular for fiber culating fiber orientations.4,9 As a result, two bonding
orientation testing mainly because of its efficiency and or crossing fibers might be traced continuously as the
the availability of high-resolution imaging sensors.2 same fiber, causing a false measurement in fiber
Huang and Bresee and Pourdeyhimi and colleagues orientation.
proposed a direct tracking method to characterize non-
woven web structures.3–5 Xu developed a skeletoniza-
tion algorithm to extract the simplified structure of a
1
nonwoven web from which the orientations and lengths Department of Textile Engineering, Donghua University, Shanghai, China
2
Key Laboratory of Textile Science & Technology, Donghua University,
of fiber segments could be estimated.6 Pourdeyhimi and
Shanghai, China
colleagues utilized a Fourier transform function to 3
Department of Merchandising and Digital Retailing, University of North
measure the fiber orientation in assembled structures.7 Texas, Denton, Texas, USA
4
These analysis methods often used simulation images Henan Clothing Textiles Engineering Research Center, Henan University
for result verification and were applicable to thin non- of Engineering, Zhengzhou, Henan, China
wovens, because it was difficult to acquire a fully
Corresponding author:
focused image for fibers on different layers. Image RongWu Wang, Key Laboratory of Textile Science & Technology,
fusion is a process of combining information from mul- Donghua University, Shanghai, 201620, P.R. China.
tiple images into a single composite image.8 Wang and Email: [email protected].
Hou et al. 2121
Figure 1. (a) Original nonwoven web image and (b) partially enlarged detail.
2122 Textile Research Journal 88(18)
Figure 2. Result of the Canny detector: (a) original image of nonwoven web; (b) result of the Canny detector; (c) part of the Canny
detector result.
Figure 3. Effect of edge thinning on the image in Figure 2b: (a) Magnification of the Canny detector image; (b) magnification of the
edge-thinning image.
2. Calculate the grayscale gradient of every pixel to The Canny detector exhibits excellent performance,
get potential edges that have a sudden change in preserving most of the valuable edge information in the
intensity. nonwoven web image. Unlike the Canny detector,
3. Thin the potential edges using the non-maximum another commonly used edge detector, LoG operator,23
suppression algorithm.26 often loses certain edge information in dark regions.
Figure 4 shows comparison results of Canny edge
Regular fiber edges should be constituted by 1 px detection and LoG edge detection.
wide lines showing fiber orientations, which means
that every pixel on an edge has one or two neighbors.
However, there is a 45 or 135 edge with uniform areas Corner detection using Bézier contours
on either side, and the non-maximum suppression
could produce thick edges, as shown in Figure 3a.27
Bézier fitting contour
Fiber edges generated by the Canny detector are not In a 2D nonwoven image, segments of edges from dif-
1 px wide. Redundant neighboring pixels should be ferent fibers are connected at crossing points, which
deleted using an edge-thinning process.28 Thinning is are also the corners of edge polygons. A corner is gen-
a morphological operation used to remove pixels that erally defined as the local maximum of the absolute
are not essential for edge connections. The edge-thin- value of the curvature of a curve in topology.27 In
ning effect is shown in Figure 3b. order to compute the fiber orientation distribution in
Hou et al. 2123
Figure 4. Comparison of Canny and LoG edge detectors: (a) the Canny detector image; (b) magnification of the Canny detector
image; (c) the LoG detector image; (d) magnification of the LoG detector image.
a nonwoven web, the directions of all fiber segments fitting here is to locate corner points of joining fibers.
need to be accumulated precisely. We must detect all Therefore, we chose Bézier curves to fit short segments
corners on fiber edges based on changes in curvature. of fiber edges due to its simplicity and efficiency.
A curve at a corner has a much larger curvature, or a The Bézier curve is a parametric curve frequently
smaller angle between its two tangent lines, than at used in engineering science to model a discrete contour.
other points. In a bitmap image, it is difficult to find It contains two endpoints and several control points,
real corners because fiber edges are represented by and its shape can be controlled by changing the relative
discrete pixels, instead of continuous curves. Many locations of the control points. The Bézier curve has
curve-fitting methods can be used to approximate two significant advantages, summarized as follows:
discrete pixels. In general, NURBS curves are more
robust for fitting complex curves,29,30 while Bézier 1. It can easily be expressed as a smooth curve by a
curves are more appropriate for fitting simple curves. parametric equation.
Fiber segments in a nonwoven material are relatively 2. The form of the Bézier curve only relates to the end-
short and straight lines, and the purpose of the curve points and the control point.
2124 Textile Research Journal 88(18)
The Bézier curve can be represented as:31 Bézier curve is written as:30
xðtÞ ¼ a0 þ a1 t þ a2 t2
X
n t 2 ½0, 1 ð2Þ
QðtÞ ¼ Vi Bni ðtÞ, 0t1 ð1Þ yðtÞ ¼ b0 þ b1 t þ b2 t2
i¼0
A nonwoven web image has abundant fiber edges,
which require massive calculations for corner detection.
where Vi is the control point and Bni is the Bernstein A quadratic Bézier curve is found to be an effective
polynomial. The parametric equation of a quadratic choice to model a fiber-fitting contour because fiber
edges are relatively short, straight-line segments.
The main step to calculate the curvatures of pixels
on a fiber edge is to fit the edge with a Bézier curve. The
pixel where a curvature needs to be calculated is called
the current pixel (Figure 5). Fitting a quadratic Bézier
curve is always a convex curve tangent at the endpoints,
with two lines passing the control points.
If the current pixel (i.e. a control point) is a corner
point, there will be a significant deviation between the
fitting curve (Bézier curve) and the original fiber edge.
Thus, it is necessary to divide the fiber edge into two
segments at the current pixel, change the current pixel
to an endpoint, and fit the segments on both sides sepa-
rately. Another endpoint and a control point for each
segment are also needed, and can be decided by the
Figure 5. Endpoints and a control point of a quadratic fitting scale s (the distance between the two endpoints),
Bézier curve. as shown by P0–P1 and P0–P4 in Figure 6.
Figure 6. Fitting a Bézier curve on both sides of a current point (P0 is the current point, P1 and P4 are endpoints, P2 and P3 are
control points).
Hou et al. 2125
Figure 7. The fitting curve deviated from the actual edge (arc AC has an obvious deviation from the actual path ABC).
where t is the parametric of a quadric Bézier curve, and where xn , yn are the coordinates of the tangents’ end-
x_ ðtÞ, y_ðtÞ, x€ ðtÞ, y€ ðtÞ are the first and second derivatives points. The corner is defined as a point where y(x,y) is
of a Bézier curve, respectively. the minimum along a fiber edge.
However, the curves on both sides of the current In Figure 9a, A is the corner point and B and C are
point do not have the same expression and are not C2 adjacent points of A on a fiber edge. Figure 9b displays
continuous. Hence, the first derivative and the second the angles of all points on the edge that are computed
derivative cannot be calculated. at the scale s ¼ 5. For the edge segment, if the angle of
The curvature k has a direct relation with the angle, a point is the minimum among all the points and is
y(x,y), of two tangent lines. A tangent line is the limit smaller than a preset threshold (to be discussed in
case of the secant. Figure 8 shows that when the two the following section), this point can be regarded as a
secant endpoints infinitely close, the secant slope is candidate corner. For example, point A in Figure 9
approximately equal to the tangent slope. The slope of has y ¼ 90 , which is the minimum and smaller
the secant can be easily calculated, avoiding the calcula- than the threshold, and thus A is a candidate corner
tion of curve derivatives. y(x,y) is then defined as follows: on this edge.
0 1
! !
n1 n2
Removal of false corners
ðx, yÞ ¼ cos1 @ A ð5Þ
! ! As shown in Figure 10, the fiber edges are divided
n1 n2
into several segments by corners (all of F points and
T points). Partial segments from the same fiber edge are
where
not oriented in exactly the same direction. The angle
between two adjacent segments determines whether to
!
n1 ¼ lim ðx1 x0 , y1 y0 Þ ð6Þ
ðx1 ,y1 Þ!ðx0 , y0 Þ
reserve a corner candidate or not. It is necessary to set
an appropriate angle filtering threshold that balances
! algorithm efficiency and precision, owing to how com-
n2 ¼ lim ðx2 x0 , y2 y0 Þ ð7Þ
ðx2 ,y2 Þ!ðx0 , y0 Þ putational complexity is augmented exponentially with
increasing targets.
Figure 11 shows the preserved corner numbers after
the corner candidates in Figure 10 were filtered using
different angle thresholds. Preserving more corner can-
didates means more segments of fiber edges can be
separated – that is, a higher computational cost.
On the other hand, eliminating more corner candidates
will lead to poor accuracy in orientation calculations.
So setting a proper threshold to filter corner candidates
is important for both the efficiency and accuracy of the
algorithm. From Figure 11, it can be seen that at the
Figure 8. Secant approaches the tangent. threshold of 175, 37% more corners are retained than
Figure 9. Change of angle y along a sequence of points: (a) a sequence of points; (b) angles of two secants.
Hou et al. 2127
Figure 10. All candidate corners; F (yellow) marked false candidates, T (red) marked reserved corners.
8 qffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffiffi
< li ðÞ ¼ R ðx1 ,y1 Þ fds ðx1 x2 Þ2 þ ð y1 y2 Þ2
ðx2 ,y2 Þ
ð8Þ
:
¼ tan1 jjx22 x11jj
y y
Figure 11. Relationship between the number of corners and Fiber web orientations can be calculated from the
threshold. direction distributions of fiber segments. The fiber
web orientation in a certain direction is defined as the
ratio of the accumulated length of fibers in this direc-
at the threshold of 150, and 6.9% more corners than at tion as opposed to the total length of the fibers in all
the threshold of 170. Since there was no significant directions. Therefore, the fiber orientation distribution
increase in corners when the angle threshold varied of a web image can be written as:
from 170 to 175, we set the threshold to be 170 in
this project.
Lð Þ
Fð Þ ¼
Lð0Þ þ Lð1Þ þ þ Lð178Þ þ Lð179Þ
Pn
Orientation calculation i¼0 li ðÞ
¼ 2 ½0, 180o Þ
The fiber orientation distribution in a nonwoven Lð0Þ þ Lð1Þ þ þ Lð178Þ þ Lð179Þ
web provides important information describing the ð9Þ
2128 Textile Research Journal 88(18)
where is the angle between the fiber segment and In the big and small curvature cases, the four methods
the horizontal line, L() is the sum length of successfully find all the corners. In the other cases, the
fiber edges whose angles are equal to , li() is the three previously reported algorithms ignore or falsely
length of the fiber segment whose angle is equal to , locate some corners. CSS corner detection tends to
and n is the number of fiber edges whose angles detect distinct corners, while both CPDA and TAR
are equal to . use change of chords to represent the point’s curvature
and more likely miss indistinctive corners.
To compare the accuracy and practicability of the
Results and discussion four algorithms, each algorithm was applied to actual
measurement of fiber orientation. The fiber edges have
Comparison tests on corner detection been cut into several segments by corners; these segments
The measurement accuracy of fiber orientation distri- should be close to straight lines. The higher precision of
bution is closely related to corner detection accuracy. In corner detection can ensure that the connecting line
this section, we compare our proposed corner detection between an endpoint and a corner point is closer to an
algorithm with three previously reported contour-based actual fiber edge. The ratio of actual fiber edges covered
algorithms: CPDA, CSS, and TAR. by connecting lines is shown in Table 1, which demon-
Figure 12 displays the corner detection results of strates the significant accuracy made by the proposed
five cases with the four algorithms, in which fiber algorithm for nonwoven fiber images.
edge segments are indicated by black pixels, and cor-
ners are marked by red points. The five cases include a
big curvature curve, a normal curve, a small curvature
Comparison tests on fiber orientation distribution
curve, a curve with multiple angles, and an arc curve. The mechanical properties of a nonwoven, such as
These five cases are the fiber edges extracted from a real breaking strength, are disparate in various orientations,
nonwoven image. The results indicate that the pro- and their distributions should be associated with
posed algorithm can correctly detect all corners in the fiber orientation distribution. The fiber orientation
these cases, outperforming the other three algorithms. distribution in a nonwoven web can be expressed by
Hou et al. 2129
Sketch map
strengths along different directions. A thermal-bonded orientation distribution calculated by the Bézier fitting
nonwoven was used to perform the tensile test.32 As curve algorithm is highly consistent with the strength dis-
shown in Figure 13, the tested nonwoven has maximum tribution measured by the tensile test. On the contrary, the
strength in the machine direction (near 0 or 180 ), and fiber orientation distributions obtained from the other
minimum strength in the vertical direction (near 90 ). Fifty three algorithms (CSS, CPDA, TAR) show significant
images of the same thermal-bonded nonwoven were cap- differences from the strength distribution, although their
tured for the analysis, and the fiber orientation distribu- overall trends are similar. The comparison proves the pro-
tions of the nonwoven obtained from different algorithms posed algorithm is very well suited for measuring fiber
are presented in Figure 13 as well. It is clear that the fiber orientation distributions in nonwovens.
2130 Textile Research Journal 88(18)
25. Canny J. A computational approach to edge detection: 29. Lim SP and Haron H. Cube Kohonen self-organizing
Readings in computer vision. San Francisco, CA: map (CKSOM) model with new equations in organizing
Morgan Kaufmann, 1987, pp.184–203. unstructured data. IEEE Trans Neural Netw Learn Syst
26. Song Y, Glasbey CA, Polder G, et al. Non-destructive 2013; 24(9): 1414–1424.
automatic leaf area measurements by combining stereo 30. Lim SP and Haron H. Surface reconstruction techniques:
and time-of-flight images. IET Comput Vision 2014; a review. Artif Intell Rev 2014; 42(1): 59–78.
8(5): 391–403. 31. Shao L and Zhou H. Curve fitting with Bézier cubics.
27. Mokhtarian F and Suomela R. Curvature scale space Graph Model Im 1996; 58(3): 223–232.
for robust image corner detection. In: International con- 32. Pourdehyhimi B, Dent R, Jerbi A, et al. Measuring fiber
ference on pattern recognition, Brisbane, Australia, 20 orientation in nonwovens part V: real webs. Text Res J
August 1998; pp. 1819–1823. 1999; 69(3): 185–192.
28. Zhang Z, Ma S, Liu H, et al. An edge detection approach
based on directional wavelet transform. Comput Math
Appl 2009; 57(8): 1265–1271.