Acoustic Emission-based Damage Localization Using
Acoustic Emission-based Damage Localization Using
Abstract
Acoustic Emission (AE) has emerged as a popular damage detection and localization tool due to its high performance
in identifying minor damage or crack. Due to the high sampling rate, AE sensors result in massive data during long-
term monitoring of large-scale civil structures. Analyzing such big data and associated AE parameters (e.g., rise time,
amplitude, counts, etc.) becomes time-consuming using traditional feature extraction methods. This paper proposes a
2D convolutional neural network (2D CNN)-based Artificial Intelligence (AI) algorithm combined with time–frequency
decomposition techniques to extract the damage information from the measured AE data without using standalone
AE parameters. In this paper, Empirical Mode Decomposition (EMD) is employed to extract the intrinsic mode func-
tions (IMFs) from noisy raw AE measurements, where the IMFs serve as the key AE components of the data. Continu-
ous Wavelet Transform (CWT) is then used to obtain the spectrograms of the AE components, serving as the “artificial
images” to an AI network. These spectrograms are fed into 2D CNN algorithm to detect and identify the potential loca-
tion of the damage. The proposed approach is validated using a suite of numerical and experimental studies.
Keywords: NDT, Damage detection and localization, AE, EMD, WT, CNN, Acoustic sensor
© The Author(s) 2022. Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which
permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the
original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or
other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line
to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory
regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this
licence, visit http://creativecommons.org/licenses/by/4.0/.
defects in concrete containment structures were identi- suitable selection of features to identify the severity and
fied using the AE-based technique [12]. AE parameters location of the damage using AE data.
obtained from an instrumented concrete wall were con- With the advancement in deep learning (DL)-based
sidered to detect and classify the damage using a novel Artificial Intelligence techniques, the SHM researchers
clustering and visualization approach. Quy and Kim [26] have explored various Convolutional Neural Networks
proposed a method based on AE data to detect and local- (CNNs) for crack localization [11, 35]. In these methods,
ize the defect in pipeline systems. The time–frequency the actual images of the crack can be used as the train-
decomposition method was used to detect the AE event ing data for the identification and classification of cracks
as well as localize the AE source by determining the time without requiring any specific feature selection. Recently,
difference of arrival. An experimental test was conducted fast Fourier transform (FFT) and various other time–fre-
on a pipeline system subjected to internal pressure while quency (TF) methods such as short-term Fourier trans-
collecting AE data using AE sensors. It was concluded form (STFT), wavelet transform (WT) [4, 28], empirical
that the proposed method could be applied for both WT (EWT) [13, 43] transform (HHT [6, 15] empirical
offline and online monitoring of ageing pipelines. mode decomposition (EMD) [7, 31], and synchro-squeez-
In a recent study, Manthei and Plenkes [22] provided ing transform (SST) [19, 24, 34], have been explored to
a comprehensive review of AE-based structural con- obtain TF images that were fed into DL techniques in
dition assessment in underground structures. In this both mechanical and structural systems [38]. explored
research, the AE technique was applied to detect the dif- three different TF methods (i.e., STFT, WT and HHT),
ferent levels of deformation in mines. On the other hand, and the resulting TF images of bearing diagnostic data
Calabrese and Proverbio [10] provided a review of the were used as the input to the CNN. It was shown that
AE techniques to detect the damage due to corrosion in the resizing of TF-images greatly minimized the training
various engineering systems. In addition, the study dis- time but significantly reduced the classification accuracy
cussed the importance of the AE technique as a damage [40]. used eight different TF methods, and the TF images
detection and localization tool for material or systems were used as the input to AlexNet-based DL architec-
subjected to corrosion-induced damage. On the other ture. Two bearing datasets with different loads and
hand, Verstrynge et al. [39] discussed the application speeds have been used to validate the proposed method.
of AE-based methods to detect, assess, and identify the Whereas STFT provides low-resolution TF images due to
severity of damage in masonry structures. The study pro- the fixed window size, CWT can provide high-resolution
vided a detailed discussion regarding the current chal- images in both time and frequency domain due to its self-
lenges, findings, and future works that can be conducted adaption of window size [29, 38, 40].
to improve the performance of AE-based methods as a Pandhare et al. [25] used spectrograms as the input
damage detection tool for masonry structures. to the CNN. The performance of CNN was compared
Ma and Du [23] integrated AE parameters into an with conventional machine learning methods [14].
advanced deep neural network to detect cracks in pre- used EWT to convert current signals of a three-phase
stressed concrete elements. A set of experimental and induction motor to 2D grayscale images, which were
full-scale studies were undertaken to extract the crack used in CNN to classify several types of faults, includ-
signature of the prestressed concrete samples using AE ing bearing axis deviation, stator and rotor friction,
features. In a recent study, Wang et al. [42] developed a rotor aluminum end ring break, bearing noise and poor
new technique based on AE measurements to evaluate insulation. Sun et al. [36] adopted Multi-SST to ana-
the damage in concrete elements. The wavelet packet lyze time-varying signals for obtaining TF matrices
transform method was utilized to decompose the meas- that could accurately reflect the raw signal information.
ured AE signal into a set of frequency bands, followed by Sparse Feature Coding and Dictionary Learning were
calculating the energy of the coefficient in each frequency then implemented to extract the low dimensional and
band. The variation in energy across various coefficients most discriminative features. Liu et al. [20] proposed
was used to estimate the damage level. On the other a fault diagnosis method based on CNN and transfer
hand, Barbosh et al. [8] applied a new feature extraction learning, where CWT was used to extract the features
technique by combining EMD with Shannon Entropy in of the sampled signal data, and the resulting scalograms
AE data to detect and localize minor damage. The pro- were used as input to the LeNet-5 CNN architecture.
posed technique was used to monitor and evaluate the It was shown that the results of CNN converged very
existing condition of the walls in a dam under various fast with reasonable accuracy. Zhang et al. [44] used 2D
operational conditions. However, most of these studies spectrograms which were used as input to the LeNet-5
are either based on pattern recognition or signal process- CNN structure. It was demonstrated that the proposed
ing techniques that require a computationally intensive method had a high fault-diagnosis accuracy rate and
strong classification ability for various health condi- experimental studies is conducted next to show the per-
tions. In another study, Kumar et al. [17] implemented formance of the proposed method.
grayscale scalograms of an accelerometer installed on
a bearing housing as the input to the CNN. Shao et al.
[33] proposed a DL-based multi-signal fault diagno- Proposed AE‑based damage localization method
sis method in which the acquired data was converted Continuous wavelet transform
into scalograms that were used as input to the CNN. WT provides an improved TF representation of the sig-
However, most of the research associated with TF nals in a multi-resolution framework. Continuous wave-
image-based deep learning has been explored only in let transform (CWT) is considered one of the powerful
mechanical systems; there has been a very limited focus signal processing techniques that are applied in various
on SHM. applications such as image compression, noise removal,
Contrasting machine health monitoring, there has and pattern recognition [29] CWT of a signal x(t) is
been minimal research conducted in SHM where the TF defined as:
images were fed into CNN for damage or anomaly detec- ∞
tion. Tang et al. [37] proposed a data anomaly detection r t−m
cm (x) = x(t)ψ ∗ ( )dt (1)
method based on a 2D CNN. FFT was implemented to −∞ r
generate frequency domain images of the segmented
The inverse CWT (ICWT) can be determined as
time series, which were analyzed in CNN for data anom-
follows:
aly classification. The results showed that the proposed
approach could detect the multipattern anomalies (such ∞
1 1 r ∗ t−m dr
as outlier, minor, missing data, trend and drift) of SHM x(t) = cm y ψ dm 2 (2)
data with high accuracy. Acceleration data of a real long‐ Cϕ |r| r r
−∞
span cable‐stayed bridge was used for validation, and
the results were compared with a deep neural network- where Cϕ can be expressed as:
based framework. Li et al. [21] used SST to represent the
|ψ(f )|2
∞
energies of AE signals in the TF domain. A multi-branch Cϕ = df < ∞ (3)
|f |
CNN model with Adam parameter optimization algo- −∞
rithm was developed as the feature extractor and clas- where r and m represent scale and translation of the
sifier to automatically distinguish multiple types of AE mother wavelet, respectively. The basis function is called
waves resulting from crack, impact and operational con- mother wavelet ψ(t), where superscript (∗) denotes its
ditions. The proposed model utilized the TF energy dis- complex conjugate. With the appropriate choice of r
tribution features of AE waves in a rail track and achieved and m, CWT utilizes the shifted and scaled versions of
higher accuracy than the traditional CNN models. How- ψ and subsequently estimates its inner product with x(t).
ever, most of these applications were employed directly In this paper, CWT is applied to generate spectrograms
using the vibration data, which are only suitable for of key AE components (i.e., IMFs) that are used to feed
global damage detection and have a limited application the CNN model to detect and identify the potential loca-
with respect to localized damage detection such as crack tion of the damage. A mixture of sine signals with three
localization. different frequencies, including f1= 1.4 Hz, f2= 3.5 Hz,
This study aims to propose a new AE data-based 2D and f3 = 7.0 Hz is considered to show the performance
CNN model to automate the detection and identifica- of CWT as shown in Eq. 5. CWT is applied to the mixed
tion of the potential location of the damage. In this paper, signal using two popular mother wavelet basis func-
an EMD-based TF method is developed to eliminate the tions (i.e., Morse and Morlet) to investigate and compare
presence of noise and extract the key AE components the resolution of extracted CWT spectrograms of both
of the measured data obtained from limited AE sensors. basis functions. Figure 1 (a) shows the Fourier spectrum
Continuous Wavelet Transform (CWT) is then used of the mixed-signal X(t), whereas Fig. 1 (b-c) represents
to extract the spectrograms of the key AE components. the spectrogram of X obtained from CWT using Morse
The resulting spectrograms form the training and testing and Morlet function as a mother wavelet, respectively.
database to validate the proposed 2D CNN, which can It can be seen that the signal contains three frequencies,
serve as a damage detection and classification tool with- which appear in the FFT and spectrogram. Moreover, it
out considering the standalone AE parameters and fea- can be observed in Fig. 1 (b) that the CWT spectrogram
ture extraction. The paper is outlined as follows. A brief of Morse wavelet provides a better resolution compared
background of CWT and 2D CNN is presented first, fol- with the spectrogram of Morlet wavelet, as shown in
lowed by the proposed method. A suite of numerical and Fig. 1 (c). Therefore, this study uses the Morse wavelet
Fig. 1 (a) Fourier spectrum of the mixed-signal and (b) and (c) its spectrogram obtained from the CWT using Morse and Morlet basis functions,
respectively
as the mother wavelet to extract the CWT spectrograms classification layers consisting of fully connected layers,
herein. softmax layers and classification output layers.
The convolution layer is the first layer of feature extrac-
x1 = sin 2π f1 t , x2 = sin 2π f2 t , x3 = sin 2π f3 t tion from an input image using the convolution operation
(4) between an image and a filter (or kernel). A 2D convo-
X = x1 + x2 + x3 (5) lution layer applies to slide convolution filters to the
input. The layer convolves the input by moving the filters
along the input vertically and horizontally and comput-
Convolutional neural network ing the dot product of the weights and the input, and
A Convolutional Neural Network (CNN), as depicted in then adding a bias term. The convolution operation is an
Fig. 2, is a Deep Learning algorithm that assigns learnable element-wise product of images and filters, followed by
weights and biases to various features present in 1D and the summation of these values. The output of the convo-
2D data in order to differentiate them from one another. lution operation represents a low-dimensional invariant
The architecture of CNN is similar to that of the con- feature space of high-level feature data. The batch nor-
nectivity pattern of neurons in the human brain, and it malization layer normalizes each input channel across
was inspired by the organization of the visual cortex. The a mini-batch. In order to speed up the training of CNN
three major parameters, including local receptive fields, and reduce the network initialization sensitivity, batch
weight sharing and sub-sampling in the spatial domain, normalization layers are used between convolution layers
make CNN highly suitable for feature extraction from 2D and nonlinearities such as Rectified Linear Unit (ReLU)
data such as images. A typical CNN architecture com- layers. The layer first normalizes the activations of each
prises feature extraction layers, including convolution channel by subtracting the mini-batch mean and divid-
layers, batch-normalization layers, activation layers, and ing by the standard deviation of the mini-batch. Then, the
layer shifts the input by a learnable offset ‘β’ and scales it sigmoid or hyperbolic tangent function; however, ReLUs
by a learnable scale factor ‘γ’. are often used to introduce nonlinearity. A ReLU layer
Activation layers are implemented to verify the activa- performs a threshold operation to each element of the
tion of various elements of the feature space in the pres- input, where any value less than zero in this layer is set to
ence of specific features at a given spatial location. This zero. Mathematically, it can be expressed as follows:
is accomplished by introducing nonlinearity to the layers
through the use of an activation function. Various acti- 0 for x < 0
f (x) =
x for x ≥ 0 (6)
vation functions have been used in literature, such as
The objective of a fully connected layer is to take the a large probability, but it will always remain between 0
results of the convolution process and use them to clas- and 1. A classification layer computes the cross-entropy
sify the images into labels. The output of a convolution loss for multiclass classification problems with mutu-
is flattened into a 1D feature vector of values, each rep- ally exclusive classes. This layer determines the number
resenting a probability of a certain feature belonging to of classes from the output size of the preceding layer.
a label and is fed into a fully connected layer such as a This layer takes input from the softmax function and
neural network. The fully connected layer multiplies the allocates each input to one of the mutually exclusive
input by a weight matrix and then adds a bias vector. In classes using the cross-entropy loss function.
this layer, softmax function is provided as an activation
function to determine the probability of feature clas-
sification for the data analyzed. The softmax function Proposed methodology
is a normalized exponential function that transforms The proposed methodology explores the capability of
a vector of K real values into a vector of K real values TF signal processing methods (e.g., EMD and CWT)
that sum to 1. If the input vector of K real numbers is to extract key AE components along with the feature-
applied to the softmax layer, it normalizes into a prob- free classification capability of a deep learning algo-
ability distribution comprising of K probabilities. The rithm in a unified manner. First, EMD is undertaken
input values can be positive, negative, zero, or greater to eliminate the presence of noise in the measured AE
than one, but the softmax function transforms them data and decompose it into a set of IMFs that repre-
into values between 0 and 1 so that they can be inter- sent the undamaged and damaged AE signals. The time
preted as probabilities. If one of the inputs is small or response of the AE signal is considered non-station-
negative, the softmax function turns it into a small ary, which can be decomposed using EMD due to its
probability, whereas if the input is large, it turns it into capability of analyzing nonlinear and non-stationary
Fig. 5 (a) CWT spectrogram of y(t), and (b) IMF-1, (c) IMF-2, and (d) IMF-3 of y(t) obtained from EMD
Fig. 6 Training stage: (a) performance and (b) loss evaluation of the proposed CNN architecture using CWT TF images
Fig. 7 Confusion matrices for (a) validation and (b) testing data of the sine signal
Fig. 8 (a) AE monitoring system and the experimental setup: (b) actual and (c) schematic
Fig. 9 Time-history of the measured AE data collected from sensors A1 and A2 of damage at D
Fig. 10 Spectrograms of IMFs using (a) undamaged, (b) damaged AE data obtained from A
1, and (c) undamaged, (d) damaged AE data from A2 for
damage at D
Fig. 11 Training stage: (a) performance and (b) loss of the proposed method using CWT images of undamaged and damaged cases
Fig. 12 Comparison of clusters for training and testing datasets for wooden beam
Fig. 13 Confusion matrices (a-b) for validation and testing using damaged and undamaged data from A
1 and (c-d) for validation and testing using
damaged and undamaged data from A2
The resulting CWT images of each IMF are then fed compared to the original network. Additionally, the num-
into 2D CNN to localize the damage. In this study, a ber of filters for each network block increases by a fac-
modified VGG-16 [30], as depicted in Fig. 3, is used to tor of 2, starting with 4 filters in the first network block
classify the CWT images obtained from AE data. The and ending with 32 filters in the final network block.
architecture is comprised of five network blocks that Zero padding is introduced in the convolutional layers
consist of a varying number of convolutional layers that to ensure that the input and output layer sizes remain
are finalized with a max-pooling layer. The first two net- constant regardless of the convolutional operation. Each
work blocks consist of two convolutional layers followed convolutional layer is followed by a Batch Normaliza-
by a max-pooling layer, while the three network blocks tion (BN) layer and ReLU to normalize and activate the
consist of three convolutional layers followed by a max- extracted features. The max-pooling layer has a kernel
pooling layer. The number of filters of each convolutional size of 2 × 2 with a stride value of 2 to reduce the inputted
layer from the traditional VGG-16 network is reduced size to half through the max-pooling operation. Moreo-
by a factor of 16 as the number of classifications and ver, the length of intermediary fully connected layers is
complexity of the features are dramatically reduced as reduced from 4096 to 512, with the fully connected layer
Fig. 15 Training stage: (a) performance and (b) loss of the proposed method using the experimental data
Fig. 16 Confusion matrices for (a) validation and (b) testing data of the wooden beam
Fig. 18 Time history of the measured AE data collected using sensors A1 and A2 of damage at D
Fig. 19 Spectrograms of IMFs using (a) undamaged, (b) damaged AE data obtained from sensor A
1, and (c) undamaged, and (d) damaged AE data
from sensor A2 for damage at D
be observed that due to the high performance of the able to achieve 100% classification accuracy for all fre-
network, the accuracy reaches 100% relatively quickly quency categories.
while minimizing the loss function. The trained net-
work is tested using 100 images of each frequency class. The selected AE data acquisition system
The confusion matrix is shown in Fig. 7 (a-b), repre- Figure 8(a) illustrates a typical setup of the proposed
senting the classification accuracy for the validation AE monitoring system used in the experimental study.
and testing datasets, respectively. The CNN model is The AE system is used to record AE signals from a
Fig. 20 Comparison of clusters for training and testing datasets of the wooden plate
Fig. 21 Training stage: (a) performance and (b) loss of the proposed method using CWT images of undamaged and damaged conditions of the
wooden plate
wooden beam and plate subjected to minor damage acquisition (DAQ) system to collect the AE data. It is
using AE sensors. Two AE sensors with a characteristic also attached with a direct current supply to power the
frequency band extending from 20–450 kHz are placed AE sensor. The DAQ is used to transfer the measured
on the specimen, as shown in Fig. 8(b). A pre-amplifi- AE signals to the computer. It has a sampling rate of
cation of the AE signals is added using preamplifiers 200 Msamples/s, which is capable of dealing with high-
with 34—40 dB gain and plug-in bandpass filters from frequency AE data collected by the sensors. In the pro-
2.5–2400 kHz to magnify the AE signal. A decoupling posed experimentation, the sampling frequency of the
box is utilized to connect the preamplifier with the data sensors is set to 20 kHz.
Fig. 22 Confusion matrices (a-b) for validation and testing using damaged and undamaged data from A
1 and (c-d) from A2
Damage detection
In order to validate the performance of the proposed
Damage identification in a one‑dimensional method as a damage detection tool, the proposed
structural member method is applied to the AE data of the undamaged and
In order to evaluate the performance of the proposed damaged system. Figure 9 shows the time-history of
method, a wooden beam is considered in the experi- AE data collected from wooden beam using A1 and A2.
mental study. The beam has a dimension of 62 cm It can be seen that the damage progression begins near
Fig. 23 Training stage: (a) performance and (b) loss of the proposed method using the experimental data
Fig. 24 Confusion matrices for (a) validation and (b) testing data of the wooden plate for damage at D
1
Fig. 25 (a) Experimental setup of the concrete beam and (b) AE monitoring system
model is able to achieve ~ 100% classification accuracy structural elements using a limited number of AE sen-
for damaged and undamaged categories. Therefore, the sors (e.g., two sensors). The damage location is identi-
proposed method can be considered a reliable tool for fied by using the term damage-close or far with respect
damage detection in structural elements. to the sensor location. In order to identify the potential
location of damage at D, spectrograms obtained from
Damage localization A1 are treated as damage-close, whereas spectrograms
Figure 14 shows the time-history of measured AE data from A2 are treated as damage-far.
of a typical segment for damage at D. It can be observed In this study, 473 randomly selected images of each
that the amplitude of undamaged and damaged signals sensor class are used in the training process. An addi-
significantly overlap. Subsequently, the raw amplitude tional 135 images and 67 images of each sensor class are
of the time-history of AE data will provide faulty infor- used in the validation and testing process. The training
mation for the damage location, which motivates the process is shown in Fig. 15. The confusion matrix shown
need for the proposed method to automate the process in Fig. 16 (a-b) shows the classification accuracy for the
of identifying the potential location of the damage. The validation and testing datasets. The accuracy, recall, pre-
spectrogram of IMFs of each AE segment is extracted cision and F1 scores of the validation dataset and test-
from CWT. These spectrograms are then used to feed ing dataset are summarized in Table 1. The performance
the CNN model to identify the location of damage in indicators calculated from the confusion matrices sug-
the structural element. The proposed method is applied gest an excellent generalization of the CWT images by
to identify the approximate location of damage in the proposed algorithm.
Fig. 26 Time history of the measured AE waveforms and first five IMFs extracted from sensors A1 and A2
Fig. 27 Spectrograms of IMFs using AE waveform obtained from sensor A1 and sensor A
2
Damage identification in a two‑dimensional The spectrograms are used as the training and testing
structural member data of the 2D CNN. Figure 19 shows a typical CWT
In this section, an experimental study using a 2D struc- spectrogram of IMFs using undamaged and damaged AE
tural element such as a wooden plate is undertaken to data collected from (a-b) A1 and (c-d) A2.
validate the performance of the proposed method. The In order to verify the capability of the 2D CNN model
dimensions of the plate are 1 m length, 1 m width, and for classifying the undamaged and damaged state of the
2 cm thickness, respectively, as shown in Fig. 17. Two wooden plate, 140 images of undamaged and damaged
sensors (A1 and A2) are used to measure the AE signal conditions collected using A1 are used in the training
while the plate is subjected to active damage. The plate process. An additional 40 images and 20 images of each
is subjected to damage at location D. Figure 17 shows the case are used in the validation and testing process. As
proposed location of sensors and damage on the plate. A per the process described in Sect. 5.1, the centroid of
drilling machine is used to simulate the damage by creat- each image was determined the clusters for the training
ing a hole, while the signal is measured using the selected and testing datasets were compared as shown in Fig. 20.
AE sensors. Similarly, though the centroids of both the training and
testing images across the entire dataset are similar, the
spread of the points around the centroid is relatively high,
Damage detection suggesting there is good robustness within the dataset.
In this study, the proposed method is applied to undam- Furthermore, though both the beam and plate are made
aged and damaged AE signals to classify the undamaged of similar material and are damaged in a similar manner,
and damaged cases of the wooden plate. Figure 18 rep- each damage scenario generates unique clusters, sug-
resents the time-history of AE data collected from the gesting geometric properties of the element and relative
wooden plate using A1 and A 2. It can be observed that damage location have significant influence with regards
the damage progression begins near t = 1 s and ends at to the AE signals generated.
t = 19 s. Therefore, the AE data collected between 0–1 s Figure 21 shows the performance of the proposed
is considered as undamaged and between 1–19 s is con- method for identifying the undamaged and damaged
sidered as damaged data. Then, the CWT is used to gen- states of the plate. The resulting confusion matrix is
erate the spectrogram of each IMF obtained from EMD. shown in Fig. 22 (a-b), displaying the classification
Fig. 28 Comparison of clusters for the training and testing datasets of the concrete beam
accuracy for the validation and testing datasets extracted excellent generalization of the CWT images by the pro-
from AE data using A1. The same process is executed to posed algorithm.
detect the damage using AE data collected from A2. Fig-
ure 22 (c-d) shows the confusion matrices that display Crack identification in a concrete beam
the classification accuracy for the validation and test- In this section, the performance of the proposed method
ing datasets obtained from AE data collected using A2. is validated experimentally using a concrete beam. The
Table 2 summarizes the accuracy, recall, precision and F1 beam size is 355 mm in length and 78 mm in width and
scores of the validation dataset and testing dataset of the thickness. Ordinary Portland cement, fine aggregate, and
undamaged and damaged condition of the plate. It can be coarse aggregate are used in the concrete mixture. MTS
observed that the CNN model is able to achieve ~ 100% testing machine is used to carry out a three-point flex-
classification accuracy for damaged and undamaged ural loading test. Two AE sensors (A1 and A 2) are used
cases. Therefore, the proposed method shows excellent to collect AE data from the beam. During the experi-
capabilities to perform damage detection in a structural ment, the crack opening is visually monitored, where
element such as a plate. the crack initiates at the center bottom of the beam and
then propagates to the top. Figure 25 (a) shows the loca-
Damage localization tion of sensors and crack on the concrete beam. AE sig-
In this section, the proposed method is extended to nal is collected by a Micro-SHM acquisition system that
localize the damage using limited AE sensors. In order has four input channels. The Micro-SHM acquisition
to identify the potential location of damage, the spec- system is used to transfer the measured AE waveforms
trograms of IMFs of AE signal obtained from A1 and A2 from sensors to the computer using A Ewin software, as
(defined as damage-close and damage-far, respectively) shown in Fig. 25 (b). The system has a sampling rate of
are used to feed into the 2D CNN. In this study, 140 10 Msamples/s, which can deal with high-frequency AE
randomly selected images of each sensor class are used signals collected by the sensors due to the micro-cracks
in the training process. An additional 40 images and in concrete material.
20 images of each sensor class are used in the valida-
tion and testing process. The training process is shown
Crack localization
in Fig. 23. The confusion matrix shown in Fig. 24(a-b)
In this study, the AE waveforms collected from the beam
displays the classification accuracy for the validation
using two AE sensors are firstly decomposed to n num-
and testing datasets. The accuracy, recall, precision and
ber mono-components signals (IMFs) using the EMD
F1 scores of the validation dataset and testing dataset
method. Figure 26 represents the time-history response
are summarized in Table 3. The performance indica-
of a typical AE waveform and its first five IMFs obtained
tors calculated from the confusion matrices suggest an
from EMD using sensors A 1 (first column) and A 2
Fig. 29 Training stage: (a) performance and (b) loss of the proposed method using the experimental data
Fig. 30 Confusion matrices for (a) validation and (b) testing data of the concrete beam under three-point flexural loading
Table 4 Performance indicators calculated from the (second column). It can be seen that the amplitude of the
classification of CWT images of close and far damage AE waveform obtained from A1 and A2 are the same.
Indicator Damage Localization Thus, the amplitude of the time-history of raw AE data
might provide inaccurate information for the crack loca-
Validation Testing
tion, which motivates to apply the proposed method to
Accuracy (%) 95.0 95.0 automate the process of identifying the potential loca-
Precision 0.95 0.97 tion of the crack in the concrete beam. In order to predict
Recall 0.95 0.94 the approximate location of the crack, the CWT spec-
F1 Score 0.95 0.95 trograms of IMFs extracted from A 1 and A2 (defined as
Conclusions
In this paper, a 2D CNN framework is proposed to auto-
mate the process of detecting and localizing the damage
References
using AE data collected from structures. EMD is used to 1. Aggelis DG, Shiotani T, Terazawa M (2010) Assessment of construction
suppress the presence of noise and extract the key AE com- joint effect in full-scale concrete beams by acoustic emission activity. J
Eng Mech 136(7):906–912
ponents, followed by CWT to generate the spectrograms
2. Anay R, Cortez TM, Jáuregui DV, El Batanouny MK, Ziehl P (2016) On-site
of the extracted IMFs. Then, the resulting noise-free spec- acoustic-emission monitoring for assessment of a Prestressed con-
trograms are utilized to feed the CNN model for improved crete double-tee-Beam bridge without plans. J Perform Constr Facil
30(4):04015062
classification accuracy. CNN model is employed to auto-
3. Abouhussien AA, Hassan AA (2016) Acoustic emission-based analysis of
mate the process of identifying the potential location of bond behavior of corroded reinforcement in existing concrete structures.
damage using the AE data. A set of numerical and experi- Struct Control Health Monit 24(3):e1893
4. Abdulazeez AM, Zeebaree DQ, Zebari DA, Zebari GM, Adeen IMN (2020)
mental studies are conducted to validate the performance
The applications of discrete wavelet transform in image processing: a
of the proposed approach as a damage detection tool using review. J Soft Comput Data Mining 1(2):31–43
a limited number of AE sensors. 5. Benavent-Climent A, Gallego A, Vico JM (2011) An acoustic emission
energy index for damage evaluation of reinforced concrete slabs under
The results show the capability of the proposed approach
seismic loads. Struct Health Monit 11(1):69–81
to identify the approximate location of the damage in 6. Bahar O, Ramezani S (2012) Enhanced Hilbert Huang transform and
various structural elements. For example, the extracted its applications to modal identification. Struct Des Tall Special Build
23(4):239–253
results obtained from the wooden beam showed the high
7. Barbosh M, Singh P, Sadhu A (2020) Empirical mode decomposition and
performance of the proposed approach in identifying the its variants: A review with applications in structural health monitoring.
potential location of damage with 93% accuracy. Also, the Smart Mater Struct 29(9):093001
8. Barbosh M, Sadhu A, Sankar G (2021) Time–frequency decomposition-
proposed technique can identify the approximate loca-
assisted improved localization of proximity of damage using acoustic
tion of damage in a 2D wooden plate with an accuracy of sensors. Smart Mater Struct 30(2):025021
88%. Moreover, the results obtained from the experimen- 9. Carpinteri A, Lacidogna G, Niccolini G (2010) Damage analysis of rein-
forced concrete buildings by the acoustic emission technique. Struct
tal study using concrete beam represented the capability
Control Health Monit 18(6):660–673
of this approach in identifying the crack location where 10. Calabrese L, Proverbio E (2020) A review on the applications of acoustic
the accuracy reached 95%. Future studies are reserved for emission technique in the study of stress corrosion cracking. Corrosion
Mater Degrad 2(1):1–33
validating the proposed method in a wide range of full-
11. Dunphy K, Sadhu A (2022) Autonomous crack detection approach for
scale structures and identifying the location of multiple masonry structures using artificial intelligence. Recent Developments
damages. in Structural Health Monitoring and Assessment–Opportunities and
Challenges: Bridges, Buildings and Other Infrastructures, World Scientific. 34. Sony S, Sadhu A (2020) Synchrosqueezing transform-based identification
pp 253–283 of time-varying structural systems using multi-sensor data. J Sound Vibrat
12. Ebrahimkhanlou A, Choi J, Hrynyk TD, Salamone S, Bayrak O (2020) 486:115576
Acoustic emission monitoring of containment structures during post- 35. Sony S, Dunphy K, Sadhu A, Capretz M (2021) A systematic review of
tensioning. Eng Struct 209:109930 convolutional neural network-based structural condition assessment
13. Gilles J (2013) Empirical Wavelet Transform. IEEE Trans Signal Process techniques. Engineering Structures, Elsevier 226:111347
61(16):3999–4010 36. Sun G, Gao Y, Lin K, Hu Y (2019) Fine-grained fault diagnosis method of
14. Hsueh Y-M, Ittangihal V, Wu W-B, Chang H-C, Kuo C-C (2019) Fault rolling bearing combining multisynchrosqueezing transform and sparse
Diagnosis System for Induction Motors by CNN Using Empirical Wavelet feature coding based on dictionary learning. Shock Vibrat 2019:1531079
Transform. Symmetry 11(10):1212 37. Tang Z, Chen Z, Bao Y, Li H (2018) Convolutional neural network-based
15. Huang NE, Shen Z, Long SR, Wu MC, Shih HH, Zheng Q, Yen NC, Tung data anomaly detection method using multiple information for structural
CC, Liu HH (1998) The empirical mode decomposition and the Hilbert health monitoring. Struct Control Health Monit 26(1)
spectrum for nonlinear and non-stationary time series analysis. Proc R 38. Verstraete D, Ferrada A, Droguett EL, Meruane V, Modarres M (2017) Deep
Soc Math Phys Eng Sci 454(1971):903–995 learning enabled fault diagnosis using time-frequency image analysis of
16. Huang NE, Shen Z, Long SR, Wu MC, Shih HH, Zheng Q, Liu HH (2002) The rolling element bearings. Shock Vib 2017:1–17
empirical mode decomposition and Hilbert spectrum for nonlinear and 39. Verstrynge E, Lacidogna G, Accornero F, Tomor A (2021) A review on
non-stationary time series analysis. Proc R Soc A 454:903–995 acoustic emission monitoring for damage detection in masonry struc-
17. Kumar A, Zhou Y, Gandhi CP, Kumar R, Xiang J (2020) Bearing defect size tures. Construct Build Mater 268:121089
assessment using wavelet transform based Deep Convolutional Neural 40. Wang J, Mo Z, Zhang H, Miao Q (2019) A Deep Learning Method for
Network (DCNN). Alex Eng J 59:999–1012 Bearing Fault Diagnosis Based on Time-Frequency Image. IEEE Access
18. Kralovec C, Schagerl M (2020) Review of structural health monitoring 7:42373–42383
methods regarding a multi-sensor approach for damage assessment of 41. Worley R, Dewoolkar MM, Xia T, Farrell R, Orfeo D, Burns D, Huston DR
metal and composite structures. Sensors 20(3):826 (2019) Acoustic emission sensing for crack monitoring in prefabri-
19. Li Z, Park HS, Adeli H (2016) New method for modal identification of cated and Prestressed reinforced concrete bridge girders. J Bridg Eng
super high-rise building structures using discretized synchrosqueezed 24(4):04019018
wavelet and Hilbert transforms. Struct Des Tall Spec Build 26(3):e1312 42. Wang Z, Ding K, Ren H, Ning J (2021). “Quantitative acoustic emission
20. Liu Q, Huang C (2019) A Fault Diagnosis Method Based on Transfer Con- investigation on the crack evolution in concrete prisms by frequency
volutional Neural Networks. IEEE Access 7:171423–171430 analysis based on wavelet packet transform.”, Structural Health Monitor-
21. Li D, Wang Y, Yan WJ, Ren WX (2020) Acoustic emission wave classification ing, 147592172110188.
for rail crack monitoring based on synchrosqueezed wavelet transform 43. Yuan M, Sadhu A, Liu K (2017) Condition assessment of structure with
and multi-branch convolutional neural network. Struct Health Monit tuned mass damper using empirical wavelet transform. J Vib Control
20(4):1563–1582 24(20):4850–4867
22. Manthei G, Plenkers K (2018) Review on in situ acoustic emission moni- 44. Zhang Y, Xing K, Bai R, Sun D, Meng Z (2020) An enhanced convolutional
toring in the context of structural health monitoring in mines. Appl Sci neural network for bearing fault diagnosis based on time-frequency
8(9):1595 image. Measurement 157:107667
23. Ma G, Du Q (2020) Structural health evaluation of the prestressed con-
crete using advanced acoustic emission (AE) parameters. Construction
and Building Materials 250:118860 Publisher’s Note
24. Perez-Ramirez CA, Amezquita-Sanchez JP, Adeli H, Valtierra-Rodriguez M, Springer Nature remains neutral with regard to jurisdictional claims in pub-
Camarena-Martinez D, Romero-Troncoso RJ (2016) New methodology for lished maps and institutional affiliations.
modal parameters identification of smart civil structures using ambient
vibrations and synchrosqueezed wavelet transform. Eng Appl Artif Intell
48:1–12
25. Pandhare V, Singh J, Lee J (2019) “Convolutional Neural Network Based
Rolling-Element Bearing Fault Diagnosis for Naturally Occurring and
Progressing Defects Using Time-Frequency Domain Features,” Prognostics
and System Health Management Conference (PHM-Paris). France, Paris, pp
320–326
26. Quy TB, Kim J (2021) Crack detection and localization in a fluid pipeline
based on acoustic emission signals. Mechanical Systems and Signal
Processing 150:107254
27. Sarfarazi MP (1992) Acoustic emissions and damage constitutive charac-
teristics of paper. Institute of paper science and technology
28. Sadhu, A. (2013), “Decentralized ambient modal identification of struc-
tures.”, PhD Thesis, Department of Civil and Environmental Engineering,
University of Waterloo.
29. Sadhu A, Sony S, Friesen P (2019) Evaluation of progressive damage in
structures using tensor decomposition-based wavelet analysis. J Vib
Control 25(19–20):2595–2610
30. Simonyan K, Zisserman A (2014) Very deep convolutional networks for
large-scale image recognition. ICLR Conference 1409:1556
31. Singh P, Keyvanlou M, Sadhu A (2021) An improved time-varying empiri-
cal mode decomposition for structural condition assessment using
limited sensors. Eng Struct 232:111882
32. Saeedifar M, Zarouchas D (2020) Damage characterization of lami-
nated composites using acoustic emission: A review. Composit B Eng
195:108039
33. Shao S, Yan R, Lu Y, Wang P, Gao RX (2020) DCNN-based multi-signal
induction motor fault diagnosis. IEEE Trans Instrum Meas 69(6):2658–2669
1. use such content for the purpose of providing other users with access on a regular or large scale basis or as a means to circumvent access
control;
2. use such content where to do so would be considered a criminal or statutory offence in any jurisdiction, or gives rise to civil liability, or is
otherwise unlawful;
3. falsely or misleadingly imply or suggest endorsement, approval , sponsorship, or association unless explicitly agreed to by Springer Nature in
writing;
4. use bots or other automated methods to access the content or redirect messages
5. override any security feature or exclusionary protocol; or
6. share the content in order to create substitute for Springer Nature products or services or a systematic database of Springer Nature journal
content.
In line with the restriction against commercial use, Springer Nature does not permit the creation of a product or service that creates revenue,
royalties, rent or income from our content or its inclusion as part of a paid for service or for other commercial gain. Springer Nature journal
content cannot be used for inter-library loans and librarians may not upload Springer Nature journal content on a large scale into their, or any
other, institutional repository.
These terms of use are reviewed regularly and may be amended at any time. Springer Nature is not obligated to publish any information or
content on this website and may remove it or features or functionality at our sole discretion, at any time with or without notice. Springer Nature
may revoke this licence to you at any time and remove access to any copies of the Springer Nature journal content which have been saved.
To the fullest extent permitted by law, Springer Nature makes no warranties, representations or guarantees to Users, either express or implied
with respect to the Springer nature journal content and all parties disclaim and waive any implied warranties or warranties imposed by law,
including merchantability or fitness for any particular purpose.
Please note that these rights do not automatically extend to content, data or other material published by Springer Nature that may be licensed
from third parties.
If you would like to use or distribute our Springer Nature journal content to a wider audience or on a regular basis or in any other manner not
expressly permitted by these Terms, please contact Springer Nature at