A_Three-Stage_Low-Complexity_Human_Fall_Detection_Method_Using_IR-UWB_Radar
A_Three-Stage_Low-Complexity_Human_Fall_Detection_Method_Using_IR-UWB_Radar
I. I NTRODUCTION for nursing staff to always pay attention to whether the elderly
fall or not. Therefore, intelligent fall detection has become an
A CCORDING to recent demographic statistics, in 2018,
the global population over the age of 64 surpassed the
number of children under the age of 5 for the first time [1].
active area of both the research and industry. The intelligent
fall detection system can be used to: (1) monitor the elderly
As the global population over the age of 64 will continue to living alone and inform their families or relevant personnel
grow, it is clear that we are moving towards an aging world. at the first time after the elderly falling down; (2) reduce the
In daily life, falls are the main cause of injury to the elderly. work intensity of nurses and further ensure the safety of the
If help and treatment are not provided in time after a fall, elderly; and (3) avoid serious consequences after accidental
it may cause various other diseases and even indirectly lead falls, especially in the bathroom.
to the death of the elderly [2], [3]. At present, a large number Nowadays, fall detection technologies are developing
of the elderly live alone. Even in nursing homes, it is difficult rapidly, and a variety of fall detection devices have appeared
on the market. These devices can be divided into two cat-
egories: wearable and non-wearable. Wearable sensors are
Manuscript received 3 May 2022; accepted 7 June 2022. Date of
publication 29 June 2022; date of current version 1 August 2022. mainly micro electro mechanical systems (MEMS), includ-
This work was supported in part by the Guangdong Basic and ing accelerometer, gyroscope, magnetometer and barome-
Applied Basic Research Foundation under Grant 2019A1515011517, ter [4]. Researchers exploit one or multiple MEMS sensors
in part by the Science and Technology Project of Shenzhen under
Grant JCYJ20190808142803565, and in part by the National Nat- in devices, such as belt, watch, wristband, and smartphone,
ural Science Foundation of China under Grant 61771317 and Grant etc., to obtain the posture angle and motion information for
62101207. The associate editor coordinating the review of this article and the fall event [4]–[9]. Lee et al. [9] embedded accelerometers
approving it for publication was Dr. Ying Zhang. (Corresponding author:
Zhaocheng Yang.) into a smartphone, and effectively distinguished falls in four
The authors are with the Guangdong Key Laboratory of Intelli- directions from 11 types of daily activities by analyzing the
gent Information Processing, College of Electronics and Information triaxial acceleration characteristics and using three thresh-
Engineering, Shenzhen University, Shenzhen 518060, China (e-mail:
[email protected]; [email protected]). olds. Norudin et al. [7] embedded a heart rate sensor and
Digital Object Identifier 10.1109/JSEN.2022.3184513 an acceleration sensor into a smartwatch, and proposed a
1558-1748 © 2022 IEEE. Personal use is permitted, but republication/redistribution requires IEEE permission.
See https://www.ieee.org/publications/rights/index.html for more information.
Authorized licensed use limited to: Karunya Institute of Technology and Sciences. Downloaded on October 15,2024 at 16:07:32 UTC from IEEE Xplore. Restrictions apply.
CHEN et al.: THREE-STAGE LOW-COMPLEXITY HUMAN FALL DETECTION METHOD USING IR-UWB RADAR 15155
Authorized licensed use limited to: Karunya Institute of Technology and Sciences. Downloaded on October 15,2024 at 16:07:32 UTC from IEEE Xplore. Restrictions apply.
15156 IEEE SENSORS JOURNAL, VOL. 22, NO. 15, 1 AUGUST 2022
Fig. 1. The received signal and the clutter removed signal of one frame.
defined by
t2
s(t) = VT X exp(− ) cos(2π f c t), (1)
2τ 2
where VT X denotes the pulse amplitude, t means the fast-time,
f c denotes the carrier frequency, and τ is described by
τ = 2π f B lg(e). (2)
Here, f B is bandwidth, and e is Euler’s number.
After sampling in X4M03, the received signal can be
defined by r (m, n), where m denotes the frame index and Fig. 2. The workflow of the proposed three-stage human fall detection
n denotes the range bin. The r (m, n) contains a variety method.
of background cultters. In order to remove the background
clutters, the running average method [37] is applied because
instantaneous high Doppler frequency spectrum components.
of the low computational complexity. It is described as
Generally, the fall detection isn’t an easy task and requires a
x(m, n) = r (m, n) − c(m, n), (3) large computational resource. Besides, fall is a sparse event in
c(m + 1, n) = αc(m, n) + (1 − α)r (m, n), (4) daily life. Herein, we do not need to compute the classification
procedure all the time, but only need to conduct that when a
where c(m, n) is the background clutter signal, x(m, n) large-motion happened. Specifically, a high Doppler frequency
denotes the signal after subtracting clutter and α is an update energy feature based method can be used to achieve this aim.
coefficient. We set α as 0.983, meaning that micro-Doppler Firstly, the distance units of z(m, n) are united because we
features arise rapidly while the clutter remains longer. only consider whether a large-motion happened, not where it
Fig. 1 shows the received signal and the clutter removed happened. Secondly, for real-time detection, a sliding window
signal of one frame. It can be seen that after clutter suppres- of 5/6 second overlap is applied to calculate fast Fourier
sion, the scattering amplitude of static target is greatly reduced, transform with fixed length of window (1 second). For the
but the human target signal still keeps a strong scattering kth sliding window, we compute the kth spectrum vector
amplitude. described by
After clutter suppression, in order to facilitate the extraction
+∞
R
of target Doppler information, digital frequency mixing and − j 2π
fd
m
low-pass filtering are performed to the signal x(m, n) to X (k, f d ) = z k (m, n)e fr , (5)
m=−∞ n=1
remove the carrier signal and obtain the baseband signal
z(m, n). where z k (m, n) is the baseband signal z(m, n) at the kth
sliding window, and f d denotes the Doppler frequency. Finally,
III. P ROPOSED T HREE -S TAGE H UMAN we extract a high Doppler frequency energy feature E high from
FALL D ETECTION M ETHOD the spectrum vector and set a threshold γ1 to decide whether
This section will detail the proposed method by three a large-motion occurs, namely
stages: human large-motion detection, rough fall detection and H1
enhanced fall detection, as shown in Fig. 2. E high (k) >
γ1 , (6)
<
H0
A. Stage 1: Human Large-Motion Detection where H1 means that a large-motion occurs and H0 means
Here, we mainly consider 9 types of large-motions, includ- oppositely, and
ing fall, waving, squatting down, stretching exercises, picking
up things, sitting down, sitting up, drinking and walking. E high (k) = |X (k, f d )|2 , = { f 1 < | fd | < f 2 } . (7)
From the view of radar, these events will produce large f =
Authorized licensed use limited to: Karunya Institute of Technology and Sciences. Downloaded on October 15,2024 at 16:07:32 UTC from IEEE Xplore. Restrictions apply.
CHEN et al.: THREE-STAGE LOW-COMPLEXITY HUMAN FALL DETECTION METHOD USING IR-UWB RADAR 15157
Authorized licensed use limited to: Karunya Institute of Technology and Sciences. Downloaded on October 15,2024 at 16:07:32 UTC from IEEE Xplore. Restrictions apply.
15158 IEEE SENSORS JOURNAL, VOL. 22, NO. 15, 1 AUGUST 2022
Fig. 4. The time-frequency spectrums obtained by a person standing at a position and falling towards different directions (0◦ , 30◦ , 60◦ and 90◦ )
when the radar is placed on the side and top respectively.
Authorized licensed use limited to: Karunya Institute of Technology and Sciences. Downloaded on October 15,2024 at 16:07:32 UTC from IEEE Xplore. Restrictions apply.
CHEN et al.: THREE-STAGE LOW-COMPLEXITY HUMAN FALL DETECTION METHOD USING IR-UWB RADAR 15159
Fig. 5. The time-frequency spectrums and trajectories of a person at a position with different large-motions.
Authorized licensed use limited to: Karunya Institute of Technology and Sciences. Downloaded on October 15,2024 at 16:07:32 UTC from IEEE Xplore. Restrictions apply.
15160 IEEE SENSORS JOURNAL, VOL. 22, NO. 15, 1 AUGUST 2022
Fig. 6. The time-frequency spectrums and trajectories obtained by a person standing at a horizontal distance of 1.2m from the radar and falling
towards different directions (0 ◦ , 30 ◦ , 60 ◦ and 90 ◦ ).
Fig. 7. The time-frequency spectrums and trajectories of two people at different positions (0m, 0.6m, 1.2m) from the radar and falling in a direction.
Because the displacement relative to the radar caused by the The seventh feature F7 is the displacement relative to the
fall is greater than that of other motions and the target usually radar caused by motions, given by
stays on the ground after a fall, we extract the following two
features from trajectories. F7 = d1 − d0 , (19)
Authorized licensed use limited to: Karunya Institute of Technology and Sciences. Downloaded on October 15,2024 at 16:07:32 UTC from IEEE Xplore. Restrictions apply.
CHEN et al.: THREE-STAGE LOW-COMPLEXITY HUMAN FALL DETECTION METHOD USING IR-UWB RADAR 15161
Authorized licensed use limited to: Karunya Institute of Technology and Sciences. Downloaded on October 15,2024 at 16:07:32 UTC from IEEE Xplore. Restrictions apply.
15162 IEEE SENSORS JOURNAL, VOL. 22, NO. 15, 1 AUGUST 2022
q q q
and variance σ q = [σ F7 , σ F8 , σ F9 ]. Here, the superscript q
denotes the class of events, i.e., q ∈{fall, others}. After we
obtain
y from the real-time data, the fall detection can be
conducted by
H4 Fig. 11. Real-time fall monitoring interface.
> f all
Dyot hers < Dy , (26)
H5
where, H4 means that a fall occurs and H5 means oppositely,
q
Dy = yT − μq )T ( q )−1 (
( y − σ q ), (27)
Authorized licensed use limited to: Karunya Institute of Technology and Sciences. Downloaded on October 15,2024 at 16:07:32 UTC from IEEE Xplore. Restrictions apply.
CHEN et al.: THREE-STAGE LOW-COMPLEXITY HUMAN FALL DETECTION METHOD USING IR-UWB RADAR 15163
TABLE II
T HE P HYSICAL I NFORMATION OF PARTICIPANTS
acquisition was completed in more than five months. In the Fig. 15. TPR and FPR curves of human fall detection obtained by
different values of r of the SVDD model.
experiments, the perticipants perform 9 types of large-motions.
Each motion lasts 10 seconds, corresponding to the time of the
data acquisition for each sample. Participants simulate a fall Secondly, we analyze the influence of the radius parame-
toward 0◦ , 30◦ , 60◦ , 90◦, 120◦ ,150◦ or 180◦. Thus, there are ter (r ) of the SVDD model on the detection performance of
a total of seven types of fall. Each type of falls is repeated the proposed method. Fig. 15 shows the TPR and FPR curves
2 or 3 times at three positions, including 0m, 0.6m, and 1.2m. of human fall detection obtained by different values of r of the
For sittng down and sitting up, there are five chairs around the SVDD model. From the figure, we can observe that: (1) when
office, and each participant performs sitting down and sitting r is set as 0.8726, FPR is only 0.79%, and TPR is up to
up 9 or 10 times on each chair, respectively. For the other 99.09%; (2) when r is less than 0.8726, FPR decreases slowly
large-motions, each type of them is repeated 15 or 20 times with the decrease of r , while TPR decreases very quickly; and
at three positions, including 0m, 0.6m, and 1.2m. In this (3) when r is greater than 0.8726, TPR increases slowly with
experiment, the number of experimental samples obtained by the increase of r , while FPR increases very fast. Therefore,
each participant is different because some participants don’t 0.8726 is a good choice for the parameter r .
have much free time. In total, we collect 464 fall samples and Here, we use the five-fold cross-validation strategy to verify
4432 other large-motion samples, as shown in Table III. This the accuracy of the proposed method using the offline dataset.
paper addresses a binary classification problem, where the fall The offline dataset is randomly divided into five parts, four of
represents the positive class and other motions represent the which are used for training and the fifth is used for testing.
negative class. Three metrics, including the global accuracy, Additionally, in order to verify the superiority of SVDD in
false positive rate (FPR) and true positive rate (TPR), are used dealing with the binary classification problem with imbalanced
to evaluate the performance of the proposed method. data, we use the k-Nearest Neighbor (KNN) or SVM detector
for rough fall detection, and a Mahalanobis distance classifier
A. Results of Offline Dataset for enhanced fall detection. As shown in Table IV, we can
In this example, we first evaluate the inputs of the time observe that: (1) the average global accuracy of the proposed
duration of spectrums on the detection performance of the method is up to 99.4%, the true positive rate is up to 97.6% and
proposed method, as shown in Fig. 14. From the figure, we can false positive rate is only 0.4%; (2) compared with other TML
see that a short time duration may causes poor performance methods, the superiority of SVDD in dealing with the binary
and a long time duration leads to a larger time delay and a classification problem with imbalanced data is illustrated; and
higher computational complexity. With the increasing of time (3) if we only use one classifier with the same inputs (the nine
duration, some information such as noise and other motions features mentioned) to distinguish falls from other motions, the
may reduce the performance of fall detection. Thus, the time performance of fall detection degrades. The true positive rate
duration of 4 seconds is a good choice. of using only one SVDD detector or one Mahalanobis distance
Authorized licensed use limited to: Karunya Institute of Technology and Sciences. Downloaded on October 15,2024 at 16:07:32 UTC from IEEE Xplore. Restrictions apply.
15164 IEEE SENSORS JOURNAL, VOL. 22, NO. 15, 1 AUGUST 2022
TABLE III
T HE N UMBER OF S AMPLES OF E ACH M OTION T YPE
Authorized licensed use limited to: Karunya Institute of Technology and Sciences. Downloaded on October 15,2024 at 16:07:32 UTC from IEEE Xplore. Restrictions apply.
CHEN et al.: THREE-STAGE LOW-COMPLEXITY HUMAN FALL DETECTION METHOD USING IR-UWB RADAR 15165
TABLE V
E XPERIMENTAL R ESULTS OF THE P ROPOSED M ETHOD U SING LOSO S TRATEGY
TABLE VI
E XPERIMENTAL R ESULTS OF E DGE R EAL -T IME
S YSTEM IN T HREE S CENES
TABLE VII
E XPERIMENTAL R ESULTS OF E DGE R EAL -T IME S YSTEM AT
D IFFERENT R ADAR I NSTALLATION H EIGHTS
At each height, 80 falls and more than 800 other motions were
captured in two weeks. The results are shown in Table VII.
From the results, we can observe that: (1) when the radar is
installed at a height of 3m, the global accuracy rate and the true
positive rate of fall detection are the highest; (2) when the radar
is installed in the height range of 2.7m to 3.2m, the global Fig. 16. The time-frequency spectrums and trajectories obtained by one
accuracy of the proposed method is higher than 98.6% and the people at a position and falling in a direction when the radar is installed
at different heights (3.2m, 3m, 2.9m, 2.7m, 2.6m and 2.5m).
true positive rate of the proposed method is higher than 91.3%;
and (3) if the radar is installed at a height below 2.7m, it will
greatly affect the true positive rate of the proposed method.
relative distance between the human body and the radar
The true positive rates of the proposed method are only 78.8%
remains unchanged (for example, when we place the radar
and 58.8% when the radar is installed at a height of 2.6m
at 2.7m, the radar detection range can be set as 0.7-5.7m).
and 2.5m, respectively. This shows that for a certain range
(2) Fig. 16(b) shows the time-frequency spectrums obtained
of installation height, the proposed method exhibits relative
by one people at a position and falling in a direction when the
robustness. The reason for the above phenomenon is that when
radar is installed at different heights, and we can see that the
we change the installation height of the radar with a certain
change of time-frequency characteristics observed by the radar
range, the difference between the characteristics observed by
is small. However, different radar installation heights will lead
the radar and the characteristics of the training samples is still
to changes in the signal-to-noise ratio, which will affect the
relatively small. For better understanding, two points of view
time-frequency features. It can be seen from Table VII that
are provided.
when the installation height of radar is lower than 2.6m, the
(1) Fig. 16(a) shows the trajectories obtained by one people
difference between the test sample and the training sample
at a position and falling in a direction when the radar is
reaches a certain extent, and the accuracy of human fall
installed at different heights. It is obvious that the posi-
detection significantly degrades.
tion features (F7 and F8 ) observed by the radar are basi-
cally unchanged, because in the radar parameter configuration
(Table I), the detection range of the radar is set as 1-6m (the C. Comparison With Other State-of-the-Art Methods
radar is placed at the height of 3m). When we change the Here, we compare the performance of our work with other
installation height of the radar, we can adjust the detection state-of-the-art methods in Table VIII. It can be seen that
range of the radar accordingly, which can ensure that the although we only use one UWB radar, the accuracy rates
Authorized licensed use limited to: Karunya Institute of Technology and Sciences. Downloaded on October 15,2024 at 16:07:32 UTC from IEEE Xplore. Restrictions apply.
15166 IEEE SENSORS JOURNAL, VOL. 22, NO. 15, 1 AUGUST 2022
TABLE VIII
T HE P HYSICAL I NFORMATION OF S UBJECTS
Authorized licensed use limited to: Karunya Institute of Technology and Sciences. Downloaded on October 15,2024 at 16:07:32 UTC from IEEE Xplore. Restrictions apply.
CHEN et al.: THREE-STAGE LOW-COMPLEXITY HUMAN FALL DETECTION METHOD USING IR-UWB RADAR 15167
Authorized licensed use limited to: Karunya Institute of Technology and Sciences. Downloaded on October 15,2024 at 16:07:32 UTC from IEEE Xplore. Restrictions apply.
15168 IEEE SENSORS JOURNAL, VOL. 22, NO. 15, 1 AUGUST 2022
Zhaocheng Yang (Member, IEEE) received the Ping Chu received the B.E. and Ph.D. degrees
B.E. degree in information engineering from the in information and communication engineer-
Beijing Institute of Technology, Beijing, China, ing from Harbin Engineering University, Harbin,
in 2007, and the Ph.D. degree in information and China, in 2007 and 2011, respectively. Since
communication engineering from the National 2011, she has been with the College of Elec-
University of Defense Technology, Changsha, tronics and Information Engineering, Shenzhen
China, in 2013. University, where she is currently a Lecturer.
From November 2010 to November 2011, Her research interests include the area of signal
he was a Visiting Scholar with the University of processing, including array signal processing,
York, York, U.K. From June 2013 to August 2015, and its applications to radar systems.
he was a Lecturer with the School of Electronics
Science and Engineering, National University of Defense Technology.
He is currently an Associate Professor with the College of Electronics and
Information Engineering, Shenzhen University, Shenzhen, China. His
research interests include the area of signal processing, including array
signal processing, adaptive signal processing, compressive sensing,
machine learning, and its applications to radar systems.
Jialei Lai received the B.E. degree from Jinghong Lin is currently pursuing the B.E.
the School of Electronic Information Engineer- degree from the School of Electronics and Infor-
ing, Shenzhen University, Shenzhen, China, mation Engineering, Shenzhen University. His
in June 2019, where he is currently pursuing research focuses are radar signal processing and
the M.E. degree. His research focuses are radar especially the fall detection based on radar.
signal processing and pattern recognition, espe-
cially about the radar-based human target detec-
tion, and motion recognition.
Authorized licensed use limited to: Karunya Institute of Technology and Sciences. Downloaded on October 15,2024 at 16:07:32 UTC from IEEE Xplore. Restrictions apply.