Face_Verification_Using_mmWave_Radar_Sensor
Face_Verification_Using_mmWave_Radar_Sensor
Abstract—A mmWave radar sensor with massive-antenna ele- of the major benefit of our scheme is that it support privacy.
ments is tested for the task of verification of an identity based on Additional important advantage of operating a mmwave device
the human face radar signature. The sensor used in our study is is that it indifferent to beards since mmWave penetrates beards,
a 802.11ad/y CMOS mass-product networking chipset-hardware.
A dataset with faces of 200 different persons was collected for the paper masks, hair, etc ([8]).
testing. Then, a neural network based autoencoder is employed, Radar systems transmit and receive electromagnetic signals.
with either a single or double hidden layers to encode each face. By processing the received signals, radar systems can detect
Our preliminary study shows promising results. the presence and parameters of the object target reflecting the
Index Terms—Face recognition, mmwave. electromagnetic waves. This basic principle is well-studied and
dates back to the 1940s. mmWave radar systems transmit and
I. INTRODUCTION receive electromagnetic signals in the frequency band of 30-
Automatic biometric authentication is becoming increas- 300 GHz (corresponding to a wavelength of 1-10 mm). Two
ingly popular as mean of identification in front of ma- key advantages of mmWave systems are its compact size of
chines [1]. The main advantage of such authentication is, system components (e.g. amplifiers and antennas) and high
of course, removing the need for remembering passwords or level of accuracy and sensitivity (as a result of the short
pass phrases. This allows a non-expert and occasional user wavelengths). Over the past two decades, mmWave radars have
to securely operate machines with full authentication. Face been used in many civil applications, mainly in the automotive
verification (see [2],[3] and also [4]) is a recent important industry. Recent interests in mmWave radars is found in
addition to the biometric arsenal techniques. It is non-intrusive, gesture recognition and related applications, see e.g. [9], [10],
hands-free, and is acceptable by most users. Verification is [11], [12] and references therein. Scanners for security appli-
the only biometric authentication we are testing in this paper. cations based on mmWave technology are adopted in airports
However, it is noted that additional usages for biometric worldwide and ongoing research effort focus on advanced
authentications may be provided by the hardware setting algorithmic technique for analyzing mmWave signals, see, e.g.,
studied in this work and are the possible focus of future [13], [14], [15], [16], [17], [18], [19], [20], [21].
research (in particular, classification where the machine needs The IEEE 802.11ad is a Wi-Fi protocol enabling advanced
to decide who is the person and duplicate detect where the wireless communication networks operating in the unlicensed
system recognizes that the person was not registered before, 60 GHz band. The protocol provides a substantial improve-
are two promising applications of the chipset hardware studied ment for Wi-Fi communications in terms of both data rates and
in this work). latencies comparing to Wi-Fi operating in the 2.4 and 5 GHz
Different sensors are used for face recognition. RGB cam- bands. The globally available, wide and license-free bandwidth
era, is one of the well known sensors. The main drawback in the 60 GHz band in addition to mature radio-frequency
of the RGB camera is that it suffers from variable lighting integrated circuits technology are the two key reasons for ded-
condition. It addition, RGB camera suffers from poor-detection icated efforts and interest in both standardization and industry
performance of a mask or photograph (see [1]). In order focusing in providing state-of-the-art highly integrated systems
to overcome these, RGB-D (D for depth) sensors are used operating in 60 GHz band [22], [23].
for facial verification. These sensors include structured light A 802.11ad/y packet starts with a short training field,
sensors and time-of-flight sensors (see, e.g., [5],[6],[7]). followed by a channel estimation field (CEF), packet header,
In this work, we study the potential of face verifica- physical layer (PHY) payload and optional fields for gain
tion based only on the radar signature as captured by the control and additional training. A CEF is composed of Golay
Millimeter-wave (mmWave) networking schipset system that complementary sequences (128 symbols long) used in estimat-
can be operated in a radar fashion. This is, the chipset support ing the channel response characteristics. Complementary Go-
the option of simultaneous operation both a transmission lay sequences are well-studied signals in the radar community
module and a reception module. By using a chipset that is (see, e.g., [24], [25], [26]). Emerging 802.11ad technology and
already providing the task of networking, our scheme supports its PHY suitability for radar applications motivated the study
various benefits in terms of cost and power. However, one in providing opportunistic radar devices based on 802.11ad
978-1-7281-4985-1/20/$31.00
Authorized licensed use limited©2020 IEEE
to: Uppsala 320
Universitetsbibliotek. Downloaded on September 10,2024 at 17:03:00 UTC from IEEE Xplore. RestrictionsICAIIC
apply. 2020
Fig. 1. A Radar system with a target and the corresponding received signal.
321
Authorized licensed use limited to: Uppsala Universitetsbibliotek. Downloaded on September 10,2024 at 17:03:00 UTC from IEEE Xplore. Restrictions apply.
Fig. 4. A two stage biometric verification process
322
Authorized licensed use limited to: Uppsala Universitetsbibliotek. Downloaded on September 10,2024 at 17:03:00 UTC from IEEE Xplore. Restrictions apply.
Fig. 6. MSE results for an autoencoder trained on a specific person, as the
ordinate. The abscissa stands for the captured frame index.
323
Authorized licensed use limited to: Uppsala Universitetsbibliotek. Downloaded on September 10,2024 at 17:03:00 UTC from IEEE Xplore. Restrictions apply.
commercially available communication chipset, the solution [20] R. Feger, A. Fischer, and A. Stelzer, “Low-cost implementation of a
can be low cost as well. millimeter wave imaging system operating in w-band,” in Microwave
Symposium Digest (IMS), 2013 IEEE MTT-S International, pp. 1–4,
IEEE, 2013.
R EFERENCES [21] D. Oppelt, J. Adametz, J. Groh, O. Goertz, and M. Vossiek, “MIMO-
[1] J. Wayman, A. Jain, D. Maltoni, and D. Maio, “An introduction to SAR based millimeter-wave imaging for contactless assessment of
biometric authentication systems,” in Biometric Systems, pp. 1–20, burned skin,” in Microwave Symposium (IMS), 2017 IEEE MTT-S
Springer, 2005. International, pp. 1383–1386, IEEE, 2017.
[2] P. J. Phillips, P. J. Flynn, T. Scruggs, K. W. Bowyer, J. Chang, [22] ABI Research, “802.11ad will vastly enhance Wi-Fi the importance of
K. Hoffman, J. Marques, J. Min, and W. Worek, “Overview of the the 60 GHz band to Wi-Fi’s continued evolution,” tech. rep., April 2016.
face recognition grand challenge,” in 2005 IEEE Computer Society [23] P. Smulders, “Exploiting the 60 GHz band for local wireless multimedia
Conference on Computer Vision and Pattern Recognition (CVPR’05), access: prospects and future directions,” IEEE communications maga-
vol. 1, pp. 947–954 vol. 1, June 2005. zine, vol. 40, no. 1, pp. 140–147, 2002.
[3] A. F. Abate, M. Nappi, D. Riccio, and G. Sabatino, “2D and 3D face [24] H. Haderer, R. Feger, and A. Stelzer, “A comparison of phase-coded CW
recognition: A survey,” Pattern recognition letters, vol. 28, no. 14, radar modulation schemes for integrated radar sensors,” in Microwave
pp. 1885–1906, 2007. Conference (EuMC), 2014 44th European, pp. 1896–1899, IEEE, 2014.
[4] A. T. Tran, T. Hassner, I. Masi, and G. Medioni, “Regressing robust [25] N. Levanon, I. Cohen, and P. Itkin, “Complementary pair radar
and discriminative 3D morphable models with a very deep neural waveforms–evaluating and mitigating some drawbacks,” IEEE
network,” in Computer Vision and Pattern Recognition (CVPR), 2017 Aerospace and Electronic Systems Magazine, vol. 32, no. 3, pp. 40–50,
IEEE Conference on, pp. 1493–1502, IEEE, 2017. 2017.
[5] J. Kittler, A. Hilton, M. Hamouz, and J. Illingworth, “3d assisted [26] A. Pezeshki, A. R. Calderbank, W. Moran, and S. D. Howard, “Doppler
face recognition: A survey of 3d imaging, modelling and recognition resilient Golay complementary waveforms,” IEEE Transactions on In-
approachest,” in 2005 IEEE Computer Society Conference on Com- formation Theory, vol. 54, no. 9, pp. 4254–4266, 2008.
puter Vision and Pattern Recognition (CVPR’05) - Workshops(CVPRW), [27] P. Kumari, N. Gonzalez-Prelcic, and R. W. Heath, “Investigating the ieee
vol. 00, p. 114, 06 2005. 802.11 ad standard for millimeter wave automotive radar,” in Vehicular
[6] T. Bakirman, M. U. Gumusay, H. C. Reis, M. O. Selbesoglu, S. Yos- Technology Conference (VTC Fall), 2015 IEEE 82nd, pp. 1–5, IEEE,
maoglu, M. C. Yaras, D. Z. Seker, and B. Bayram, “Comparison of low 2015.
cost 3d structured light scanners for face modeling,” Appl. Opt., vol. 56, [28] P. Kumari, J. Choi, N. G. Prelcic, and R. W. Heath, “Ieee 802.11
pp. 985–992, Feb 2017. ad-based radar: An approach to joint vehicular communication-radar
[7] C. A. Luna, C. Losada-Gutierrez, D. Fuentes-Jimenez, A. Fernandez- system,” IEEE Transactions on Vehicular Technology, 2017.
Rincon, M. Mazo, and J. Macias-Guarasa, “Robust people detection [29] E. Grossi, M. Lops, L. Venturino, and A. Zappone, “Opportunistic radar
using depth information from an overhead time-of-flight camera,” Expert in ieee 802.11 ad networks,” IEEE Transactions on Signal Processing,
Systems with Applications, vol. 71, pp. 240–256, 2017. 2018.
[8] D. R. Vizard and R. Doyle, “Invited paper : Advances in millimeter wave [30] J. Wenger, “Automotive mm-wave radar: Status and trends in system
imaging and radar systems for civil applications,” in 2006 IEEE MTT-S design and technology,” 1998.
International Microwave Symposium Digest, pp. 94–97, June 2006. [31] J. Hasch, E. Topak, R. Schnabel, T. Zwick, R. Weigel, and C. Wald-
[9] P. Molchanov, S. Gupta, K. Kim, and K. Pulli, “Short-range FMCW schmidt, “Millimeter-wave technology for automotive radar sensors in
monopulse radar for hand-gesture sensing,” in Radar Conference the 77 GHz frequency band,” IEEE Transactions on Microwave Theory
(RadarCon), 2015 IEEE, pp. 1491–1496, IEEE, 2015. and Techniques, vol. 60, no. 3, pp. 845–860, 2012.
[10] J. Lien, N. Gillian, M. E. Karagozler, P. Amihood, C. Schwesig, [32] T. Nitsche, C. Cordeiro, A. B. Flores, E. W. Knightly, E. Perahia, and
E. Olson, H. Raja, and I. Poupyrev, “Soli: Ubiquitous gesture sensing J. C. Widmer, “Ieee 802.11 ad: directional 60 GHz communication
with millimeter wave radar,” ACM Transactions on Graphics (TOG), for multi-gigabit-per-second Wi-Fi,” IEEE Communications Magazine,
vol. 35, no. 4, p. 142, 2016. vol. 52, no. 12, pp. 132–141, 2014.
[11] H.-S. Yeo, G. Flamich, P. Schrempf, D. Harris-Birtill, and A. Quigley, [33] Anonymous, “60GHz radar database,” [Online]. Available:URL will be
“Radarcat: Radar categorization for input & interaction,” in Proceed- provided in the published version due to anonymity requirement.
ings of the 29th Annual Symposium on User Interface Software and [34] Y. Ghasempour, C. R. da Silva, C. Cordeiro, and E. W. Knightly, “IEEE
Technology, pp. 833–841, ACM, 2016. 802.11 ay: Next-generation 60 GHz communication for 100 Gb/s Wi-Fi,”
[12] N. Amanda, “Gesture recognition demonstration using TI mmwave IEEE Communications Magazine, vol. 55, no. 12, pp. 186–192, 2017.
sensors,” TI Training. [Online]. Available: https://training.ti.com. [35] K. Hempstalk and E. Frank, “Discriminating against new classes: One-
[13] S. Harmer, N. Bowring, D. Andrews, N. Rezgui, M. Southgate, and class versus multi-class classification,” in AI 2008: Advances in Artificial
S. Smith, “A review of nonimaging stand-off concealed threat detec- Intelligence (W. Wobcke and M. Zhang, eds.), pp. 325–336, 2008.
tion with millimeter-wave radar [application notes],” IEEE Microwave [36] G. E. Hinton and R. R. Salakhutdinov, “Reducing the dimensionality of
magazine, vol. 13, no. 1, pp. 160–167, 2012. data with neural networks,” Science, vol. 313, no. 5786, pp. 504–507,
[14] T. Sakamoto, T. Sato, P. Aubry, and A. Yarovoy, “Fast imaging method 2006.
for security systems using ultrawideband radar,” IEEE Transactions on [37] P. Vincent, H. Larochelle, I. Lajoie, Y. Bengio, and P. Manzagol,
Aerospace and Electronic Systems, vol. 52, no. 2, pp. 658–670, 2016. “Stacked denoising autoencoders: Learning useful representations in a
[15] B. Gonzalez-Valdes, Y. Álvarez, Y. Rodriguez-Vaqueiro, A. Arboleya- deep network with a local denoising criterion,” Journal of Machine
Arboleya, A. Garcı́a-Pino, C. M. Rappaport, F. Las-Heras, and J. A. Learning Research, vol. 11, pp. 3371–3408, 2010.
Martinez-Lorenzo, “Millimeter wave imaging architecture for on-the-
move whole body imaging,” IEEE Transactions on Antennas and
Propagation, vol. 64, no. 6, pp. 2328–2338, 2016.
[16] S. López-Tapia, R. Molina, and N. P. de la Blanca, “Using ma-
chine learning to detect and localize concealed objects in passive
millimeter-wave images,” Engineering Applications of Artificial Intel-
ligence, vol. 67, pp. 81–90, 2018.
[17] L. Yujiri, M. Shoucri, and P. Moffa, “Passive millimeter wave imaging,”
IEEE microwave magazine, vol. 4, no. 3, pp. 39–50, 2003.
[18] S. S. Ahmed, A. Schiessl, F. Gumbmann, M. Tiebout, S. Methfessel,
and L. Schmidt, “Advanced microwave imaging,” IEEE microwave
magazine, vol. 13, no. 6, pp. 26–43, 2012.
[19] K. Noujeim, G. Malysa, A. Babveyh, and A. Arbabian, “A compact
nonlinear-transmission-line-based mm-wave SFCW imaging radar,” in
Microwave Conference (EuMC), 2014 44th European, pp. 1766–1769,
IEEE, 2014.
324
Authorized licensed use limited to: Uppsala Universitetsbibliotek. Downloaded on September 10,2024 at 17:03:00 UTC from IEEE Xplore. Restrictions apply.