Internet of Things: HCMC University of Technology and Education
Internet of Things: HCMC University of Technology and Education
FINAL PROJECT
INTERNET OF THINGS
Face Recognition Door Lock System
Instructor: Mr. Dinh Cong Doan
--------------------
HO CHI MINH CITY, April 30, 2022
2
Contents
ACKNOWLEDGEMENTS.........................................................................................................................3
CHAPTER 1: OVERVIEW OF THE TOPIC..............................................................................................4
1. Give out the problem:.....................................................................................................................4
2. Research Content:..........................................................................................................................5
CHAPTER 2: THEORETICAL BASIS......................................................................................................6
1. Hardware........................................................................................................................................6
1.1. ESP 32 ( Board ESP-CAM )...................................................................................................6
1.2. 12V Solenoid Lock..................................................................................................................8
1.3. Module Relay 5V:...................................................................................................................9
1.4. Ualt ttl programmer..............................................................................................................10
1.5. 16v 100uf capacitor...............................................................................................................12
1.6. Jump wire..............................................................................................................................12
1.7. 7805 Regulator:.....................................................................................................................13
2. Arduino IDE Software:................................................................................................................15
3. Principle of operation:..................................................................................................................16
CHAPTER 3: DESIGN AND BUILD THE SYSTEM..............................................................................17
1. Design...........................................................................................................................................17
2. Build the System:..........................................................................................................................18
CHAPTER 4: CONCLUSION.....................................................................................................................19
1. Result............................................................................................................................................20
2. Pros and cons................................................................................................................................20
3. Future Development Direction:....................................................................................................21
4. Tables of Task Division:...............................................................................................................21
CHAPTER 5: REFERENCES...................................................................................................................21
3
ACKNOWLEDGEMENTS
Sincerely thank!
Group 03
Huynh Thi My Duyen
Nguyen Tan Thanh
Phan Ngoc Bao Tuyen
4
Home security systems have become important to every home in Viet Nam.
In the past, most doors could be opened by traditional means, such as a key,
security card, password, or pattern. However, incidents like lost keys have led to
many disturbing cases such as theft and identity fraud. This has become an
important issue. To overcome this problem, facial recognition using deep learning
techniques has been introduced, and the Internet of Things (IoT) is also used to
implement an effective access control system. Raspberry Pi is a small computer
board that is programmable and is used as the main controller for facial
recognition, youth system, and locking system. The camera is used to record the
image of the person in front of the door. The IoT system allows the user to control
the entrance to the door.
Therefore, Face Recognition Door Lock System is a topic that my group
researches.
5
2. Research Content:
Study the documentation about Arduino & ESP32.
Design the identification camera, transmission block, power block, reader
and central processing block.
Design, calculate and build hardware.
Write code for Arduino.
Assemble and connect the central processing unit and other units.
Display data.
Run system tests.
Fix control errors, programming errors and errors of devices.
Write project report.
6
1. Hardware
1.1. ESP 32 ( Board ESP-CAM )
Overview:
ESP32-CAM is a module that you can use with countless
projects and with Arduino. It is a complete module with an
integrated microcontroller, which can make it work
independently. In addition to WiFi + Bluetooth connectivity,
this module also has a built-in video camera and a microSD
card slot for storage.
Block Diagram:
7
8
Parameters:
Onectividad: WiFi 802.11b/g/n + Bluetooth 4.2 with BLE.
Support uploading images over WiFi.
Connections: UART, SPI, I2C, And PWM. It has 9 GPIO
pins.
Clock frequency: up to 160Mhz.
Microcontroller computing power: up to 600 DMIPS.
Memory: 520KB SRAM + 4MB PSRAM + SD card slot
Extras: has multiple sleep modes, firmware upgradeable
by OTA, and LEDs to use built-in flash memory.
Camera: Support camera OV2640 can be bundled or
purchased independently. These cameras include:
2 MP on your sensor
UXGA array size 1622 × 1200 px
Output format YUV422, YUV420, RGB565, RGB555
and 8-bit data compression.
You can transfer images from 15 to 60 FPS.
Features:
Specifitcations:
Material: Stainless Steel
Power supply: 12VDC
Working current: 1.2A
Power: 14.5W
Power Requirements: 12VDC/2A
Dimensions: L54 x D38 x H28
Power supply time: Less than 5s
Weight: 150g
10
Product dimensions
No Parameter Value
1 Operating voltage 5 VDC
2 Current Consumption 80mA
3 Relay Current Trigger 5mA
4 Size 43mm x 17.3mm x 17mm
Input:
Supply voltage: 5VDC.
Control input signal: 0V.
+ Signal is 0V: the relay is closed.
+ The signal is 5V: the relay is open.
Output:
NC: Normally closed.
11
The FTDI Basic Breakout (5V) is a basic breakout board for the FTDI
FT232RL USB to serial IC. The pinout of this board matches the FTDI
cable to work with official Arduino and cloned 5V Arduino boards. It
can also be used for general serial applications. The DTR pin allows an
13
Fiber optic patch cord is used for patch cord from device to fiber link. It has a
thicker layer in use in optical transceivers and connections between terminal
boxes.
Arduino programs are written in C or C++. The Arduino IDE comes with a
software library called 'Wiring'.The user needs to define two functions to
execute a program:
Setup () : function run only once at the start of a program used to
initialize the settings.
Loop() : the function is called repeatedly until the board is turned off.
3. Principle of operation:
Once the correct face recognition has been learned, the RelayPin pin will be
pulled to the HIGH level. After 5 seconds have passed, if there is no
recognition face, the pin is set to LOW. The code in the rzoCheckForFace()
function can be changed to whatever function you require when it comes to
face detection.
19
1. Design
o Feature:
Face recognition.
Automatic unlock.
o Design:
CHAPTER 4: CONCLUSION
1. Result
After researching and manufacturing, our face recognize lock door system
has been working stably.
About design: Compact, simple and accurate.
About purpose: high versatility.
Difficulties encountered: Due to illness, we couldn't buy electronic
components easily, communication with team members was also limited
but our team tried our best to do.
2. Pros and cons
22
2.1. Pros
Suitable for all ages.
Suitable for forgetful people.
Use quickly.
Convenient
2.2. Cons
Lack of security should only be used for unlocking bedroom doors
or locking applications for things of moderate importance.
High price.
Requires skilled workers.
Use existing images for identification.
CHAPTER 6: REFERENCES
1. Retail e-commerce sales CAGR forecast in selected countries from 2016 to 2021". Statista.
October 2016. Archived from the original on 26 November 2017. Retrieved 4 May 2021.
2. Wienclaw, Ruth A. (2013). "B2B Business Models" (PDF). Research Starters:
Business. Archived (PDF) from the original on 18 July 2013. Retrieved 4 May 2021.
3. Bussey, Ed (6 March 2018). "How to prepare your products and brand for conversational
commerce". VentureBeat. Archived from the original on 29 September 2020. Retrieved 4
May 2021.
4. "The Ultimate Guide to eCommerce Marketing". Mayple. Archived from the original on 28 April
2021. Retrieved 4 May 2021.
5. Power, Michael 'Mike' (19 April 2013). "Online highs are old as the net: the first e-commerce was
a drugs deal". The Guardian. Archived from the original on 30 November 2016. Retrieved 4
May 2021.
6. "Four Products for On-Line Transactions Unveiled". Computerworld. International Data
Group. 10 (4): 3. 26 January 1976. Archived from the original on 23 December 2019. Retrieved 5
September 2019.
7. Tkacz, Ewaryst; Kapczynski, Adrian (2009). Internet - Technical Development and
Applications. Springer Science+Business Media. p. 255. ISBN 9783642050190. Archived from the
original on 4 May 2021. Retrieved 4 May 2021. The first pilot system was installing in Tesco in
the UK (first demonstrated in 1979 by Michael Aldrich).
24
57. "Ecommerce in the Middle East – What are the demographics?". Embitel. 17 June
2016. Archived from the original on 27 August 2017. Retrieved 4 May 2021.
58. Eisingerich, Andreas B.; Kretschmer, Tobias (March 2008). "In E-Commerce, More is
More". Harvard Business Review. 86: 20–21. Archived from the original on 3 December 2020.
Retrieved 4 May 2021.
59. Burgess, Stephen; Sellitto, Carmine; Karanasios, Stan (28 February 2009). Effective Web Presence
Solutions for Small Businesses: Strategies for Successful Implementation: Strategies for
Successful Implementation. IGI Global (published 28 February
2009). ISBN 9781605662251. Archived from the original on 4 May 2021. Retrieved 4 May 2021.
60. "Ecommerce Sales Topped $1 Trillion for First Time in 2012". eMarketer. 5 February
2013. Archived from the original on 30 March 2021. Retrieved 4 May 2021.
61. Enright, Allison (25 April 2013). "U.S. e-commerce sales could top $434 billion in 2017". Digital
Commerce 360. Archived from the original on 2 December 2020. Retrieved 4 May 2021.
62. DeLone, William H.; McLean, Ephraim R. (8 December 2014). "Measuring e-Commerce Success:
Applying the DeLone & McLean Information Systems Success Model". International Journal of
Electronic Commerce. 9 (1): 31–
47. doi:10.1080/10864415.2004.11044317. S2CID 205751936. Archived from the original on 23
March 2021. Retrieved 4 May 2021 – via Taylor & Francis.
63. Bakos, Yannis (2001). "The Emerging Landscape for Retail E-Commerce". Journal of Economic
Perspectives. 15 (1): 69–80. CiteSeerX 10.1.1.4.9128. doi:10.1257/jep.15.1.69. Archived from the
original on 18 January 2021. Retrieved 4 May 2021.
64. Constine, Josh (20 February 2018). "Facebook's plan to unite AR, VR and News Feed with 3D
posts". TechCrunch. Archived from the original on 4 May 2018. Retrieved 4 May 2021.
65. Kawa, Arkadiusz (2017). "Fulfillment Service in E-Commerce Logistics" (PDF). LogForum. 13 (4):
429–438. doi:10.17270/J.LOG.2017.4.4. eISSN 1734-459X. ISSN 1895-2038. Archived (PDF) from
the original on 4 May 2021. Retrieved 4 May 2021.
66. ^ Sloman, John; Garratt, Dean; Guest, Jon (2018). Economics (10th ed.). Pearson
plc. ISBN 9781292187853. Archived from the original on 4 May 2021. Retrieved 4 May 2021.
67. Sabanoglu, Tugba (26 March 2021). "Retail e-commerce sales worldwide from 2014 to
2024". Statista. Archived from the original on 22 November 2018. Retrieved 4 May 2021.
29
68. "Electronic money and electronic commerce". BBC News. Archived from the original on 4 May
2021. Retrieved 4 May 2021.
69. Li, Zhaolin; Lu, Qiang; Talebian, Masoud (28 October 2014). "Online versus bricks-and-mortar
retailing: a comparison of price, assortment and delivery time". International Journal of
Production Research. 53 (13): 3823–
3835. doi:10.1080/00207543.2014.973074. S2CID 111092824 – via Taylor & Francis.
70. Dimoka, Angelika; Hong, Yili; Pavlou, Paul A. (June 2012). "On Product Uncertainty in Online
Markets: Theory and Evidence" (PDF). Management Information Systems Quarterly. 36 (2): 395–
426. doi:10.2307/41703461. JSTOR 41703461. S2CID 8963257. Archived from the
original (PDF) on 6 January 2018. Retrieved 4 May 2021 – via JSTOR.
71. Marincas, Delia Adriana (2008). "Information system for the supply chain management". The
AMFITEATRU ECONOMIC Journal. 10 (24): 236–253. Archived from the original on 18 May 2015.
Retrieved 8 May 2015.
72. Evans, Richard (1 May 2002). "E-commerce, Competitiveness and Local and Regional
Governance in Greater Manchester and Merseyside: A Preliminary Assessment". Urban
Studies. SAGE Publishing. 39 (5–6): 947–
975. doi:10.1080/00420980220128390. JSTOR 43084757. S2CID 154155858.
73. Januszkiewicz, Monika (October 2017). "Online Virtual Fit Is Not Yet Fit For Purpose: An Analysis
Of Fashion e-Commerce Interfaces" (PDF). Proceedings of 3DBODY.TECH 2017: 210–
217. doi:10.15221/17.210. ISBN 9783033064362. Archived (PDF) from the original on 22 July
2018. Retrieved 4 May 2021.
74. DePillis, Lynda (16 July 2019). "Amazon's incredible, vanishing cardboard box". CNN
Business. Archived from the original on 16 July 2019. Retrieved 4 May 2021.
75. Barrabi, Thomas; Carter, Shawn M. (14 July 2017). "Retail Apocalypse: Pier 1 and the other
retailers closing, filing for bankruptcy". Fox Business. Archived from the original on 12 August
2019. Retrieved 4 May 2021.
76. Forte, Daniela (11 March 2019). "Store Closures, Failures Continue to Mount as Retailers Seek to
Pivot Faster". Multichannel Merchant. Access Intelligence, LLC. Archived from the original on 13
August 2019. Retrieved 4 May 2021.
77. ^ "The retail apocalypse is shutting down flagship stores". USA Today. Gannett. 1 August
2019. Archived from the original on 13 August 2019. Retrieved 12 August 2019.
30
78. Clark, Patrick (10 July 2013). "Click-to-Brick: Why Online Retailers Want Stores in Real
Life". Bloomberg News. Archived from the original on 26 July 2020. Retrieved 4 May 2021.
79. Taylor, Glenn (5 March 2018). "Retail's Big Opportunity: 87% Of U.S. Consumers Grasp The
Power Of Conversational Commerce". Retail Touch Points. Emerald X, LLC. Archived from the
original on 13 February 2021. Retrieved 4 May 2021.
80. Kohavi, Ronny; Provost, Foster (28 February 2001). Applications of Data Mining to Electronic
Commerce. Springer US (published 28 February 2001). pp. 115–
153. ISBN 9780792373032. Archived from the original on 4 May 2021. Retrieved 4 May 2021.
81. Clement, J. (12 February 2021). "Most popular online retail websites worldwide in 2020, by
average monthly traffic". Statista. Archived from the original on 21 May 2020. Retrieved 4
May 2021.
82. Kuhuk, Jane (19 May 2020). "COVID-19 shopping behavior: what products would customers
rather buy online?". Competera (Infographic). Archived from the original on 21 May 2020.
Retrieved 4 May 2021.
83. Anam, Bhatti; Akram, Hamza; Basit, Hafiz Muhammad; Khan, Ahmed Usman; Naqvi, Syeda
Mahwish Raza; Bilal, Muhammad (2020). "E-commerce trends during COVID-19
Pandemic" (PDF). International Journal of Future Generation Communication and
Networking. 13 (2): 1449–1452. ISSN 2233-7857. Archived (PDF) from the original on 30
December 2020. Retrieved 4 May 2021.