doc
doc
https://doi.org/10.22214/ijraset.2023.51769
International Journal for Research in Applied Science & Engineering Technology (IJRASET)
ISSN: 2321-9653; IC Value: 45.98; SJ Impact Factor: 7.538
Volume 11 Issue V May 2023- Available at www.ijraset.com
Abstract: In today's world, sleepiness is one of the main causes of road accidents, many of which have tragic outcomes. Statistics
show that the majority of traffic collisions, which frequently result in fatalities and serious injuries, are caused by sleepy driving.
As a result, various studies have been done to develop software that can recognize driver tiredness and alert them before making
a major error. Using methods from the automobile industry, several of the more popular ways to design their own systems.
However, other factors, such as vehicle type, road design, and the capacity to operate the driver's wheel, significantly impacted
these traditional criteria. In order to monitor a driver's drowsiness, certain techniques use psychological methods, which
frequently produce the most accurate and dependable results. These methods are expensive, though, because electrodes must be
applied to the head and torso. This paper describes a machine learning approach to sleepiness detection. The areas of the
driver's eyes are located using face detection, and these regions serve as templates for eye tracking in subsequent frames.
Finally, drowsiness detection is performed on the tracked eye images to produce alarm warnings. The three steps of this method
are Face detection, Eye detection, and Drowsiness detection. Image processing is used to identify the driver's face, and after that,
the image of the driver's eyes is extracted to look for indicators of sleepiness. The HAAR face detection algorithm uses image
frames that have been captured as input before producing the detected face. To generate results, the model is provided with a
sizable database of closed and open eyes. Every time the driver is observed to be sleepy, Buzz alerts the driver. The suggested
method for real-time driver drowsiness detection is a practical and affordable approach.
Keywords: Drowsiness, OpenCV, Eye Aspect Ratio, Convolutional Neural Network (CNN), HAAR cascade classifier, Webcam
I. INTRODUCTION
Driving while fatigued is frequently to blame for fatal car accidents. The majority of drivers are aware of the dangers of texting and
driving while intoxicated, but many people underestimate the dangers of sleepy driving. The National Safety Council estimates that
drowsiness driving results in approximately 100,000 collisions, 71,000 injuries, and 1,550 fatalities annually (NSC). In research by
the AAA Foundation for Traffic Safety, it was discovered that tiredness could potentially be a contributing factor in up to 9.5 percent
of collisions overall and 10.8 percent of collisions involving airbag deployment, injuries, or major property damage. Drowsy driving
is highly risky, thus it's important for drivers to be aware of the dangers. Drowsy driving must be recognized, and the motorist must
be warned [1,5].
Vehicle accidents are frequently caused by drowsy drivers. Lack of sleep has an impact on a person's capacity to perform their daily
activities. They react more slowly, have poorer memory and judgement, and their ability to function is compromised. Numerous
studies have revealed that inadequate sleep can impair driving just as much as intoxication from alcohol. 40% of those surveyed
admitted to having done so at least once while driving, with 20% of those admitting to having dozed off behind the wheel [4].
©IJRASET: All Rights are Reserved | SJ Impact Factor 7.538 | ISRA Journal Impact Factor 7.894 | 1344
International Journal for Research in Applied Science & Engineering Technology (IJRASET)
ISSN: 2321-9653; IC Value: 45.98; SJ Impact Factor: 7.538
Volume 11 Issue V May 2023- Available at www.ijraset.com
©IJRASET: All Rights are Reserved | SJ Impact Factor 7.538 | ISRA Journal Impact Factor 7.894 | 1345
International Journal for Research in Applied Science & Engineering Technology (IJRASET)
ISSN: 2321-9653; IC Value: 45.98; SJ Impact Factor: 7.538
Volume 11 Issue V May 2023- Available at www.ijraset.com
©IJRASET: All Rights are Reserved | SJ Impact Factor 7.538 | ISRA Journal Impact Factor 7.894 | 1346
International Journal for Research in Applied Science & Engineering Technology (IJRASET)
ISSN: 2321-9653; IC Value: 45.98; SJ Impact Factor: 7.538
Volume 11 Issue V May 2023- Available at www.ijraset.com
B. Algorithm Framework
The Transfer Learning theory serves as the model's foundation. A model created for a task in the past is used as the foundation for a
second activity model in the machine learning technique known as transfer learning. Using previously trained models as the
foundation for computer vision and natural language processing tasks is a well-liked approach for in-depth learning. Given the
substantial computing resources and time required to create neural network models for such issues, transferring learning makes
sense. They also yield incredibly precise results for comparable issues. Transfer learning is not the only learning area in deep
learning, but it is closely related to problems with multi-tasking and mental retardation. Transfer learning, however, is a well-liked
method of in-depth learning when you consider the specialized computer capabilities needed to train in-depth learning models or the
sizable and difficult data sets used to train in-depth learning models. Inductive Transfer is the name given to this type of transfer
learning used in deep learning.
In order to detect driver drowsiness, the proposed system employs a convolutional neural network (CNN). Deep learning techniques
most frequently employ convolutional neural networks (CNNs), a class of artificial neural networks, to analyse visual data. In at
least one of their layers, convolutional neural networks (CNNs) take the place of conventional matrix multiplication. They are used
in image processing and recognition because they were created specifically to process pixel data. Convolutional layers, pooling
layers (maximum, minimum, and average), ReLU layers, and fully connected layers are some of the layers in CNN. The convolution
layer consists of kernels (filters), each of which has a width, depth, and height.
©IJRASET: All Rights are Reserved | SJ Impact Factor 7.538 | ISRA Journal Impact Factor 7.894 | 1347
International Journal for Research in Applied Science & Engineering Technology (IJRASET)
ISSN: 2321-9653; IC Value: 45.98; SJ Impact Factor: 7.538
Volume 11 Issue V May 2023- Available at www.ijraset.com
C. HAAR Training
For the detection of faces and features (such as eyes, mouths, sunglasses, etc.), the Open CV library offers functions. These
functions can be used to train classifiers. HAAR training is the process of teaching the classifiers to recognise faces. Here, positive
and negative images are used to train a cascade function. The sum of the pixels under the various regions of the images is subtracted
to create the single value that makes up each feature. A different set of pixels is extracted for each characteristic. The required
process will not benefit from all of the extracted features.
D. Face Detection
The suggested approach will begin by individually recording each video frame. Live video processing is supported in great detail by
OpenCV. For each frame, the system will find the face in picture. The Haar face detection method is used to do this. The well-
known resilient feature-based method Haar cascade is effective in detecting faces in images. The non-face candidates can be
eliminated using the Haar algorithm's cascade of phases. Additionally, every phase consists of a mixture of several Haar features,
and a Haar feature classifier classifies each feature individually. This system can detect user sleepiness by analysing video stream
visuals. Face detection is performed using multiple CNNs kernelized correlation filters, a more sophisticated in-video face tracking
method. The driver's face's important features were located using 68 key points, included the lips and eyes. The system measured the
ratio of closed eye frames to total frames, the length of continuous eye closure, and the frequency of blinking to assess the driver's
level of drowsiness. The DDD system finally alerts the driver.
E. Eye Detection
The suggested technique makes use of HAAR Cascades to recognise objects in real time, such as the driver's face and eyes. The
model makes use of the Open CV library. After identifying the driver's face, the rate at which the eyes blink is used to determine the
driver's level of tiredness.
Using the scalar value, Eye Aspect Ratio (EAR) equation may identify an eye blink. For instance, if a driver's eyelids are blinking
more frequently, it indicates that they are drowsy. In order to determine the frequency of eye blinking, it is therefore required to
precisely identify the form of the eyes. The EAR is utilised as an estimation of the eye opening stage from the landmarks found in
the image of the face.
The eye characteristics are identified for each video frame between the calculated height and breadth of the eye. We then set the
frame counter "COUNTER" to 0 and the Boolean "ALARM ON" to OFF to keep up with the overall number of frames for both
open and closed eyes in addition to the alarm status. We raise the alarm if the recognised eyes are closed for longer than 10
consecutive frames; otherwise, the counter is reset to 0.
©IJRASET: All Rights are Reserved | SJ Impact Factor 7.538 | ISRA Journal Impact Factor 7.894 | 1348
International Journal for Research in Applied Science & Engineering Technology (IJRASET)
ISSN: 2321-9653; IC Value: 45.98; SJ Impact Factor: 7.538
Volume 11 Issue V May 2023- Available at www.ijraset.com
F. Drowsiness Detection
It is first necessary to determine whether the eyes are open or closed throughout the time in order to recognise drowsiness. To
determine whether the driver's eyes are open or closed, the Eye Aspect Ratio (EAR) is used. After identifying the driver's face, the
rate at which the eyes blink is used to determine the driver's level of tiredness. Using the scalar value, Eye Aspect Ratio (EAR)
equation may identify an eye blink. For instance, if a driver's eyelids are blinking more frequently, it indicates that they are drowsy.
In order to determine the frequency of eye blinking, it is therefore required to precisely identify the form of the eyes. The EAR is
utilised as an estimation of the eye opening stage from the landmarks found in the image of the face. The eye characteristics are
identified for each video frame between the calculated height and breadth of the eye [8].
The Euclidean formula is used to determine the EAR by measuring the distance between the important points on the eyes. When the
eye is open, the aspect ratio will be greater and more stable over time. When a blink occurs, the eye aspect ratio will decrease to
almost zero.
The Eye Aspect Ratio (EAR), an equation that captures this relationship, is derived from:
EAR= ||p2-p6|| + ||p3-p5|| / 2||p1-p4||
While the denominator of this equation calculates the distance between horizontal eye landmarks, the numerator of the equation
computes the distance between vertical eye landmarks. Following the acquisition of eyeballs, the algorithm calculates the total
number for open eyes in each frame to ascertain tiredness. The motorist is considered to be sleepy if the conditions are met. The
system's associated buzzer makes corrections to the driver's aberrant behaviour.
V. RESULT
The model is remarkably accurate at differentiating between closed and open eyes. Our system uses a webcam to capture images,
which are then processed using OpenCV image processing libraries, which is free and open-source software. The alarm is then set
off after the Haar cascade algorithm recognises the person's face and eye.
©IJRASET: All Rights are Reserved | SJ Impact Factor 7.538 | ISRA Journal Impact Factor 7.894 | 1349
International Journal for Research in Applied Science & Engineering Technology (IJRASET)
ISSN: 2321-9653; IC Value: 45.98; SJ Impact Factor: 7.538
Volume 11 Issue V May 2023- Available at www.ijraset.com
VII. CONCLUSION
To prevent drowsy driving-related accidents, Driver Drowsiness Detection was developed to assist drivers in staying awake while
operating a motor vehicle. This study focused on drowsy drivers and their propensity to cause auto accidents. The driver drowsiness
detection system calculates the driver's tiredness level from the driver using a combination of webcam, HAAR cascade classifier,
drowsiness detection is used to calculate whether or not a driver is drowsy. It simultaneously retrieves photos from the camera,
which is sufficient to identify a driver's features in real time. The system processes the captured images using open-source software
called Open CV image processing libraries. The system becomes a low-cost drowsiness detection system when a webcam and an
Open CV are combined.
REFERENCES
[1] Mali, S., Bangale, K., Walekar, R., & Shitole, P. T. Driver Drowsiness Detection Using Smartphone.
[2] Piyush, R. K., & Dahiya, N. (2019). Driver Distraction and Drowsiness Detection System.
[3] Khetan, D., Nawani, A., Aggarwal, A., & Kaur, M. S. Driver Drowsiness Detection in Real-time.
[4] Kiran, V. N., Raksha, R., Anisoor, R., Varsha, K. N., & Nagamani, N. P. (2020). Driver drowsiness detection. Int J Eng Res Technol (IJERT), 8(15), 33-35.
[5] Manjunath, C. R., Krishna, K. S., Sree, K. B., & Ramyatha, K. N. (2022, May). Driver Drowsiness Detection Alert System Using Haar Method. In International
Conference on Intelligent Emerging Methods of Artificial Intelligence & Cloud Computing: Proceedings of IEMAICLOUD 2021 (pp. 380-389). Cham:
Springer International Publishing.
[6] Jabbar, R., Al-Khalifa, K., Kharbeche, M., Alhajyaseen, W., Jafari, M., & Jiang, S. (2018). Real-time driver drowsiness detection for android application using
deep neural networks techniques. Procedia computer science, 130, 400-407.
[7] Sajikumar, A., Aji, A., Baby, J., Prasad, A., Stanly, A. K., & John, N. M. (2021). Save the drowsy driver drowsy driver detection.
[8] Musale, T., & Pansambal, B. H. (2017). Driver Drowsiness Detection Technique Using Raspberry pi. International Journal of Development Research, 7(02), 49-
53.
©IJRASET: All Rights are Reserved | SJ Impact Factor 7.538 | ISRA Journal Impact Factor 7.894 | 1350