A NOVEL AUGMENTED REALITY-INTEGRATED

PLATFORM FOR REAL-TIME PATIENT HEALTH

ASSESSMENT
Abstract:
In contemporary healthcare, timely and accurate patient health monitoring is crucial,
especially in emergency situations where delays can compromise patient safety. Current
systems often rely on manual checks of health parameters upon a patient's arrival at a
hospital, leading to potential delays in critical decision-making. To address this challenge, we
propose an advanced health monitoring system that integrates IoT sensors with augmented
reality (AR) using Unity 3D and the Vuforia Engine package. This system continuously collects
vital health data, including temperature, glucose levels, blood oxygen levels, and heart rate,
through IoT sensors, storing the information in a Firebase database for seamless access. The
AR component enhances the system by allowing healthcare providers to visualize real-time
data on a 3D heart model, accessible through a QR code-based interface. This innovative
approach not only reduces the time needed for patient assessment but also provides an
intuitive and interactive platform for healthcare professionals. By leveraging Unity 3D for the
KEY IoTand
AR application health monitoring,
integrating augmented
it with reality
Firebase, our healthcare,
solution Unity improves
significantly 3D, Vuforia
the Engine,
speed
WORDS: real-time patient data, Firebase database, emergency medical care, 3D heart
and accuracy of medical responses, ultimately enhancing patient outcomes in emergency
Existing System:
 Existing health monitoring systems often rely on manual data collection and analysis,
leading to delays in accessing crucial health information during emergencies, impacting
patient care.
 Traditional systems provide limited real-time data visualization, requiring healthcare
providers to interpret raw data, which can hinder quick decision-making in urgent medical

Existing System Drawback:

situations

Conventional health monitoring systems suffer from latency issues in data

retrieval and analysis, resulting in inefficacious management of critical patient
conditions during emergent circumstances.
The absence of real-time, integrated data visualization in traditional systems
leads to protracted diagnostic processes, potentially exacerbating patient
prognoses and delaying therapeutic interventions
Proposed System:
The proposed system utilizes augmented reality to display real-time health data, enhancing
visualization of vital signs and facilitating immediate, informed decision-making during
emergencies.
By storing patient data in a centralized database, the system ensures swift access and
retrieval of health information, significantly reducing delays in emergency medical response

Proposed System
Advantages:
The integration of augmented reality facilitates immediate, immersive visualization of health
metrics, streamlining diagnostic accuracy and expediting clinical decision-making in critical
scenarios.
Centralized data storage ensures expeditious retrieval of patient information, mitigating
latency and enhancing the efficacy of emergency interventions through prompt access to
Scope of the project:
The scope of this project encompasses the development of a real-time health monitoring
system that integrates IoT sensors with augmented reality (AR) for enhanced patient care. It
includes the design and implementation of sensor networks, data management using
Firebase, and an AR-based Android application for visualizing health metrics. This system is
aimed at improving real-time health monitoring, early diagnosis, and timely medical
interventions, thereby advancing patient outcomes.
Literature survey:
Title 1: A Review on the Latest Advancements and Innovation Trends in Vibration-Based Structural
Health Monitoring (SHM) Techniques for Improved Maintenance of Steel Slit Damper (SSD)

Authors: JOHN MARK G. PAYAWAL, DONG-KEON KIM.

Year: 2024

Description:

This study explores the latest advancements in vibration-based structural health monitoring (SHM)
techniques specifically for steel slit dampers (SSDs), which are critical for energy absorption and
structural safety during seismic events. Given the vulnerability of SSDs to wear, corrosion, and material
degradation, consistent monitoring is essential to ensure their reliability. Using the PRISMA 2020
guidelines, the paper identifies and reviews key vibration-based methodologies, highlighting their
advantages and limitations in SSD monitoring. It delves into sensor technologies, real-time SHM
frameworks, and practical implementations, offering a comprehensive analysis of optimal sensor
selection, data collection methods, experimental settings, and innovative approaches. The study also
proposes a maintenance standard for SSDs to enhance their safety and functionality in civil
Title 2: Next Generation Edge-Cloud Continuum Architecture for Structural Health Monitoring

Authors: Lorenzo Gigli, Federica Zonzini, Nicola Testoni, Marco Di Felice.

Year: 2023

Description:

The MAC4PRO architecture represents a cutting-edge sensor-to-cloud monitoring platform

designed for effective Structural Health Monitoring (SHM) of industrial and civil appliances. By
seamlessly integrating sensing technologies with advanced software, MAC4PRO provides
precise measurement, transmission, and analysis of data. Its notable features include high
interoperability and versatility, making it ideal for next-generation smart structures. Extensive
experimental validation demonstrated its capability to detect minor changes such as 1mm
leaks in pipelines and less than 1% frequency shifts in buildings after seismic events, all while
achieving over 90% reduction in edge-to-cloud data transfer
Title 3: Graphene-Enabled Wearable for Remote ECG and Body Temperature Monitoring.

Authors: Victor Toral, Yann Houeix, Denice Gerardo, Isabel Blasco-Pascual , Almudena Rivadeneyra, and
Francisco J. Romero

Year: 2024

Description:

This article explores the synthesis, characterization, and application of laser-synthesized graphene-
based materials in wearable technology for noninvasive physiological monitoring. It details the production
and analysis of laser-induced graphene (LIG) and laser-reduced graphene oxide (LrGO) using techniques like
scanning electron microscopy (SEM), micro-Raman spectroscopy, and X-ray photoelectron spectroscopy
(XPS). The study showcases the use of these materials in fabricating temperature sensors, micro-
supercapacitors (MSCs), and electrocardiogram (ECG) electrodes. LrGO’s temperature-dependent electrical
conductivity is utilized to create sensitive temperature sensors encapsulated in polydimethylsiloxane (PDMS)
for enhanced performance. LIG’s porous structure is leveraged for effective MSCs and ECG electrodes. A
wearable device incorporating these components, along with a Bluetooth low energy (BLE) microcontroller for
wireless data transmission and optimized power consumption for prolonged battery life, demonstrates the
Title 4: Autonomous Industrial IoT for Civil Engineering Structural Health Monitoring

Authors: Gaël Loubet, Alassane Sidibe, Philippe Herail, Alexandru Takacs.

Year: 2023

Description:

The article describes a wireless sensing node (SN) designed for the structural health monitoring of
reinforced concrete, as part of a cyber–physical system. This low-power SN, which consumes less than 21
mJ for complete processing and transmission, is battery-free and energy-autonomous, powered through
radiative electromagnetic wireless power transfer (WPT). It operates in the 868-MHz ISM band, allowing it
to wirelessly transmit data over tens of meters using LoRaWAN technology and be remotely controlled
and powered by a communicating node (CN) with an equivalent isotropic radiated power (EIRP) of +33
dBm. The SN can measure various parameters such as temperature, humidity, strain, and electrical
resistivity, essential for monitoring concrete health and estimating corrosion rates. By using the same
frequency for both wireless communication and power transfer, it avoids interference and supports the
deployment of multiple SNs and CNs over significant areas, making it suitable for harsh environments
like concrete, space, or underground settings.
Title 5: A Lightweight and Secure Authentication Scheme for Remote Monitoring of Patients in IoMT.

Authors : zohaib ali, saba mahmood, khwaja mansoor ul hassan , ali daud, riad alharbey, and amal
bukhari.

Year: 2024

Description:

Smart health technologies offer significant benefits like remote patient monitoring, personalized
therapy, and early disease detection, but they also raise concerns about data security and privacy.
Addressing these issues, a new lightweight authentication technique has been developed for smart
health environments, particularly for remote monitoring scenarios. This technique employs a Multiple
Factor approach combined with a lightweight algorithm to enhance security. The proposed scheme
has been rigorously analyzed both formally and informally, showing superior authentication
performance with minimal processing overhead (0.04 milliseconds) and low transmission overhead
(704 bits), compared to existing methods. This advancement promises to bolster data security and
privacy across various smart health applications.
Working Principle:
In this project, we utilize an ATmega 328 microcontroller as the primary controller and an
ESP8266 as a slave controller for cloud storage. The system employs flame sensors to detect
fires within a mall area. Upon detecting a fire, the robot automatically navigates to the fire
source and extinguishes it using a pump motor for water spraying. Ultrasonic sensors are
integrated for obstacle detection and avoidance, ensuring smooth and efficient navigation
through the mall's complex environment. The ESP8266 enables real-time updates by sending
alert messages to cloud web storage, ensuring that authorities and relevant personnel are
promptly notified of the fire incident. The combination of flame detection, autonomous
navigation, and real-time communication provides a robust and efficient solution for fire
management in public spaces. This system enhances safety by reducing response times and
automating firefighting efforts, thereby mitigating potential damage and risks to human life.
Through the integration of advanced sensors and cloud connectivity, the firefighting robot
offers a proactive approach to emergency management, ensuring a swift and coordinated
response to fire incidents in mall environments.
Block Diagram:
POWER SUPPLY

DHT11
ESP8266
NIR ARDUINO
MEGA

SPO2

AUGMENTED
REALITY APP
Module Name:
 Sensor Data Collection and Management Module

 Augmented Reality Visualization Module

 Real-Time Data Integration and Analysis Module

Modules Description:
 SENSOR DATA COLLECTION AND MANAGEMENT MODULE:
The Sensor Data Collection and Management Module is designed to integrate and coordinate
health sensors with the Arduino Mega microcontroller, serving as the core for data acquisition.
It incorporates the DHT11 sensor to measure temperature, the NIR sensor for monitoring
glucose levels, and the SPO2 sensor to track blood oxygen levels and heart rate. This module is
responsible for the continuous collection and transmission of health data to a Firebase
database, ensuring secure storage and real-time accessibility. By managing sensor integration
and data flow, the module guarantees accurate data collection and timely updates, facilitating
effective data management. This structured approach enables seamless monitoring and
 POWER SUPPLY

DHT11

NIR
ARDUINO MEGA

SPO2
 AUGMENTED REALITY VISUALIZATION MODULE :

The Augmented Reality Visualization Module is designed to enhance health monitoring

through immersive technology by developing an Android application with Unity 3D and
the Vuforia engine. This module provides an augmented reality (AR) interface that
projects detailed 3D models of the human body or heart when users scan image targets
or QR codes. The application overlays real-time sensor data, such as temperature,
glucose levels, blood oxygen, and heart rate, onto the 3D model in a text format,
allowing users to intuitively grasp and monitor these health metrics. By integrating AR
technology, the module facilitates interactive and engaging visualization, making it
easier for users to understand complex data and track health parameters effectively.
This approach not only improves user interaction but also enhances the accuracy and
accessibility of health information, ultimately supporting better decision-making and
patient care
POWER SUPPLY

ESP8266
ARDUINO
MEGA

AUGMENTED
REALITY APP
 REAL-TIME DATA INTEGRATION AND ANALYSIS MODULE :

The Real-Time Data Integration and Analysis Module is crucial for ensuring that health
data is consistently updated and accurately represented within the system. It handles
the continuous transmission of sensor data from the Arduino Mega to the Firebase
cloud, maintaining real-time updates for seamless monitoring. This module is
responsible for the efficient storage and retrieval of health metrics, such as
temperature, glucose levels, blood oxygen, and heart rate. By integrating this data with
augmented reality (AR) visualization, it enhances the system's ability to present real-
time health information interactively. This integration allows healthcare professionals to
quickly access and interpret critical data, facilitating timely and informed medical
decisions. The module's focus on real-time data accuracy and swift accessibility
significantly improves response times and patient care outcomes, making it an
essential component for effective health monitoring and intervention.
Hardware Requirement:
 POWER SUPPLY

 ARDUINO MEGA

 ESP8266

 DHT11

 NIR

 SPO2
Software Requirement:
 ARDUINO IDE
 EMBEDDED C

Application:
The system provides real-time health monitoring for patients, enabling healthcare
professionals to swiftly assess and analyze vital signs using augmented reality and
remote data retrieval.
It enhances patient engagement and education by visualizing health data through
interactive 3D models, making complex medical information more accessible and
understandable to users
Future Enhancement:
For future enhancements, the health monitoring system could integrate advanced concepts such as
machine learning algorithms and predictive analytics to further elevate its capabilities. By
incorporating machine learning, the system could analyze historical health data patterns and
predict potential health issues before they arise, enabling proactive medical interventions.
Additionally, the integration of wearable devices, such as smartwatches or biosensors, could
provide more granular and continuous health monitoring, capturing additional parameters like
activity levels, sleep patterns, and stress indicators. This expanded data set would enrich the
system's analytical capabilities, offering a more comprehensive view of the patient's health.
Furthermore, integrating telemedicine features could enable real-time virtual consultations with
healthcare providers directly through the AR interface, facilitating immediate expert input and
guidance. Enhancing data security through advanced encryption and blockchain technology could
further protect patient information and ensure its integrity. The use of augmented reality could also
be expanded to include interactive training modules for healthcare professionals, improving their
ability to interpret data and respond to emergencies effectively. By combining these advanced
technologies, the system could provide an even more robust and intelligent health monitoring
Conclusion:
In conclusion, the proposed health monitoring system represents a significant
advancement in the integration of IoT technology and augmented reality to enhance
patient care. By leveraging the Arduino Mega microcontroller and various sensors to
track critical health metrics—such as temperature, glucose levels, blood oxygen, and
heart rate—the system ensures accurate and continuous data collection. The integration
of this data with the Firebase cloud allows for real-time updates and secure storage,
facilitating prompt access and analysis. The innovative use of augmented reality,
through an Android application developed with Unity 3D and Vuforia, provides an
interactive platform for visualizing health information. Scanning QR codes or image
targets displays 3D models of the human body or heart, with real-time sensor data
overlaid, offering an intuitive and immersive experience for users. This approach not
only enhances the understanding of complex health metrics but also supports healthcare
professionals in making timely, informed decisions. The system's ability to deliver
immediate insights into a patient's health status significantly improves response times
and patient outcomes, making it a valuable tool in both routine and emergency medical
scenarios. Overall, this project exemplifies the potential of combining cutting-edge
technology with practical healthcare solutions to optimize monitoring, diagnosis, and
Reference or Bibliography:
[1] R. Pirmagomedov et al., “Characterizing throughput and convergence time in dynamic
multi-connectivity 5G deployments,” Comput. Commun., vol. 187, pp. 45–58, 2022.

[2] A. A. Pise et al., “Enabling artificial intelligence of things (AIoT) healthcare

architectures and listing security issues,” Comput. Intell. Neurosci., vol. 6, pp. 1–14, 2022.

[3] G. Tsochev, “Some security problems and aspects of the industrial Internet of Things,”
in Proc. IEEE Int. Conf. Inf. Technol., 2020, pp. 1–5.

[4] J. Shen, T. Zhou, D. He, Y. Zhang, X. Sun, and Y. Xiang, “Block design-based key
agreement for group data sharing in cloud computing,” IEEE Trans. Dependable Secure
Comput., vol. 16, no. 6, pp. 996–1010, Nov./Dec. 2019.

[5] F. Wu et al., “A lightweight and robust two-factor authentication scheme for

personalized healthcare systems using wireless medical sensor networks,” Future Gener.
Comput. Syst., vol. 82, pp. 727–737, 2018.
[6] M. A. Khan et al., “A provable and privacy-preserving authentication scheme for UAV-
enabled intelligent transportation systems,” IEEE Trans. Ind. Informat., vol. 18, no. 5, pp.
3416–3425, May 2022.

[7] T.-F. Lee, X. Ye, and S.-H. Lin, “Anonymous dynamic group authenticated key
agreements using physical unclonable functions for Internet of Medical Things,” IEEE
Internet Things J., vol. 9, no. 16, pp. 15336–15348, Aug. 2022.

[8] J. Miao, Z. Wang, Z. Wu, X. Ning, and P. Tiwari, “A blockchain-enabled privacy-

preserving authentication management protocol for internet of medical things,” Expert
Syst. Appl., vol. 237, 2024, Art. no. 121329.

[9] S. Das and S. Namasudra, “Lightweight and efficient privacy-preserving mutual

authentication scheme to secure Internet of Things-based smart healthcare,” Trans.
Emerg. Telecommun. Technol., vol. 34, 2023, Art. no. e4716.

[10] N. Singh and A. K. Das, “TFAS: Two factor authentication scheme for blockchain
enabled IoMT using PUF and fuzzy extractor,” J. Supercomputing, vol. 80, pp. 865–914,