See discussions, stats, and author profiles for this publication at: https://www.researchgate.

net/publication/371903309

Apple Vision Pro and why extended reality will revolutionize the future of
medicine

Article in Irish Journal of Medical Science · June 2023

DOI: 10.1007/s11845-023-03437-z

CITATIONS READS
26 4,178

7 authors, including:

Ethan Waisberg Joshua Ong

University of Cambridge 191 PUBLICATIONS 1,670 CITATIONS
151 PUBLICATIONS 1,350 CITATIONS
SEE PROFILE
SEE PROFILE

Mouayad Masalkhi Nasif Zaman

University College Dublin University of Nevada, Reno
84 PUBLICATIONS 684 CITATIONS 95 PUBLICATIONS 1,014 CITATIONS

SEE PROFILE SEE PROFILE

All content following this page was uploaded by Nasif Zaman on 06 July 2023.

The user has requested enhancement of the downloaded file.

Apple Vision Pro and Why Extended Reality will Revolutionize the Future of
Medicine. Last revision on June 15, 2023.

Apple Vision Pro and Why Extended Reality will Revolutionize the Future of
Medicine
Ethan Waisberg MB BCh BAO1, Joshua Ong, MD2, Mouayad Masalkhi1, Nasif Zaman3, Prithul
Sarker3, Andrew G. Lee, MD5-12 Alireza Tavakkoli, PhD3
1
University College Dublin School of Medicine, Belfield, Dublin, Ireland
2
Michigan Medicine, University of Michigan, Ann Arbor, Michigan, United States
3
Human-Machine Perception Laboratory, Department of Computer Science and Engineering,
University of Nevada, Reno, Reno, Nevada, United States
5
Center for Space Medicine, Baylor College of Medicine, Houston, Texas, United States
6
Department of Ophthalmology, Blanton Eye Institute, Houston Methodist Hospital, Houston,
Texas, United States
7
The Houston Methodist Research Institute, Houston Methodist Hospital, Houston, Texas,
United States
8
Departments of Ophthalmology, Neurology, and Neurosurgery, Weill Cornell Medicine, New
York, New York, United States
9
Department of Ophthalmology, University of Texas Medical Branch, Galveston, Texas, United
States
10
University of Texas MD Anderson Cancer Center, Houston, Texas, United States
11
Texas A&M College of Medicine, Texas, United States
12
Department of Ophthalmology, The University of Iowa Hospitals and Clinics, Iowa City,
Iowa, United States

Corresponding Author:
Ethan Waisberg
Email: [email protected]
University College Dublin School of Medicine,
Belfield, Dublin 4, Ireland

Funding: NASA Grant [80NSSC20K183]: A Non-intrusive Ocular Monitoring Framework to

Model Ocular Structure and Functional Changes due to Long-term Spaceflight.

Keywords: artificial intelligence; generative pre-trained transformer; ophthalmology; medical

education

Words: 388 References:12 Figures: 0

1
Apple Vision Pro and Why Extended Reality will Revolutionize the Future of
Medicine. Last revision on June 15, 2023.

Abstract

Apple unveiled its highly an�cipated mixed-reality headset, called the Apple Vision Pro on June

5th 2023. The primary user interface relies on eye tracking, hand, gestures, cameras, and sensors,

elimina�ng the need for physical controllers such as keyboards or touch screens. The refined capabili�es

of this technology can be u�lized for diverse purposes, including but not limited to medical and surgical

educa�on, and remote medical consulta�ons. All things considered, virtual reality is a highly promising

area for the future of medicine, from improving medical educa�on, vision screening to physical and

psychological rehabilita�on. We look forward to further innova�ons in this exci�ng area for years to

come.

2
Apple Vision Pro and Why Extended Reality will Revolutionize the Future of
Medicine. Last revision on June 15, 2023.

Introduction

Apple recently unveiled its highly an�cipated mixed-reality headset, called the Apple Vision Pro on

Jun 5th 2023.1 This innova�ve device will feature excep�onal 4K displays for each eye and a brightness of

5000 nits. Instead of the physical screen in conven�onal computers, this device projects its output into

the user's eyes using two small, high-resolu�on displays.1 The primary user interface relies on eye

tracking, hand, gestures, cameras, and sensors, elimina�ng the need for physical controllers such as

keyboards or touch screens.1

In recent years, there have been notable advancements in the field of medicine with regards to

augmented reality (AR) and virtual reality (VR) technology.2 Apple Vision Pro displays significant poten�al

in the domain of medicine. The refined capabili�es of this technology can be u�lized for diverse

purposes, including but not limited to medical and surgical educa�on, and remote medical consulta�ons.

For example, surgeons can use immersive virtual environments to prac�ce their surgical skills, in a secure

and controlled environment, ul�mately leading to beter pa�ent outcomes.3 VR technology has

previously been used in physical and psychological rehabilita�on and has been shown poten�al to

reduce pain, depression, anxiety, emo�onal tension, stress, Hospital Anxiety Depression Scale and length

of hospitaliza�on.4 Virtual reality has also been used to improve clinical care and medical educa�on, with

a variety of applica�ons from stroke management, managing diabe�c emergencies, to improving

cannula�on skills.5

Our group has previously used VR technology to help assess astronaut vision changes during

long-dura�on spaceflight.6,7 Future applica�on of VR vision assessment technology can be used to help

screen individuals to help reduce preventable blindness in developing countries.8,9 Further research into

improving the test-retest reliability of these assessments will be essen�al.10 AR/XR technology has also

3
Apple Vision Pro and Why Extended Reality will Revolutionize the Future of
Medicine. Last revision on June 15, 2023.

been u�lized in the development of assis�ve devices for people with visual impairments. Head-mounted

displays, similar to the Apple Vision Pro, have the capability to augment visual percep�on by

superimposing digital data onto the physical environment.11 These devices can help individuals with low

vision navigate their surroundings, read text and recognize objects.12 Specific deficits such as

metamorphopsia can also be suppressed in augmented reality.11

All things considered, virtual reality is a highly promising area for the future of medicine, from

improving medical educa�on, vision screening to physical and psychological rehabilita�on. We look

forward to further innova�ons in this exci�ng area for years to come.

Compliance with Ethical Standards: This article does not contain any studies with human

participants performed by any of the authors.

Funding: None.

Conflict of Interest: None

4
Apple Vision Pro and Why Extended Reality will Revolutionize the Future of
Medicine. Last revision on June 15, 2023.

REFERENCES

1. Apple Vision Pro. Apple htps://www.apple.com/apple-vision-pro/.

2. Yeung, A. W. K. et al. Virtual and Augmented Reality Applica�ons in Medicine: Analysis of the

Scien�fic Literature. J Med Internet Res 23, e25499 (2021).

3. Ong, C. W., Tan, M. C. J., Lam, M. & Koh, V. T. C. Applica�ons of Extended Reality in Ophthalmology:

Systema�c Review. J Med Internet Res 23, e24152 (2021).

4. Bouraghi, H. et al. Virtual Reality and Cardiac Diseases: A Systema�c Review of Applica�ons and

Effects. Journal of Healthcare Engineering 2023, 1–20 (2023).

5. Dhar, E. et al. A scoping review to assess the effects of virtual reality in medical educa�on and clinical

care. DIGITAL HEALTH 9, 205520762311580 (2023).

6. Waisberg, E. et al. Head-Mounted Dynamic Visual Acuity for G-Transi�on Effects During

Interplanetary Spaceflight: Technology Development and Results from an Early Valida�on Study.

aerosp med hum perform 93, 800–805 (2022).

7. Ong, J. et al. Terrestrial health applica�ons of visual assessment technology and machine learning in

spaceflight associated neuro-ocular syndrome. npj Microgravity 8, 37 (2022).

8. Waisberg, E. et al. Op�mizing Screening for Preventable Blindness With Head-Mounted Visual

Assessment Technology. Journal of Visual Impairment & Blindness 116, 579–581 (2022).

9. Waisberg, E. et al. Advances in machine learning to detect preventable causes of blindness. Eye

(2022) doi:10.1038/s41433-022-02354-2.

5
 Apple Vision Pro and Why Extended Reality will Revolutionize the Future of
Medicine. Last revision on June 15, 2023.

10. Sarker, P. et al. Test–Retest Reliability of Virtual Reality Devices in Quan�fying for Rela�ve Afferent

Pupillary Defect. Trans. Vis. Sci. Tech. 12, 2 (2023).

11. Ong, J. et al. Head-mounted digital metamorphopsia suppression as a countermeasure for macular-

related visual distor�ons for prolonged spaceflight missions and terrestrial health. Wearable

Technologies 3, e26 (2022).

12. Waisberg, E. et al. Stroboscopic Augmented Reality as an Approach to Mi�gate Gravita�onal

Transi�on Effects During Interplanetary Spaceflight. 9, (2022).

View publication stats