2021 7th International Conference on Advanced Computing & Communication Systems (ICACCS)

Interaction of Spatial Computing In Augmented

Reality
2021 7th International Conference on Advanced Computing and Communication Systems (ICACCS) | 978-1-6654-0521-8/20/$31.00 ©2021 IEEE | DOI: 10.1109/ICACCS51430.2021.9442010

S. Balakrishnan M.Syed Shahul Hameed Venkatesan. K

Dept. of Computer Science and University of Technology and Applied St. Josephs college of engineering
Business Systems, Sri Krishna College Sciences - SUR, Department of ECE
of Engg. and Technology, Coimbatore, PO BOX : 484, PC 411, SUR, The [email protected]
Tamilnadu, India Sultanate of Oman.

Aswin G
Full stack software developer
zealbots in chadura Tech,
Tiruchirapalli,
Tamilnadu, India.

Abstract—In the above certain years, the technology of spatial developing the simulated environment reality for user
computing has recognized the environment growth of interactions. The first phase of the technology is to access
simulated reality by user interaction and extensive knowledge Virtual Reality (VR) and involve the user towards 3D
which assist the 3D canvas used space for user interfaces.
dimension, artificial and digital mounted display with
Spatial computing is widely compatible with XR which is an
Extended Reality. This acts itself as an umbrella phase for
specific interaction between users and real world. Further,
Augmented Reality (AR), Mixed Reality (MR) and Virtual VR computations are used in many fields for increasing the
Reality (VR). Moreover, we are looking into the deep concepts virtual space in games, entertainment, education and sports.
of AR in spatial computing. Augmented reality is a new In the medical aspect, this assists in training surgical
medium of laminating and merging digital contents towards methods for viewing interventional approaches.The next
the real world. This medium provides individual assets phase of the technology is to operate Augmented Reality
connecting the physical-virtual world with steady control and (AR) which fixes and overlays all the digital concepts
enhances the overall environment reality of user s information. towards the real-time world. This reality elaborates the
These are obtained based on mobile devices, projection devices
information content to the user's conditions. This attains
and mounted displays that help in augmenting the information
over real-life. In advance, AR is part of spatial augmented
devices like monitoring screening, smartphones and google
reality which is an assistive technology tool used for camera. AR augments in virtual space with information on
determining the completion time of task, speed range and the real world. The digital world observes, quantifies and
quality of interactive computation. This paper delivers the manipulates augmented reality for representing numerous
effectiveness of Augmented Reality (AR) with possible technologies [1].
combination of technologies and applications from a user s
point of view. II. SPATIAL COMPUTING DEEP DIVE

Index Terms: Spatial computing, augmented reality, virtual

RPA is a “utilization of innovation that is represented
reality, mixed reality.
Spatial computing used 3D canvas space for user interfaces.
I. INTRODUCTION Extended Reality (ER) is the broad phase of spatial
computing. This holds all types of realities like augment,
“ Spatial Computing” is one of the huge concepts of
virtual and mixed which helps in computing XR user
connecting digital and physical reality into the actual world.
interactions. The human brain gives out three dimensional
This is almost done based on Virtual Reality (VR) and
physical conditions to the real world. Here, the languages
Augmented Reality (AR). This assists in digitalizing the
used for enhancing the computation is based on physical
object through the cloud, permits the sensors to react with
speech for grasping the knowledge. Spatial computing
each other and digitalizes the real world representation.
analyses the extensive recognition of information to gain
Further, this integrates the accomplishment of spatial
knowledge. In this numerous digital concepts are sorted
mapping to validate computer tracking and navigates the
such as data visualization, story analysis and mathematics
interaction process between object and person with physical
contents with a huge number of structures. This explores
to digital world. The spatial computing helps in integrating
human intellectual capability and expands the true
connection between human to machine and machine to
expectation over physical tasks with certain human abilities.
machine which process various operations based on
Thus, this enables the concept of collaboration between
classified advanced efficiency level of lives, industries,
humans and machines which utilize synchronization
medical-care, homes and transports. The top companies
processes [2-5].
invested in spatial computing are Amazon and Microsoft
technologies. Here, spatial computing technology helps in

978-1-6654-0521-8/21/$31.00 ©2021 IEEE

1900

Authorized licensed use limited to: University of Prince Edward Island. Downloaded on July 03,2021 at 11:18:52 UTC from IEEE Xplore. Restrictions apply.
 2021 7th International Conference on Advanced Computing & Communication Systems (ICACCS)

The three concepts of spatial computing includes: 3D UX/UI Design

(i) Enable the technologies to perceive the digital 3D The potential of spatial computing is determined by
concepts. unlocked technologies which are used for mirroring the
Example: Augmented Reality and Virtual Reality design of 2D-interactions but in the case of 3D interface it
headsets needs a UX design for collaborating the connection between
(ii) Allow the technologies to interact with digital 3D human interactions. This materializes the standard
concepts. Extensive Reality (XR) where more things are to be added.
Example: Voice controlling and Eye tracking In specific this is genuine interactions. This holds various
(iii) Effective ideology for 3D UX design. UX principles practices such as eye/hand tracking, voice
Audio Visual Technology controlling and haptices for certain progress of work. The
3D UX includes the (shown in figure 2) interaction design,
Spatial computing turns on with 3D imaging prototype frames, information architectures, user research
technologies. This includes AR Headsets, Holographic and many other scenarios, The 3D UI consists of visual
Displays, GearVR, HoloLens, Magic Leap and Looking designs, colors, graphic designs, layouts and typography of
Glasses. The advancement in the computation helps in the real world. This explores human intellectual capability
generating and solving the puzzles through various and expands the true expectation over physical tasks with
techniques. The Augmented-Headset is an exclusive type of certain human abilities [8].
head-moduled screen display that gives out simulate
visualization over physical environment to digital mode Spatial Computing Intelligent Machines
display. The users are allowed to hear and watch the world Spatial Computing uses intelligent machines for
through a determined headset glass. The Holographic enhancing the process of visualization in three-dimension
display helps in projecting the graphical image lighting that augmented reality. This technology is to operate Augmented
is used in scenes to view the objects picture and record the Reality (AR) which fixes and overlays all the digital
pattern such as X-ray images. GearVR is a virtual reality concepts towards the real-time world. This reality elaborates
headset which consists of more specific features like touch the information content to the user's conditions. This
pads and sensors to detect. It is the combination of Oculus includes Browsers, 3D models and slice tools. The
VR which analyses the screen display and obtains outcome projection of intelligent objects helps in determining the
imaging. The audio and visual technologies are important solutions for various things without pressing on keyboard or
components of spatial computing [6]. mouse. These are operated over educational areas,
entertainment fields, industries, modelling, games, health­
Interaction Technology care, space and scientific researchers. In advance, AR is part
The interaction technology of spatial computing is based of spatial augmented reality which is an assistive
on three dimensional authentication of visual technology tool used for determining the completion time of
communications. This assists in digitalizing the object task, speed range and quality of interactive computation.
through the cloud, permits the sensors to react with each
other and digitalizes the real world representation. Further,
this integrates the accomplishment of spatial mapping to III. AUGMENTED REALITY
validate computer tracking and navigates the interaction A physical framework with existence of mind in a
process between object and person with physical to digital perceived time state is known as Reality. Nowadays we can
world. The user interface of spatial computing includes also exist inside the computer generated space and time that
body gestures, eye and voice control connections [7]. is known as virtual reality. In between this another kind of
reality can be enhanced which includes normal reality and
The four important interaction technologies are: virtual reality that is called “Augmented Reality.” AR
processes reality with bits of virtual reality. In another
Interaction Specifications perspective this emphasizes the virtual objects into the
Technologies physical world rather than going around. AR assists in
seeing the nature of life before us like trees around the park,
Hand Hand tracking automatically dogs following the balls, children playing football they have
Tracking interacts and operates virtual objects. an augmentation added to digitalization. For example,
dinosaurs eating leaves of trees, dogs may be mixed with
Haptics It is virtual touch wearable their cartoon counterparts, and children may be seen kicking
technology made of augmented reality. past a space shuttle where they w ill score a goal [9].
Augmented reality (AR) is an important technology
Voice This is voice based digital assistance
movement right now and. This helps in enhancing the
Control engaged with VR and AR.
growth of AR Smartphones and other devices that are
readily available around the world. With the advancement
Eye Eye tracking enhances most
of AR technology, these models can be accessed through
Tracking effective delivering of visualization.
different smartphone applications. The augmented reality
consists of specific apps such as to identify cars
overcrowded on particular location, to capture the lenses on

1901

Authorized licensed use limited to: University of Prince Edward Island. Downloaded on July 03,2021 at 11:18:52 UTC from IEEE Xplore. Restrictions apply.
 2021 7th International Conference on Advanced Computing & Communication Systems (ICACCS)

snapchat and to enhance numerous shopping applications years they have become the most expensive way to improve
with trail clothes without moving out from home. AR is Augmented Reality and more importantly to make them
enveloping an open technology which magnifies virtual widely available to the users. These days, almost many of
items to the real world of greater user’s. Augmented Reality the smartphones can support AR. All you need is a camera,
holds 25% virtual and 75% real displaying information. In a display, and enough computer power to ensure a "real­
this, the users pursue to hold in touch with virtual and real time" connection with the given visualization. So as we
life interactions. AR devices digitize the items from the have seen, AR goes a long way from its origins, and these
physical environment to the top layers of elements. This days it is already doing amazing work. Here, AR already
enhances a computer initiated images in order to sight the has its own potential and what to expect in the future. Each
visibility of contrasting AR devices. Here, the smart devices year additionally AR and VR games are added into the app
are more adaptable to augmented reality for acquiring stores, especially AR-based games as they usually do not
additional experience. Further, the users have privilege to require the purchase of additional expensive hardware.
swap or connect more insights to real-time with lower cost Currently, augmented reality progresses to portable power
applications on mainstream media. This uses all supplies, displays and processors over finite technologies.
smartphones, tablets and mobile devices where the system
arguments with real world scenes. In fact, while moving in a The tools used for building and testing augmented reality
visual environment, user actions (movements / of apps are [11]:
communication) have a direct effect on a given material and (i) ARToolKit: This tool is used for tracking the
all of this happens in real time. If you pay close attention, viewpoint and analysing the virtual object interactions. The
these rules do not discriminate against any particular general platform used by ARToolKit is Windows, Linux,
instrument of output or contact area, which means that, in Android and iOS.
this theory AR is not limited to visual display and (ii) ARKit: This persistent multiple user detection and
performance. However, audio, haptic and AR gustatory are tracking to detect the 3D objects such as sculpture, furniture
very difficult to achieve. and toys. It is mainly designed for iOS users.
Properties abided in Augmented Reality: (iii) ARCore: This platform is developed for AR
(i) This merges virtual and real information with primary experience for motion tracking on camera and
actions towards the real world. understanding the environmental light estimation. This API
(ii) This has Real-time interactive updates. enables Android and iOS.
(iii) It contains virtual information on 3D space of the
physical environment.
V. Companies Based on AR

(i) Pepsi Max

This company pranks the Londoner communication and
authorizes the Augmented reality display for bus stops
while travelling, prevents the metro from clash, identify
aliens grabbing peoples which programme to justice.
(ii) US Army
This gives a situational recognition of soldiers of the
United States Army with AR based technologies. Here,
TAR which is Tactical augmented Reality which is used as
Fig 1: Architecture of Augmented Reality tech essential for soldiers eyepiece to mark the location of
companion and enemy. The TAR helps in night vision
The figure 1 shows the integrated interaction between goggles to see the objects at dark mode. This handles a GPS
the user and augmented reality in order to obtain output system which determines the exact position of soldiers
over visualization. The collaboration is around virtual world carrying each and every day to analyze their location if they
and mobile devices where the virtual environment enhances seem to be missing. A wireless eyepiece is connected over a
the resources eg: Education. Further, this experiments 3D soldiers tablet which is a wearable device that connects with
augmented reality towards the information of the real world. mounted thermal site rifles. In order the soldier obtained the
The multimedia elements and AR frameworks are clear view of the target to be pointed with imaging. Here,
interlinked. Finally, this process includes audios, images, almost long distance targets can be identified using eyepiece
videos, 3D objects, animations, stimulations, tracking and of Augmented reality technology.
recognition over visualized information in Augmented (iii) Disney
reality where this forms up with good architecture. This research helped out in coloring books with 3D
characters. Augmented Reality (AR) which fixes and
IV. EXISTING TOOLS OF AR overlays all the digital concepts. The children are more
initiated to colour up the character of disney world and
However, portable augmented devices are becoming Moreover, this is included as the example because it is a
more and more reliable ways for screening head-mounted normal application with lots of potentials towards the AR.
displays and it should come as no surprise that in recent (iv) Acura

1902

Authorized licensed use limited to: University of Prince Edward Island. Downloaded on July 03,2021 at 11:18:52 UTC from IEEE Xplore. Restrictions apply.
 2021 7th International Conference on Advanced Computing & Communication Systems (ICACCS)

It streams live races featuring Augmented reality. This is digitizes the images of the latest products. Further, they
attached to the wheels of racing bikes in order to influence deployed a Lowe’s store to estimate the virtual tape
the new model of Acura. AR race is the most rapid application which detailed 3D image items. This furnishes
experience of the single running in athletics with three laps attachment in profit-oriented home space. The duplex
shoots up to identify overall time durations. Acura is visible visualiser assists in buying a compatible room with various
on various phases such as for drivers and live audiences on paint shades using smartphone camera technology which
Facebook. This uniquely finds out the visualization and finally examines the paint and virtual room with VIBGYOR
obstacle of Acura that is to be handled properly. The car colours.
drivers mount the cameras over car’s and the bike rider (iii) Virtual applications of Virtual Artist
manages to attach it on the helmet to analyze the actions An augmented reality technology was developed over a
going around. The AR technology connects all the cosmetic company. The name of the company is Sephora
additional wide visors to predict the original colour in which inspects the client with greater experience for look
viewing experience. Here, the helmets are associated with gestures, lips shades, eye colors and other beauty products
computers to obtain a high performance over rendering too. This reformes digital virtual face makeup with exact
process. The Acura maintains the capacity of experience colour orientations. This is an important way to increment
with smooth visuals at high speed. the sales and impress the clients in a fun way of new brand
(v) L ’ Oreal glance looks. The next company which offers this is Rolex
which assists augmented reality to stimulate commercial
This enhances the makeup brand collections into certain needs and acquires purchase items. Here, the experience is
makeup apps like YouCam Perfect which elaborates the determined based on the virtual phase of clients model and
challenges of customers. In general to discover traditional style.
beauty products. This contains several features such as (iv) AR in healthcare
contouring, colour fixing and strobing. L ’Oreal is in Augmented reality is a powerful phase of healthcare and
partnership with Perfect crops which gives out ipads with it mainly focuses on medical student technologies. This
beauty contours. This allows the customers to makeup so helps in training the environment of AR and enhances the
efficiently and comfortably from home itself. In present 64 telemedicine to transmit direct connection between
makeup apps have been launched over app stores of India, professional and patients. At rigid conditions certain
USA and Russia. In addition, this cooperates with collection application of AR helps in motoring real-time data and
for products for delivery where the customers can purchase assists in curing such as identifying and diagnosing human-
up all the L ’Oreal Paris products over app and it is delivered body surgeries. The augmented reality in healthcare has
to ordered users through online communication using AR introduced a technology device AccuVein which analyzes a
developed technology. patient's veins and guides with a lower escalation of 45%
(vi) Bonus constantly. They have also enhanced a diagnostic tool on
This observes the view of Google videos and predicts the AR where the surgeons can determine the models and
recommended search technology for immense process of operation cuts in condition with tumor diseases. Further,
work. This explores human intellectual capability and research on AR Deloitte’s cause lots of healthcare
expands the true expectation over physical tasks. The Bonus operations which increases the business model technically
consists of AR and VR which are more immersed in our using the latest technology.
regular lives. (v) AR for fun
Rather than the increase of the sales, most of the time
augmented reality is used for fun purposes only. This assists
VI. BIG APPLICATIONS in engaging the people with fun games such as teeth
brushing, drawing and building blocks over AR technology.
(i) Airport application They have developed an app named DrawyBook which
The creative usage of AR technology in airports has enhances all sketching skills. Proceeding from gaming to
immense enhancement. This is an airport passenger eastabilng AR browsers have lots of constructive ideas in
application which won lots of awards. Gatwick has deploying camera display. The augmented reality apps are
developed this application and this helped more than 2,000 introduced for growing up in an advanced industry pattern.
beacons all around the extreme terminal. This mobile In addition the ideology is to develop an Augmented reality
application assists the passenger to trace out the nearby touch for numerous lives.
airport station locations and supports in reducing more
traffic movements on airports. VII. CONCLUSION
(ii) Applications of remodeled and Dulux Visualiser The whole Scientists say that, once we are in the
In this, purchasing furniture and delivering on time was a middle of the technology world, our brain will evolve to the
greater discovery but this did not enhance the work of next level, because the brain can’t find the real or fake
specific locations. They developed an application named things happening there. Worst case is, if we jump over the
Ikea which elaborates identification of required places to building in AR we are still alive but in reality we died. That
avoid future clashing. This application was constructed by may happen in future if we handle spatial computers overly.
ARkit of Apple technology which recognizes the space plan Another term most of the classes and lectures w ill be in AR,
and analyzes the Ikea items on the specific room that

1903

Authorized licensed use limited to: University of Prince Edward Island. Downloaded on July 03,2021 at 11:18:52 UTC from IEEE Xplore. Restrictions apply.
 2021 7th International Conference on Advanced Computing & Communication Systems (ICACCS)

that is good news for all students and professors. Your home Engineering Research, ISSN 0973-4562, Volume 11, Number 3
(2016) pp 2036-2041.
w ill be your classroom. Future is always unpredictable,
[9] Manojkumar, D., P. G. Scholar, CV Arul Kumar, and Coimbatore
that’s why we are still seeking something important. Plus or Kinathukadavu. "Privacy Policy Multiparty Access Control On
minus in technologies but the world can't stop growing the Content Sharing Sites.
technologies. The conclusion is that every technology has [10] Balakrishnan. S and K L Shunmuganathan, R. Sreenevasan,
its beauty side and defect side but we must take all the “ Amelioration of Artificial Intelligence using Game Techniques for
importance into the count. Thus, spatial computing enables an Imperfect Information Board Game Geister” International Journal
of Applied Engineering Research (IJAER). ISSN 0973-4562. Vol 9,
the technology of Augmented Reality (AR) in order to Number 22 (2014) pp. 11849-11860.
utilize and capture the information towards the physical and
digital world.

Future Works
In general, AR doesn’t include only in phones or tablets
but it enhances various researches on touch lenses, wearable
devices, voice control gadgets and many more. The latest
intention of augmented reality is to determine appropriate
and genuine involvement over phones or tablets but this
can't be restored exactly. Even glasses might be replaced in
the form of "smart glasses" but this mainly focuses on blind
peoples. Similarly, all developing technology on AR has
several diplomatic and social issues which instantly have
higher privacy agitate over Google Glass too. Some peoples
bothered more on recording chats and snapping images but
this could be assessed based on face recognition application
software. In production and sale augmented reality have
greater demand over latest brand technologies like AR
glasses, AR contacts, AR Glass-X and AR Google Lens.
Finally, Augmented reality helps in enhancing the future
over digitized real world. occupation generation.

References
[1] S. Balakrishnan, J. Janet, Aswin G. Artificial Intelligence and
Robotics: A Research Overview, CSI Communications magazine,
Volume No. 44, Issue No. 7, October 2020, pp. 24-26.
[2] Balakrishnan. S, Artificial Intelligence in a Quantum World of
Computation, CSI Communications magazine, Volume No. 44, Issue
No. 3, June 2020, pp. 28-30.
[3] Balakrishnan. S and K L Shunmuganathan. Article: A JADE
Implementation of Integrated Agent System for E-Mail Coordination
(IASEC). International Journal of Computer Applications 58(5): 5-9,
November 2012.
[4] S.Balakrishnan, “ An Overview of Agent Based Intelligent Systems
and Its Tools” , CSI Communications magazine, Volume No. 42,
Issue No. 10, January 2019, pp. 15-17.
[5] S.Balakrishnan, “ Agent based Bioinformatics Integration using JADE
- Overview”, CSI Communications magazine, Volume No. 43, Issue
No. 9, December 2019, pp. 29-31.
[6] Balakrishnan S and Steven Uatuaromuinjo Tjiraso, “ Integration of
Agent Based Computing with Cloud Computing: Towards Cloud
Intelligent Systems” , International Research Publication House,
Delhi. Engineering and Technology: Recent Innovations & Research,
ISBN- 978-93-86138-06-4, pp. 1-17.
[7] S. Balakrishnan, K.N. Sivabalan and J. Janet “ MASFE - Mutliagent
System for Filtering E-Mails Using JADE” , Advanced Engineering
Research and Applications (AERA), Research India Publications,
ISBN- 978-93-84443-42-9, pp. 148-167, 2017.
[8] P.Arivazhagan, Balakrishnan. S and K L Shunmuganathan. “ An
Agent Based Centralized Router with Dynamic Connection
Management Scheme Using JADE” , International Journal of Applied

1904

Authorized licensed use limited to: University of Prince Edward Island. Downloaded on July 03,2021 at 11:18:52 UTC from IEEE Xplore. Restrictions apply.