Augmented Reality: PUNIT KUMAR (1509010153)
Augmented Reality: PUNIT KUMAR (1509010153)
by
PUNIT KUMAR (1509010153)
Bachelor of Technology
in
1
TABLE OF CONTENTS
DECLARATION iii
CERTIFICATE iv
ACKNOWLEDGEMENTS v
CHAPTER 1 INTRODUCTION OF AUGMENTED REALITY 6
CHAPTER 2 AUGMENTED REALITY OVERVIEW 7
CHAPTER 3 AR v/s VR 10
CHAPTER 4 DISPLAY 12
CHAPTER 5 DIFFERENT AR TECHNICS 15
CHAPTER 6 WHAT MAKES AR 17
CHAPTER 7 AR APPLICATION WORKING DOMAIN 19
CHAPTER 8 MOBILE AR SYSTEM 24
CHAPTER 9 CHALLENGES 28
CONCLUSIONS 29
REFERENCES 30
2
CERTIFICATE
This is to certify that the Report entitled “Augmented Reality” has been submitted by
Priyanshu Sharma under my guidance in partial fulfillment of the degree of Bachelor of
Technology in Computer Science Engineering of IEC College of Engineering & Technology
during the academic year 2017-2018 (Semester VI).
Date:
Place:
3
DECLARATION
I hereby declare that this submission is my own work and that, to the best of my
knowledge and belief, it contains no material previously published or written by
another person nor material which to a substantial extent has been accepted for the
award of any other degree or diploma of the university or other institute of higher
learning, except where due acknowledgment has been made in the text.
Signature
Name
Roll No.
Date
ACKNOWLEDGEMENT
4
It gives me a great sense of pleasure to present the report of the B. Tech Seminar undertaken
during B. Tech. Third Year. We owe special debt of gratitude to Professor Ms. Saumya Yadav,
Department of Computer Science Engineering, IEC College of Engineering and Technology,
for her constant support and guidance throughout the course of my work. Her motivation,
thoroughness and perseverance have been a constant source of inspiration for me. It is only
her cognizant efforts that my endeavors have seen light of the day.
I also take the opportunity to acknowledge the contribution of Mr. Rajneesh Singh, Head,
Department of Computer Science Engineering for his full support and assistance .I also do
not like to miss the opportunity to acknowledge the contribution of all faculty members of the
department for their kind assistance and cooperation during the development of our project.
Last but not the least, I acknowledge my friends for their contribution in the completion of
the report.
Signature:
Name :
Roll No.:
Date :
Signature:
Name :
Roll No.:
Date :
5
CHAPTER-1
1. INTRODUCTION
Technology has advanced to the point where realism in virtual reality is very
achievable. However, in our obsession to reproduce the world and human
experience in virtual space, we overlook the most important aspects of what makes
us who we are—our reality. Yet, it isn’t enough just to trick the eye or fool the body
and mind. One must capture the imagination in order to create truly compelling
experiences.
Augmented reality will truly change the way we view the world. Picture yourself
walking or driving down the street. With augmented-reality displays, which will
eventually look much like a normal pair of glasses, informative graphics will appear
in your field of view and audio will coincide with whatever you see. These
enhancements will be refreshed continually to reflect the movements of your head.
In this article, we will take a look at this future technology, its components and how
it will be used.
With the introduction of Augmented Reality (AR) as being coined the term in the
early nineties, we were able to apply virtual objects within physical reality.
Combining techniques of Sutherland/Sproull’s first optical see-through Head
Mounted Display (HMD) from the early 1960’s with complex, real-time computer-
Page 1
6
generated wiring diagrams and manuals. Both were registered with each other and
manuals were embedded within the actual aircraft for intensely detailed procedures.
Augmented reality (AR) refers to computer displays that add virtual information to
a user's sensory perceptions. Most AR research focuses on see-through devices,
usually worn on the head that overlay graphics and text on the user's view of his or
her surroundings. In general it superimposes graphics over a real world environment
in real time.
Getting the right information at the right time and the right place is the key in all
these applications. Personal digital assistants such as the Palm and the Pocket PC
can provide timely information using wireless networking and Global Positioning
System (GPS) receivers that constantly track the handheld devices. But what makes
augmented reality different is how the information is presented: not on a separate
display but integrated with the user's perceptions. This kind of interface minimizes
the extra mental effort that a user has to expend when switching his or her attention
back and forth between real-world tasks and a computer screen. In augmented
reality, the user's view of the world and the computer interface literally become
one.
Augmented reality is far more advanced than any technology you've seen in
television broadcasts, although early versions of augmented reality are starting to
appear in televised races and football games. These systems display graphics for
only one point of view. Next-generation augmented-reality systems will display
graphics for each viewer's perspective.
Page 2
7
CHAPTER-2
AR: OVERVIEW
2.1. DEFINITION
Augmented reality (AR) is a field of computer research which deals with the
combination of real world and computer generated data. Augmented reality (AR)
refers to computer displays that add virtual information to a user's sensory
perceptions. It is a method for visual improvement or enrichment of the surrounding
environment by overlaying spatially aligned computer-generated information onto a
human's view (eyes)
AR research focuses on see-through devices, usually worn on the head that overlay
graphics and text on the user's view of his or her surroundings. In general it
superimposes graphics over a real world environment in real time.
Page 3
8
2.2 PROPERTIES
2.3 HISTORY
The beginnings of AR, as we define it, date back to Sutherland’s work in the 1960s,
which used a see-through HMD to present 3D graphics. However, only over the past
decade has there been enough work to refer to AR as a research field. In 1997, Azuma
published a survey that defined the field, described many problems, and summarized
the developments up to that point. Since then, AR’s growth and progress have been
remarkable.
Page 4
9
CHAPTER-3
The term Virtual Reality was defined as "a computer generated, interactive, three-
dimensional environment in which a person is immersed." There are three key points
in this definition. First, this virtual environment is a computer generated three-
dimensional scene which requires high performance computer graphics to provide an
adequate level of realism. The second point is that the virtual world is interactive. A
user requires real-time response from the system to be able to interact with it in an
effective manner. The last point is that the user is immersed in this virtual
environment
One of the identifying marks of a virtual reality system is the head mounted display
worn by users. These displays block out all the external world and present to the
wearer a view that is under the complete control of the computer. The user is
completely immersed in an artificial world and becomes divorced from the real
environment.
A very visible difference between these two types of systems is the immersiveness of
the system. Virtual reality strives for a totally immersive environment. The visual, and
in some systems aural and proprioceptive, senses are under control of the system.
Page 5
10
1 reality virtuality continnum
The real world and a totally virtual environment are at the two ends of this continuum
with the middle region called Mixed Reality. Augmented reality lies near the real
world end of the line with the predominate perception being the real world augmented
by computer generated data.
Page 6
11
CHAPTER 4
4. DISPLAYS
Displays for viewing the merged virtual and real environments can be classified
into the following categories: head worn, handheld, and projective.
Users mount this type of display on their heads, providing imagery in front of their
eyes. Two types of HWDs exist: optical see-through and video see-through. The latter
uses video capture from head-worn video cameras as a background for the AR
overlay, shown on an opaque display, where as the optical see-through method
provides the AR overlay through a transparent display.
Established electronics and optical companies (for example, Sony and Olympus) have
manufactured color, liquid crystal display (LCD)-based consumer head-worn displays
intended for watching videos and playing video games. While these systems have
relatively low resolution (180,000 to 240,000 pixels), small fields of view
(approximately 30 degrees horizontal), and don’t support stereo, they’re relatively
lightweight (under 120grams) and offer an inexpensive option see-through displays
(later discontinued) that have been used extensively in AR research.
A different approach is the virtual retinal display which forms images directly on the
retina. These displays, which Micro Vision is developing commercially, literally draw
on the retina with low-power lasers whose modulated beams are scanned by
microelectromechanical mirror assemblies that sweep the beam horizontally and
vertically. Potential advantages include high brightness and contrast, low power
consumption, and large depth of the field.
Page 7
12
2 head worn dispay
Page 8
13
4.2 Handheld displays.
Some AR systems use handheld, flat-panel LCD displays that use an attached
camera to provide video see-through-based augmentations. The handheld display
acts as a window or a magnifying glass that shows the real objects with an AR
overlay.
3 handheld dispay
Page 9
14
4.3. Projection displays.
In this approach, the desired virtual information is projected directly on the physical
objects to be augmented. In the simplest case, the intention is for the augmentations to
be coplanar with the surface onto which they project and to project them from a single
room-mounted projector, with no need for special eyewear. Projectors can cover large
irregular surfaces using an automated calibration procedure that takes into account
surface geometry and image overlap.
Another approach for projective AR relies on head worn projectors, whose images are
projected along the viewer’s line of sight at objects in the world. The target objects are
coated with a retroreflective material that reflects light back along the angle of
incidence. Multiple users can see different images on the same target projected by
their own head-worn systems, since the projected images can’t be seen except along
the line of projection. By using relatively low output projectors, nonretroreflective
real objects can obscure virtual objects.
Page 10
15
CHAPTER 5
5. DIFFERENT AR TECHNIQUES
There are two basic techniques for combining real and virtual objects; optical and
video techniques. While optical technique uses an optical combiner, video
technique uses a computer for combining the video of the real world (from video
cameras) with virtual images (computer generated). AR systems use either Head
Mounted Display (HMD), which can be closed-view or see-through HMDs, or use
monitor-based configuration. While closed-view HMDs do not allow real world
direct view, see-through HMDs allow it, with virtual objects added via optical or
video techniques.
Page 11
16
CHAPTER 6
1. Display
This corresponds to head mounted devices where images are formed. Many objects
that do not exist in the real world can be put into this environment and users can view
and exam on these objects. The properties such as complexity, physical properties etc.
are just parameters in simulation.
2. Tracking
Getting the right information at the right time and the right place is the key in all these
applications. Personal digital assistants such as the Palm and the Pocket PC can
provide timely information using wireless networking and Global Positioning System
(GPS) receivers that constantly track the handheld devices
3. Environment Sensing
It is the process of viewing or sensing the real world scenes or even physical
environment which can be done either by using an optical combiner, a video combiner
or simply retinal view.
Page 12
17
The example of placing a rubick cube on the table illustrates AR technique:
Page 13
18
CHAPTER 7
Only recently have the capabilities of real-time video image processing, computer
graphic systems and new display technologies converged to make possible the display
of a virtual graphical image correctly registered with registered with a view of the 3D
environment surrounding the user. Researchers working with augmented reality
systems have proposed them as solutions in many domains. The areas that have been
discussed range from entertainment to military training. Many of the domains, such as
medical are also proposed for traditional virtual reality systems.
7.1. Medical
This domain is viewed as one of the more important for augmented reality systems.
Most of the medical applications deal with image guided surgery. Pre-operative
imaging studies, such as CT or MRI scans, of the patient provide the surgeon with the
necessary view of the internal anatomy. From these images the surgery is planned.
Visualization of the path through the anatomy to the affected area where, for example,
a tumor must be removed is done by first creating a 3D model from the multiple
views and slices in the preoperative study. Being able to accurately register the
images at this point will enhance the performance of the surgical team and eliminate
the need for the painful and cumbersome stereo tactic frames.
Page 14
19
7.2 Entertainment
A simple form of augmented reality has been in use in the entertainment and news
business for quite some time. Whenever we are watching the evening weather report
the weather reporter is shown standing in front of changing weather maps. In the
studio the reporter is actually standing in front of a blue or green screen. This real
image is augmented with computer generated maps using a technique called chroma-
keying. It is also possible to create a virtual studio environment so that the actors can
appear to be positioned in a studio with computer generated decorating
In this the environments are carefully modeled ahead of time, and the cameras are
calibrated and precisely tracked. For some applications, augmentations are added
solely through real-time video tracking. Delaying the video broadcast by a few video
frames eliminates the registration problems caused by system latency. Furthermore,
the predictable environment
Page 15
20
(uniformed players on a green, white, and brown field) lets the system use custom
chroma-keying techniques to draw the yellow line only on
the field rather than over the players. With similar approaches, advertisers can
embellish broadcast video with virtual ads and product placements
The military has been using displays in cockpits that present information to the pilot
on the windshield of the cockpit or the visor of their flight helmet. This is a form of
augmented reality display.
Imagine that a group of designers are working on the model of a complex device for
their clients. The designers and clients want to do a joint design review even though
they are physically separated. If each of them had a conference room that was
equipped with an augmented reality display this could be accomplished. The physical
prototype that the designers have mocked up is imaged and displayed in the client's
conference room in 3D. The clients can walk around the display looking at different
aspects of it
In the domain of robotics and telerobotics an augmented display can assist the user of
the system. A telerobotic operator uses a visual image of the remote workspace to
guide the robot. Annotation of the view would still be useful just as it is when the
scene is in front of the operator. There is an added potential benefit. The robot motion
could then be executed directly which in a telerobotics application would eliminate
any oscillations caused by long delays to the remote site.
Page 16
21
7.6. Manufacturing, Maintenance and Repair
Recent advances in computer interface design, and the ever increasing power and
miniaturization of computer hardware, have combined to make the use of augmented
reality possible in demonstration test beds for building construction, maintenance and
renovation. When the maintenance technician approaches a new or unfamiliar piece of
equipment instead of opening several repair manuals they could put on an augmented
reality display. In this display the image of the equipment would be augmented with
annotations and information pertinent to the repair. The military has developed a
wireless vest worn by personnel that is attached to an optical see-through display. The
wireless connection allows the soldier to access repair manuals and images of the
equipment. Future versions might register those images on the live scene and provide
animation to show the procedures that must be performed.
Virtual reality systems are already used for consumer design. Using perhaps more of a
graphics system than virtual reality, when you go to the typical home store wanting to
add a new deck to your house, they will show you a graphical picture of what the
deck will look like
When we head into some high-tech beauty shops today you can see what a new hair
style would look like on a digitized image of yourself. But with an advanced
augmented reality system you would be able to see the view as you moved. If the
dynamics of hair are included in the description of the virtual object you would also
see the motion of your hair as your head moved.
Page 17
22
7.8. Augmented mapping
Paper maps can be brought to life using hardware that adds up-to-the-minute
information, photography and even video footage. Using AR technique the system,
which augments an ordinary tabletop map with additional information by projecting it
onto the map’s surface. can be implemented.
It would help emergency workers and have developed a simulation that projects live
information about flooding and other natural calamities. The system makes use of an
overhead camera and image recognition software on a connected computer to identify
the region from the map’s topographical features. An overhead projector then overlays
relevant information - like the location of a traffic accident or even the position of a
moving helicopter - onto the map
Page 18
23
CHAPTER 8
Identifying generic tasks a mobile user would want to carry out using a
context-aware computing system
Defining a comprehensive set of reusable user interface components for
mobile augmented reality applications.
Making combined use of different display technologies, ranging from head-
worn, to hand-held, to palm-top to best support mobile users.
GPS system
A wireless network
The MARS user interfaces that we will present embody three techniques that we are
exploring to develop effective augmented reality user interfaces:
Page 19
24
information filtering, user interface component design, and view management.
Information filtering helps select the most relevant information to present, based on
data about the user, the tasks being performed, and the surrounding environment,
including the user's location. User interface component design determines the format
in which this information should be conveyed, based on the available display
resources and tracking accuracy. For example, the absence of high accuracy position
tracking would favor body- or screen-stabilized components over world-stabilized
ones that would need to be registered with the physical objects to which they refer.
View management attempts to ensure that the virtual objects that are selected for
display are arranged appropriately with regard to their projections on the view plane.
For example, those virtual objects that are not constrained to occupy a specific
position in the 3D world should be laid out so that they do not obstruct the view to
other physical or virtual objects in the scene that are more important. We believe that
user interface techniques of this sort will play a key role in the MARS devices that
people will begin to use on an everyday basis over the coming decade.
Implementation Framework
Hardware
The main components of our system are a computer (with 3D graphics acceleration),
a GPS system originally differential GPS, and now real-time kinematic
GPS+GLONASS, a see-through head-worn display with orientation tracker, and a
wireless network all attached to the backpack. The user also holds a small stylus-
operated computer that can talk to the backpack computer via the spread spectrum
radio channel. Thus we can control the material presented on the headworn display
from the handheld screen. We also provide a more direct control mechanism of a
cursor in the headworn display by mounting a track pad on the back of the handheld
display where it can easily be manipulated (we inverted the horizontal axis) while
holding the display upright.
Page 20
25
To make the system to be as lightweight and comfortable as possible, off-the-shelf
hardware can be used to avoid the expense, effort, and time involved in building our
own. Over the years, lighter and faster battery-powered computers with 3D graphics
cards, and finally graduated to laptops with 3D graphics processors
Software
Page 21
26
Applications of MARS
1. Touring machine
MARS unit acts as a campus information system, assisting a user in finding places
and allowing her to pose queries about items of interest, such as buildings and statues.
Page 22
27
3. UIs for Indoor/Outdoor Collaboration
Page 23
28
CHAPTER 9
9. CHALLENGES
Technological limitations
Although there is much progress in the basic enabling technologies, they still
primarily prevent the deployment of many AR applications. Displays, trackers, and
AR systems in general need to become more accurate, lighter, cheaper, and less power
consuming. Since the user must wear the PC, sensors, display, batteries, and
everything else required, the end result is a heavy backpack. Laptops today have only
one CPU, limiting the amount of visual and hybrid tracking that we can do.
We need a better understanding of how to display data to a user and how the user
should interact with the data. AR introduces many high-level tasks, such as the need
to identify what information should be provided, what’s the appropriate representation
for that data, and how the user should make queries and reports. Recent work suggests
that the creation and presentation of narrative performances and structures may lead
to more realistic and richer AR experience.
Social acceptance
The final challenge is social acceptance. Given a system with ideal hardware and an
intuitive interface, how AR can become an accepted part of a user’s everyday life, just
like a mobile phone or a personal digital assistant. Through films and television, many
people are familiar with images of simulated AR. However, persuading a user to wear
a system means addressing a number of issues. These range from fashion to privacy
concerns. To date, little attention has been placed on these fundamental issues.
However, these must be addressed before AR becomes widely accepted
Page 24
29
CHAPTER 10
10. CONCLUSION
The research topic "Augmented Reality" (AR) is receiving significant attention due to
striking progress in many subfields triggered by the advances in computer
miniaturization, speed, and capabilities and fascinating live demonstrations. AR, by
its very nature, is a highly inter-disciplinary field, and AR researchers work in areas
such as signal processing, computer vision, graphics, user interfaces, human factors,
wearable computing, mobile computing, computer networks, distributed computing,
information access, information visualization, and hardware design for new displays.
Augmented reality is a term created to identify systems which are mostly synthetic
with some real world imagery added such as texture mapping video onto virtual
objects. This is a distinction that will fade as the technology improves and the virtual
elements in the scene become less distinguishable from the real ones.
Page 25
30
3.
CHAPTER. 11
REFERENCES:
www.augmentedreality.com
www.newscientist.com /blogs/onepercent/augmented-reality/
www.howstuffworks.com/augmented-reality.htm
www.citeseer.ist.psu.edu.
www1.cs.columbia.edu
www.lsi.upc.es.
www.cs.ualberta.com
www.en.wikipedia.org/wiki/Augmented_reality
Page 26
31