Multimedia Technology (IT-204-F)

Section A
Introduction to multimedia

Lecture1
BasicsofMultimedia

1
Basics of Multimedia Technology
BasicsofMultimediaTechnology
Multimedia: The term multimedia comes from the Latin words
multus which means numerous and Media means
middle or centre. In other words we can say that multimedia
means Multiple
Multiple Intermediaries
Intermediaries or Multiple
Multiple Means
Means..

The multiple means by which one can perceive information are:

1 Text
1. T t (e.g.
( b k letters,
books, l tt newspapers))
2. Images and graphics(e.g. photographs, charts, maps, logos,
sketches)
3. Sound (e.g. radio, gramophone records and audio cassettes)
4. Video & animation (e.g. TV, video cassettes and motion
pictures)

2
 What is Multimedia?
WhatisMultimedia?
Multimedia
Multimedia hasnostrictdefinition.
has no strict definition

Multimediaisanycombinationoftext,graphic,sound,
animation and video that is delivered by computer.
animationandvideothatisdeliveredbycomputer.

Whenyouallowtheusertocontrolwhatandwhen
theseelementsaredelivered,itisinteractive
multimedia.

Text
Audioandspeech
Images
Graphics
Vid
Video

3
Multimedia Definitions
MultimediaDefinitions
Multimedia:
1. It is any combination of text, art, sound, animation, and video
delivered to you by computer or other electronically or digitally
manipulated means.

Although the definition is simple but the main motive behind the topic is
to make each multimedia element stand up and work.

Other Definitions:
2. Multimedia is commonly defined as the combination of text, graphics,
audio video and animation on a computer
audio, computer.

3. Multimedia is a method of designing and interacting computer

g on a single
technologies g pplatform that enables the end-user to input,
p ,
create, manipulate and output text, graphics, audio and video using a
single user interface.
4
Multimedia : Uses & Applications
Multimedia:Uses&Applications
Multimedia applications
pp are pprimarily
y existing
g applications
pp that can
be made less expensive or more effective through the use of
multimedia technology.
Uses of Multimedia:
1 B
1. Business
i
2. Education
3. Home
4 Public
4. P bli Place.
Pl
1. Multimedia in Business: Business is logical mainstream market
for multimedia. This includes marketing, advertising, product
demos and various other methods like ppresentation,, network
communication etc.
e.g. 1. advertising
2. Presentations
3. Multimedia Advertising.

5
 Applications Contd.:
ApplicationsContd.:
2. Multimedia in Education: This is perhaps the most needy field of
multimedia. One of the major challenge of today's scenario is to
meet the needs of variety of students. Multimedia will provoke
radical changes in the teaching process during the coming decades.

3. Multimedia at Home: The area of multimedia lies from gardening

to cooking to home design, remodeling and repair. Most
multimedia projects are reaching home via TV sets.
Today home consumers of multimedia own either a computer with
an attached CD-ROM or DVD drive or a set top player that is
connected with a TV. Another example is X-Box or Sony Play
station.

4. Multimedia in Public Places: In Hotels, Railway stations, shopping

malls, museums, multimedia can be made available in the form of
kiosks to provide information and help, or it can be connected with
wireless devices such as a cell phones or PDA(Personal digital
assistant).
6
 Applications Contd.:
ApplicationsContd.:
Somemoreapplicationsare:
pp
1. Video on Demand or Movies on demand, is a service that
provides movies on an individual basis to TV sets in peoples
home. The movies are stored in a central server and
transmitted through a communication network.
network A set-top
set top
box(STB) connected to a communication network converts
the digital information and make it displayed on TV sets.
2. Home Shopping
pp g & Information System:
y Manyy kind of ggoods
& services can be sold online either through TVs or through
internet. The service will help the user to navigate through the
available material to plan vacations, purchase goods or say
apply
pp y for new DL or Passport.
p
3. Networked Games: can be played with the help of a set-top
box or through internet.
4. Digital Libraries.
5. Telemedicine.
7
 Applications Contd:Multimedia In Telemedicine:
A multimedia telemedicine system using Transfer Control Protocol and
I t
Internett Protocol
P t l (TCP/IP) over the th Internet
I t t is
i developed.
d l d Doctor
D t with
ith
patient and doctor can communicate each other using this system. Real-
time data, including audio, video and instant message, and non-real-time
data,, includingg vital sign
g signals,
g , radiological
g images
g with DICOM 3.0,,
file, bio-signal, bio-data and so on, can be exchanged on the system. This
system's architecture is client/server mode.
All data are encoded/compressed before transferring through
I
Internet/Intranet.
/I Th real-time
The l i audio
di is
i encoded
d d andd decoded
d d d by
b MPEG
(Moving Picture Experts Group) audio layer 3 algorithm and real-time
video is encoded and decoded by MPEG-4. The software implementation
of needed functionalityy without anyy externallyy attached hardware CODEC
(Coder/Decoder) units enables the compact design with low cost. The real-
time video has 25 frames per second at Local Area Network and more than
20 frames per second at ADSL(Asymmetric digital subscriber line).

8
Multimedia: Present Scenario
Multimedia:PresentScenario
Multimedia in present Scenario: The multiple modalities of
text, audio, images, drawing, animation and video in multimedia
are put to use in ways as diverse as:
1. Video Teleconferencing
2. Distributed lectures for Higher Education.
3. Telemedicine.
4 Cooperative
4. C ti workk environment
i t that
th t allows
ll business
b i people
l to
t
edit a shared document or schoolchildren to share a single game,
that pass control back and forth.
5 Making
5. M ki multimedia
lti di components t editable-allowing
dit bl ll i the th user
side to decide what components, video, graphics are required or
can be deleted-thus making components Distributed.
6 Using voice
6. oice recognition to build
b ild an interacti
interactivee environment.
en ironment

9
 Multimedia Research
MultimediaResearch
Multimedia Research topics and Projects: Multimedia
consists of a wide variety of topics, such as:
1. Multimedia Processing & Coding: This includes multimedia
control analysis
analysis, content based multimedia retrieval
retrieval, multimedia
security, audio/image/video processing, compression etc.

2. Multimedia
2 M lti di System
S t Support
S t & Networking:
N t ki This
Thi includes
i l d
protocols, internet, operating systems, client and servers, quality
of service(QoS).

3. Multimedia tools, end systems, and Applications: These

includes hypermedia systems, user interfaces, authoring
systems,
t multimedia
lti di education
d ti etc. t

10
Multimedia Software Tools
MultimediaSoftwareTools
Multimedia S/W tools: These are divided into followingg main categories:
g
1. Music sequencing and Notations. Cakewalk, Cubase, Macromedia, Soundedit
2. Digital Audio: Cool Edit, Sound Forge, Pro Tools
3. Graphics and Image Editing: Adobe Illustrator, Adobe Photoshop,
M
Macromediadi Fireworks.
Fi k
4. Video Editing: Adobe Premiere, Adobe After Effects, Final Cut Pro.
5. Animation
Multimedia APIs Rendering Tools
1. Java 3D 1. 3D Studio Max
2. Direct X 2. Softimage XSI
3. Open GL 3. Maya
6. Multimedia Authoring: Macromedia Flash , Macromedia Director, quest

11
 Multimedia System
MultimediaSystem
Multimedia
Multimediainvolvesmorethansimple
involves more than simple
additionofnewdatatypes.

Itintegratesawiderangeofsymbol
modes simultaneously into a coherent
modessimultaneouslyintoacoherent
framework.

Theframeworkisusuallydenotedasa
multimedia system
multimediasystem.
12
Elements of Multimedia System
ElementsofMultimediaSystem
Elements of Multimedia Systems: A Multimedia system combines
elements that are familiar from the world of films, video, broadcast,
television, music and Telecommunications as well as computing.

Some of the basic components are:

1. A processor, a PC or a workstation that has been enhanced to
handle audio and video.
2 A variety
2. i t off methods
th d by
b which
hi h the
th user can interact
i t t with
ith the
th
system, such as keyboard, mouse, joystick or touch screen.
3. A screen that can display high quality still images and moving
videos as well as computer-generated
computer generated text, graphics and animation.
4. Speakers to allow speech and music to be output.
5. A Microphone.
6. A wayy to pplayy back pre-recorded
p source material,, usuallyy from
some form of optical disks, such as CD, DVD.
13
MultimediaSystemisMultidisciplinary

Computer
networks,
operatingsystem

Multimedia Computervision,
Image,audio,
Image, audio, S stem
System pattern recognition
patternrecognition
speechprocessing

Humancomputer
interaction Computer
graphics

14
Challenges in Designing Multimedia System
ChallengesinDesigningMultimediaSystem

Developing
Developingasuccessfulmultimediasystemisnon
a successful multimedia system is non
trivial.
Continuousmediatypessuchasvideoneedalotof
space to store and very high bandwidth to transmit.
spacetostoreandveryhighbandwidthtotransmit.

Theyalsohavetighttimingconstraints.

Automaticallyanalyzing,indexingandorganizing
informationinaudio,imageandvideoismuchharder
thanfromtext.

Multimediainvolvesmanydifferentresearchareas
andneedsmorecomplexandmoreefficient
algorithmsandhardwareplatforms.
l ith dh d l tf

15
ExamplesofMultimediaSystem
p y

RealEstate inMITsProjectAthena
16
Multimedia System Examples Contd.II
MultimediaSystemExamplesContd.

Navigation LearningEnvironment inMITsProjectAthena

17