Scribd
Upload
12 views

Introduction_v4 3

The document provides an overview of multimedia systems, detailing the integration of various media types, including text, graphics, audio, and video. It distinguishes between time-independent and time-dependent media, explaining their characteristics and examples. Additionally, it discusses multimedia processing techniques such as compression, encryption, enhancement, and transformation.

Uploaded by

cdd306820
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPT, PDF, TXT or read online on Scribd
12 views

Introduction_v4 3

The document provides an overview of multimedia systems, detailing the integration of various media types, including text, graphics, audio, and video. It distinguishes between time-independent and time-dependent media, explaining their characteristics and examples. Additionally, it discusses multimedia processing techniques such as compression, encryption, enhancement, and transformation.

Uploaded by

cdd306820
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PPT, PDF, TXT or read online on Scribd
You are on page 1/ 51

Introduction

Tsung-Yi Wu
Introduction
 What is a multimedia system?
– A multimedia system supports the
integrated storage, transmission and
representation of the discrete media
types text, graphics and image and the
continuous media types audio and video
on a digital computer.
A Hybrid
(analog/digital)
Multimedia System
 Early multimedia system, around 1985
Digital Multimedia
System
 The media streams are digital. They can be
processed (e.g., compressed/
decompressed,analyzed) in the computer.
Time-Independent
Media
 Information is not related to timing of
the data stream
 All „classic“ media in the computer,

such as:
– text
– graphics (line drawings, vector graphic)
– image (photo, pixel graphics).
Time-Independent
Media
 Example [Kitaoka 2003]
Time-Independent
Media
 Illusory Motion (Ming-Te Chi et al.)
Time-Independent
Media
 Example (Image)
Time-Independent
Media
 Example (Image)
Time-Independent
Media
 Example (Image)
Time-Independent
Media
 Hybrid Image
– http://olivalab.mit.edu/hybrid_gallery/
gallery.html
Time-Independent
Media
 Graphics
– An SVG (scalable vector graphic) file
 SVG stands for Scalable Vector Graphics.
 SVG defines vector-based graphics in XML format
Time-Independent
Media
 Example (3D Stereogram)
Time-Independent
Media
 Example (How to see, 14 cyclic stones)
Time-Independent
Media
 3D Stereogram
– DIY
 http://www.flash-gear.com/stereo/

 Why do they look 3D?


– http://www.kondo3d.com/stereo/why-3d/
why-3d-e.html
 Paper
Time-Independent
Media
 Why do they look 3D?
Time-Independent
Media
Right Eye Left Eye

A B B A

A and B: recognized
Focus Point positions of objects
A and B: images of left eye
A and B: images of right eye
B
Time-Independent
Media
 Example (3D ASCII Stereogram)
Time-Independent
Media
 Example (3D ASCII Stereogram)
Time-Independent
Media
 Optical Illusion
Time-Dependent
Media
 Information is time-related, must be shown to
the user at specific points in time
 Continuous data streams
– Data appears in regular intervals
 Examples:
– Video (continuous)
Time-Dependent
Media
 Examples:
– An animation (not a continuous stream,
but time-dependent)

– An interactive game on the Internet (not


a continuous stream, but has real-time
requirements)
– Audio (continuous)
Time-Dependent
Media
 Image Morphing
– Morphing is a special effect in motion pictures and
animations that changes (or morphs) one image into
another through a seamless transition.
 Morph Tools
– FantaMorph
– Fun Morph
Time-Dependent
Media
 3D Stereogram Movie in Ascii
http://www.kammerl.de/ascii/AsciiStere
oMovie.php
 3D Animated Stereograms

– http://www.hidden-3d.com/
stereogram_theory.php
Multimedia System
 Integrated
 production,

 processing,

 storage,

 representation,

 Transmission, etc.

of several time-dependent and time-


independent media streams
History of Bandwidth
in Computer Networks
Network Requirements
of Different Types of
Data Streams
Multimedia Processing
 Compression/Decompression
 Encryption/Decryption

 Enhancement

 Transformation

 Recognition

 Etc.
Compression
 Goal
– The compression
of multimedia data
streams saves
 storage space
 transmission
bandwidth
Compression
 Lossless
– If the recovered data are assured to be identical
to the source
– Lossless compression techniques are requisite
for applications involving textual data
 e.g. ZIP
 Lossy
– Other applications, such as those involving voice
and image data, may be sufficiently flexible to
allow controlled degradation in the data
Compression
 Lossy
– Example (DCT)
 Although there is some loss of quality in the reconstructed
image, it is clearly recognizable, even though almost 85%
of the DCT coefficients were discarded.
Encryption
 Example

2
Encryption
 Example
Encryption
 Example
Encryption
 Example (Decryption)
Encryption
 Text/String

KA-B KA-B

plaintext encryption ciphertext decryption plaintext


message, m algorithm algorithm
K (m)
A-B
m=K
A-B
(KA-B(m) )
Enhancement
 Examples
Transformation
 Example
Transformation
 Example
– Original
– Changed
Recognition
 Example
Tools
 Matlab
I = imread('cameraman.tif');
I = im2double(I);
T = dctmtx(8);
B = blkproc(I,[8 8],'P1*x*P2',T,T');
mask = [1 1 1 1 0 0 0 0
1 1 1 0 0 0 0 0
1 1 0 0 0 0 0 0
1 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0
0 0 0 0 0 0 0 0];
B2 = blkproc(B,[8 8],'P1.*x',mask);
I2 = blkproc(B2,[8
8],'P1*x*P2',T',T);
imshow(I), figure, imshow(I2)
Tools
 Matlab
Tools
 PhotoImpact
Tools
 Audacity
FrontPage
 HTML
 Javascript
function encode() {
if(document.form2.R1[0].checked){
Result="0 分 ";
}
if(document.form2.R1[1].checked){
Result="30 分 ";
}
document.form1.S1.value=Result;
}
 Java
Anfy
 Anfy (Java™) includes 52 applets, top
effects and menu for web sites and blogs.
Plus screensaver.
Flash MX
PowerPoint
 Example
PowerPoint
 Example
PowerPoint

50
App
 http://processing.org/tutorials/android/

You might also like