Scribd
Upload
57 views

Lecture 8 - JPEG Compression (Part 3) : Klara Nahrstedt Spring 2012

This document provides an overview of JPEG compression (part 3). It discusses hybrid coding schemes used in JPEG that apply both lossy and lossless compression techniques. Specifically, it covers quantization which throws out less significant frequency components, and entropy encoding which further compresses the quantized coefficients without loss. It also describes how DC coefficients representing average block intensity are encoded using difference encoding to take advantage of small differences between blocks.

Uploaded by

Reni Hoxhaj
Copyright
© © All Rights Reserved
Available Formats
Download as PPT, PDF, TXT or read online on Scribd
57 views

Lecture 8 - JPEG Compression (Part 3) : Klara Nahrstedt Spring 2012

This document provides an overview of JPEG compression (part 3). It discusses hybrid coding schemes used in JPEG that apply both lossy and lossless compression techniques. Specifically, it covers quantization which throws out less significant frequency components, and entropy encoding which further compresses the quantized coefficients without loss. It also describes how DC coefficients representing average block intensity are encoded using difference encoding to take advantage of small differences between blocks.

Uploaded by

Reni Hoxhaj
Copyright
© © All Rights Reserved
Available Formats
Download as PPT, PDF, TXT or read online on Scribd
You are on page 1/ 40

CS 414 Multimedia Systems Design

Lecture 8 JPEG
Compression (Part 3)

Klara Nahrstedt
Spring 2012

CS 414 - Spring 2012


Administrative
MP1 is posted

CS 414 - Spring 2012


Today Covered Topics
Hybrid Coding:
JPEG Coding

Reading: Section 7.5 out of Media Coding


and Content Processing, Steinmetz &
Nahrstedt, Prentice Hall 2002

CS 414 - Spring 2012


Ubiquitous use of digital images

CS 414 - Spring 2012


Image Compression and
Formats
RLE, Huffman, LZW (Lossless Coding)
GIF
JPEG / JPEG-2000 (Hybrid Coding)

Original 60KB 98% less 1KB


CS 414 - Spring 2012
JPEG (Joint Photographic Experts
Group)
Requirements:
Very good compression ratio and good quality
image
Independent of image size
Applicable to any image and pixel aspect ratio
Applicable to any complexity (with any
statistical characteristics)

CS 414 - Spring 2012


JPEG Belong to Hybrid Coding Schemes

Lossy Coding

Lossless Coding
RLE, Huffman or
Arithmetic
CS 414 - Spring 2012 Coding
JPEG Compression (Baseline)
8x8 blocks Source
Image
Image Preparation
B
G
R
DCT-based encoding

Entropy Compressed
FDCT Quantizer
Encoder image data
Image Processing

Table Table

CS 414 - Spring 2012


1. Image Preparation
The image preparation is NOT BASED on
9-bitYUV encoding
Fixed number of lines and columns
Mapping of encoded chrominance
Source image consists of components
(Ci) and to each component we assign
YUV, RGB or TIQ signals.

CS 414 - Spring 2012


Division of Source Image into
Planes

CS 414 - Spring 2012


Components and their
Resolutions

CS 414 - Spring 2012


Color Transformation (optional)
Down-sample chrominance components
compress without loss of quality (color space)
e.g., YUV 4:2:2 or 4:1:1

Example: 640 x 480 RGB to YUV 4:1:1


Y is 640x480
U is 160x120
V is 160x120

CS 414 - Spring 2012


Image Preparation (Pixel
Allocation)
Each pixel is presented by p bits, value is in
range of (0,2p-1)
All pixels of all components within the same
image are coded with the same number of bits
Lossy modes use precision 8 or 12 bits per
pixel
Lossless mode uses precision 2 up to 12 bits
per pixel

CS 414 - Spring 2012


Image Preparation - Blocks
Images are divided into data units, called
blocks definition comes from DCT
transformation since DCT operates on
blocks
Lossy mode blocks of 8x8 pixels;
lossless mode data unit 1 pixel

CS 414 - Spring 2012


Data Unit Ordering
Non-interleaved: scan from left to right, top
to bottom for each color component

Interleaved: compute one unit from each


color component, then repeat
fullcolor pixels after each step of decoding
but components may have different resolution

CS 414 - Spring 2012


Example of Interleaved Ordering

MCU: Minimum Coding Unit

CS 414 - Spring 2012


[Wallace, 1991]
2. Image Processing
Shift values [0, 2P - 1] to [-2P-1, 2P-1 - 1]
e.g.
if (P=8), shift [0, 255] to [-127, 127]
DCT requires range be centered around 0
Values in 8x8 pixel blocks are spatial
values and there are 64 samples values in
each block

CS 414 - Spring 2012


Forward DCT
Convert from spatial to frequency domain
convert intensity function into weighted
sum of periodic basis (cosine) functions
identify bands of spectral information that
can be thrown away without loss of quality

Intensity values in each color plane often


change slowly

CS 414 - Spring 2012


1D Forward DCT
Given a list of n intensity values I(x),
where x = 0, , n-1
Compute the n DCT coefficients:
2 n 1
(2 x 1)
F (u ) C (u ) I ( x) cos , u 0...n 1
n x 0 2n

1
for u 0,
where C (u ) 2
1 otherwise

CS 414 - Spring 2012


Visualization of 1D DCT Basic
Functions

F(0) F(1) F(2) F(3) F(4) F(5) F(6) F(7)

CS 414 - Spring 2012


1D Inverse DCT
Given a list of n DCT coefficients F(u),
where u = 0, , n-1
Compute the n intensity values:
2 n 1
( 2 x 1)
I ( x)
n

u 0
F (u )C (u ) cos
2n
, x 0...n 1

1
for u 0,
where C (u ) 2
1 otherwise

CS 414 - Spring 2012


Extend DCT from 1D to 2D
Perform 1D DCT on each
row of the block

Again for each column of


1D coefficients Y
alternatively, transpose
the matrix and perform
DCT on the rows
X
Equations for 2D DCT
Forward DCT:
2 m 1 n 1
(2 x 1)u (2 y 1)v
F (u , v) C (u )C (v) I ( x, y ) * cos * cos
nm y 0 x 0 2n 2 m

Inverse DCT:
2 m 1 n 1 (2 x 1)u (2 y 1)v
I ( y, x)
nm v 0 u 0
F ( v , u )C (u )C ( v ) cos
2n


* cos
2m


Visualization of 2D DCT Basis
FunctionsIncreasing frequency
Increasing frequency

CS 414 - Spring 2012


Coefficient Differentiation
F(0,0)
includes the lowest frequency in both directions
is called DC coefficient
Determines fundamental color of the block

F(0,1) . F(7,7)
are called AC coefficients
Their frequency is non-zero in one or both
directions

CS 414 - Spring 2012


3. Quantization
Throw out bits
Consider example: 1011012 = 45 (6 bits)
We can truncate this string to 4 bits: 10112 = 11
We can truncate this string to 3 bits: 101 2 = 5 (original value 40) or
1102 = 6 (original value 48)
Uniform quantization is achieved by dividing DCT coefficients
by N and round the result (e.g., above we used N=4 or N=8)
In JPEG use quantization tables
Fq(u,v) = F(u,v)/Quv
Two quantization tables one for luminance and one for two
chrominance components

CS 414 - Spring 2012


De facto Quantization Table
16 11 10 16 24 40 51 61
Eye becomes less sensitive

12 12 14 19 26 58 60 55
14 13 16 24 40 57 69 56
14 17 22 29 51 87 80 62
18 22 37 56 68 109 103 77
24 35 55 64 81 104 113 92
49 64 78 87 103 121 120 101
72 92 95 98 112 100 103 99

Eye becomes less sensitive

CS 414 - Spring 2012


4. Entropy Encoding
Compress sequence of quantized DC and
AC coefficients from quantization step
further increase compression, without loss

Separate DC from AC components


DCcomponents change slowly, thus will be
encoded using difference encoding

CS 414 - Spring 2012


DC Encoding
DC represents average intensity of a block
encode using difference encoding scheme

Because difference tends to be near zero,


can use less bits in the encoding
categorize difference into difference classes
send the index of the difference class, followed
by bits representing the difference

CS 414 - Spring 2012


Difference Coding applied to DC
Coefficients

CS 414 - Spring 2012


AC Encoding
Use zig-zag ordering of coefficients
orders frequency components from low->high
produce maximal series of 0s at the end
Ordering helps to apply efficiently entropy encoding

Apply Huffman coding


Apply RLE on AC zero

values

CS 414 - Spring 2012


Huffman Encoding
Sequence of DC difference indices and values
along with RLE of AC coefficients

Apply Huffman encoding to sequence

Attach appropriate headers

Finally have the JPEG image!

CS 414 - Spring 2012


Interchange Format of JPEG

CS 414 - Spring 2012


Example - One Everyday Photo

2.76M

CS 414 - Spring 2012


Example - One Everyday Photo

600K

CS 414 - Spring 2012


Example - One Everyday Photo

350K

CS 414 - Spring 2012


Example - One Everyday Photo

240K

CS 414 - Spring 2012


Example - One Everyday Photo

144K

CS 414 - Spring 2012


Example - One Everyday Photo

88K

CS 414 - Spring 2012


Discussion
What types of image content would JPEG
work best (worst) for?

Is image compression solved?

Whats missing from JPEG?

CS 414 - Spring 2012

You might also like