Structure of Eye
Structure of Eye
Image
Digital Image Fundamentals
• Human visual system
• A simple image model
• Sampling and quantization
• Color models and Color imaging
2
Why to study Human Visual System
5
Structure of Human Eye
The lens and the ciliary muscle focus the reflected lights from
objects into the retina to form an image of the objects.
Elements of visual perception
7
Human Eye Structure
17
• Principal difference b/w the lens of the eye & an ordinary
optical lens is that the former is flexible
• Radius of the curvature the anterion surface its postirior
surface
• Shape is controlled by tension in the fibles of the ciliary
body
• Focus on distinct objects, the controlling muscles cause
the lens to be relatively flattened
• These muscles allow the lens to become thicker in order to
focus on objects near the eye
Image Formation in the Human Eye
log (cd/m2)
20
Brightness Adaptation & Discrimination
• The human visual system can perceive (the ability to see, hear,
or become aware of something through the senses)
approximately 1010 different light intensity levels
• However, at any one time we can only discriminate between a
much smaller number brightness adaptation
• The ability of the eye to discriminate between changes in light
intensity at any specific brightness adaptation level is
governed by Weber s la which states that the just
noticeable difference ΔI is proportional to the background
luminance I
• Similarly, the perceived intensity of a region is related to the
light intensities of the regions surrounding it
Human Visual System
• Brightness adaptation
22
Brightness adaptation
• Simutaneous range is smaller than Total adaptation range
24
Brightness adaptation
For a given
observation
Sensitivity of the HVS
condition, the
for the given current sensitivity
adaptation level level is call the
brightness
Anything below Bb will adaptation level
be perceived as
indistinguishable
blacks •The range of brightness that
the eye can adapt to is
enormous, roughly around
1010 to 1.
•Photopic vision alone has a
range of around 106 to 1.
•Brightness adaptation:
example Ba”
•mL: millilambert
25
Brightness Adaptation and Discrimination
27
Brightness Adaptation and Discrimination
Position
Perceived Brightness
• Perceived brightness is not a simple function of
intensity Mach band pattern
31
Mach Band Effect (Cont)
A
B
Intensity
Position
In area A, brightness perceived is darker while in area B is
brighter. This phenomenon is called Mach Band Effect.
Brightness Adaptation of Human Eye :
Simultaneous Contrast
34
Optical Illusions
Examples for Human Perception Phenomena
Examples for
Human
Perception
Phenomena
Light And The Electromagnetic Spectrum
38
A simple image model
• l(x,y) - illumination range
log (cd/m2)
• r(x,y) – typical reflectance indixes
black velvet (0.01)
stainless steel (0.65)
white paint (0.80)
silver plate (0.90)
snow (0.93)
39
Image Sensing and Acquisition
Gate
Photosites
Vertical Transport Register
Device
Gate
Horizontal Transportation Register
i h g Image pixel
f e d
c b a
i h g
f e d
i h g
Horizontal transport
register c b a
f e d
Horizontal shift
Image Acquisition
Nowadays most visible and near IR electromagnetic imaging
is done with 2-dimensional charged-coupled devices (CCDs).
47
A Simple Image Formation Model
f(x,y)=i(x,y)*r(x,y) Reflectivity
f(x,y)=i(x,y)*t(x,y) Transmissivity
i(x,y) - illumination component
0< i(x,y) < r(x,y) – reflectance component
H.R. Pourreza
Image Sampling and Quantization
f ( N 1,0) f ( N 1,1) f ( N 1, M 1)
53
Quantization
• Digitization of the light intensity function
54
Image Acquisition
55
Sampling and Quantization
56
Sampling and Quantization
• How many samples to take?
57
How to choose the spatial resolution
Spatial resolution = Sampling locations
Original image
Sampled image
59
Definition of Aliasing
• Aliasing refers to the effect produced when a signal is imperfectly reconstructed
from the original signal.
• Aliasing occurs when a signal is not sampled at a high enough frequency to
create an accurate representation. This effect is shown in the following example
of a sinusoidal function:
• In this example, the dots represent the sampled data and the curve represents
the original signal. Because there are too few sampled data points, the resulting
pattern produced by the sampled data is a poor representation of the original.
Aliasing is relevant in fields associated with signal processing, such as digital audio,
digital photography, and computer graphics.
Aliasing(mixing of two different signals)
• Spatial aliasing in the form of a Moiré pattern.
• In signal processing and related disciplines, aliasing refers to an effect that
causes different signals to become indistinguishable (or aliases of one
another) when sampled. It also refers to the distortion or artifact that
results when the signal reconstructed from samples is different from the
original continuous signal.
• Aliasing can occur in signals sampled in time, for instance digital audio is
referred to as temporal aliasing. Aliasing can also occur in spatially
sampled signals, for instance digital images. Aliasing in spatially sampled
signals is called spatial aliasing.
Properly sampled image of brick wall. Spatial aliasing in the form of a Moiré pattern.
Sampling and Quantization
• How many samples to take?
62
How to choose the spatial resolution :
Nyquist Rate
Original image
Sampled image
1mm
2mm
No detail is lost!
Minimum Nyquist Rate:
Spatial resolution
Period Spatial resolution must be less or equal
(sampling rate)
half of the minimum period of the image
or sampling frequency must be greater or
= Sampling locations
Equal twice of the maximum frequency.
Aliased Frequency
x1 (t ) sin( 2 t ), f 1
1 x2 (t ) sin(12 t ), f 6
0.5
-0.5
-1
0 0.5 1 1.5 2
Sampling rate:
5 samples/sec
1
0.5
-0.5
-1
0 0.5 1 1.5 2
65
Effect of Spatial Resolution
Image quantization:
discretize continuous pixel values into discrete numbers
b
Nc 2
where b = no. of bits
Quantization function
Nc-1
Nc-2
Quantization level
1
0
Light intensity
Darkest Brightest
Effect of Quantization Levels
64 levels 32 levels
Effect of Quantization Levels (cont.)
16 levels 8 levels
In this image,
it is easy to see
false contour.
4 levels 2 levels
How to select the suitable size and pixel depth of images
(0,0) x
(x,y-1) 4-neighbors of p:
(x 1,y)
(x-1,y) p (x+1,y)
(x+1,y)
N4(p) = (x,y 1)
(x,y+1)
(x,y+1)
(x 1,y 1)
(x-1,y) p (x+1,y)
(x,y 1)
(x+1,y 1)
(x 1,y)
(x-1,y+1) (x,y+1) (x+1,y+1) (x+1,y)
N8(p) = (x 1,y+1)
(x,y+1)
(x+1,y+1)
(x 1,y 1)
p
(x+1,y 1)
ND(p) = (x 1,y+1)
(x+1,y+1)
(x-1,y+1) (x+1,y+1)
O O O O O O
O X O X O X O
O O O O O O
Some Basic Relationships Between
Pixels
• Path:
The length of the path
Closed path
• Connectivity in a subset S of an image
Two pixels are connected if there is a path between them that lies
completely within S.
• Connected component of S:
The set of all pixels in S that are connected to a given pixel in S.
• Region of an image
• Boundary, border or contour of a region
• Edge: a path of one or more pixels that separate two regions
of significantly different gray levels.
Connectivity
Connectivity is adapted from neighborhood relation.
Two pixels are connected if they are in the same class (i.e. the
same color or the same range of intensity) and they are
neighbors of one another.
S1
S2
q
p
p p p
q q q
m-path from p to q
8-path from p to q
solves this ambiguity
results in some ambiguity
Some Basic Relationships Between Pixels
• An example of adjacency:
Some Basic Relationships Between
Pixels
• Adjacency:
Two pixels that are neighbors and have the same grey-
level (or some other specified similarity criterion) are
adjacent
Pixels can be 4-adjacent, diagonally adjacent, 8-adjacent,
or m-adjacent.
• m-adjacency (mixed adjacency):
Two pixels p and q of the same value (or specified
similarity) are m-adjacent if either
• (i) q and p are 4-adjacent, or
• (ii) p and q are diagonally adjacent and do not have any common
4-adjacent neighbors.
• They cannot be both (i) and (ii).
Distance
For pixel p, q, and z with coordinates (x,y), (s,t) and (u,v),
D is a distance function or metric if
w D(p,q) = D(q,p)
De ( p, q) ( x s )2 + ( y t )2
Distance (cont.)
D4-distance (city-block distance or Manhattan) is defined as
D4 ( p, q) x s+y t
2 1 2
2 1 0 1 2
2 1 2
D8 ( p, q) max( x s , y t )
2 2 2 2 2
2 1 1 1 2
2 1 0 1 2
2 1 1 1 2
2 2 2 2 2
Nearest neighbor
Interpolation
(Pixel replication)
Bilinear
interpolation
Face Recognition
Face Expression
A
B
C
D
E
Hidden
Layer Output
Layer
Input
Layer
102
MRI Image
Signature recognition
104
• Image formation
105
Re l f Image ce ing
• Image processing theory and practices
How ?
Theory
Practice
107