Course Website: http://www.comp.dit.

ie/bmacnamee
Digital Image Processing

Image Enhancement
(Spatial Filtering 2)
2
of
30
Contents
In this lecture we will look at more spatial
filtering techniques
Spatial filtering refresher
Sharpening filters
1
st
derivative filters
2
nd
derivative filters
Combining filtering techniques
3
of
30
Spatial Filtering Refresher
r s t
u v w
x y z
Origin x
y
I mage f (x, y)
e
processed
= v*e +
r*a + s*b + t*c +
u*d + w*f +
x*g + y*h + z*i
Filter
Simple 3*3
Neighbourhood
e 3*3 Filter
a b c
d e f
g h i
Original Image
Pixels
*
The above is repeated for every pixel in the
original image to generate the smoothed image
4
of
30
Sharpening Spatial Filters
Previously we have looked at smoothing
filters which remove fine detail
Sharpening spatial filters seek to highlight
fine detail
Remove blurring from images
Highlight edges
Sharpening filters are based on spatial
differentiation
5
of
30
Spatial Differentiation
Differentiation measures the rate of change of
a function
Lets consider a simple 1 dimensional
example
I
m
a
g
e
s

t
a
k
e
n

f
r
o
m

G
o
n
z
a
l
e
z

&

W
o
o
d
s
,

D
i
g
i
t
a
l

I
m
a
g
e

P
r
o
c
e
s
s
i
n
g

(
2
0
0
2
)

6
of
30
Spatial Differentiation
I
m
a
g
e
s

t
a
k
e
n

f
r
o
m

G
o
n
z
a
l
e
z

&

W
o
o
d
s
,

D
i
g
i
t
a
l

I
m
a
g
e

P
r
o
c
e
s
s
i
n
g

(
2
0
0
2
)

A B
7
of
30
1
st
Derivative
The formula for the 1
st
derivative of a
function is as follows:


Its just the difference between subsequent
values and measures the rate of change of
the function

) ( ) 1 ( x f x f
x
f
+ =
c
c
8
of
30
1
st
Derivative (cont)
Image Strip
0
1
2
3
4
5
6
7
8
1st Derivative
-8
-6
-4
-2
0
2
4
6
8
5 5 4 3 2 1 0 0 0 6 0 0 0 0 1 3 1 0 0 0 0 7 7 7 7
0 -1 -1 -1 -1 0 0 6 -6 0 0 0 1 2 -2 -1 0 0 0 7 0 0 0
9
of
30
2
nd
Derivative
The formula for the 2
nd
derivative of a
function is as follows:


Simply takes into account the values both
before and after the current value

) ( 2 ) 1 ( ) 1 (
2
2
x f x f x f
x
f
+ + =
c
c
10
of
30
2
nd
Derivative (cont)
Image Strip
0
1
2
3
4
5
6
7
8
5 5 4 3 2 1 0 0 0 6 0 0 0 0 1 3 1 0 0 0 0 7 7 7 7
2nd Derivative
-15
-10
-5
0
5
10
-1 0 0 0 0 1 0 6
-12
6 0 0 1 1 -4 1 1 0 0 7 -7 0 0
11
of
30
Using Second Derivatives For Image
Enhancement
The 2
nd
derivative is more useful for image
enhancement than the 1
st
derivative
Stronger response to fine detail
Simpler implementation
We will come back to the 1
st
order derivative
later on
The first sharpening filter we will look at is
the Laplacian
Isotropic
One of the simplest sharpening filters
We will look at a digital implementation
12
of
30
The Laplacian
The Laplacian is defined as follows:


where the partial 1
st
order derivative in the x
direction is defined as follows:


and in the y direction as follows:
y
f
x
f
f
2
2
2
2
2
c
c
+
c
c
= V
) , ( 2 ) , 1 ( ) , 1 (
2
2
y x f y x f y x f
x
f
+ + =
c
c
) , ( 2 ) 1 , ( ) 1 , (
2
2
y x f y x f y x f
y
f
+ + =
c
c
13
of
30
The Laplacian (cont)
So, the Laplacian can be given as follows:



We can easily build a filter based on this
) , 1 ( ) , 1 ( [
2
y x f y x f f + + = V
)] 1 , ( ) 1 , ( + + + y x f y x f
) , ( 4 y x f
0 1 0
1 -4 1
0 1 0
14
of
30
The Laplacian (cont)
Applying the Laplacian to an image we get a
new image that highlights edges and other
discontinuities
I
m
a
g
e
s

t
a
k
e
n

f
r
o
m

G
o
n
z
a
l
e
z

&

W
o
o
d
s
,

D
i
g
i
t
a
l

I
m
a
g
e

P
r
o
c
e
s
s
i
n
g

(
2
0
0
2
)

Original
Image
Laplacian
Filtered Image
Laplacian
Filtered Image
Scaled for Display
15
of
30
But That Is Not Very Enhanced!
The result of a Laplacian filtering
is not an enhanced image
We have to do more work in
order to get our final image
Subtract the Laplacian result
from the original image to
generate our final sharpened
enhanced image
Laplacian
Filtered Image
Scaled for Display
I
m
a
g
e
s

t
a
k
e
n

f
r
o
m

G
o
n
z
a
l
e
z

&

W
o
o
d
s
,

D
i
g
i
t
a
l

I
m
a
g
e

P
r
o
c
e
s
s
i
n
g

(
2
0
0
2
)

f y x f y x g
2
) , ( ) , ( V =
16
of
30
Laplacian Image Enhancement
In the final sharpened image edges and fine
detail are much more obvious
I
m
a
g
e
s

t
a
k
e
n

f
r
o
m

G
o
n
z
a
l
e
z

&

W
o
o
d
s
,

D
i
g
i
t
a
l

I
m
a
g
e

P
r
o
c
e
s
s
i
n
g

(
2
0
0
2
)

-
=
Original
Image
Laplacian
Filtered Image
Sharpened
Image
17
of
30
Laplacian Image Enhancement
I
m
a
g
e
s

t
a
k
e
n

f
r
o
m

G
o
n
z
a
l
e
z

&

W
o
o
d
s
,

D
i
g
i
t
a
l

I
m
a
g
e

P
r
o
c
e
s
s
i
n
g

(
2
0
0
2
)

18
of
30
Simplified Image Enhancement
The entire enhancement can be combined
into a single filtering operation
) , 1 ( ) , 1 ( [ ) , ( y x f y x f y x f + + =
) 1 , ( ) 1 , ( + + + y x f y x f
)] , ( 4 y x f
f y x f y x g
2
) , ( ) , ( V =
) , 1 ( ) , 1 ( ) , ( 5 y x f y x f y x f + =
) 1 , ( ) 1 , ( + y x f y x f
19
of
30
Simplified Image Enhancement (cont)
This gives us a new filter which does the
whole job for us in one step
0 -1 0
-1 5 -1
0 -1 0
I
m
a
g
e
s

t
a
k
e
n

f
r
o
m

G
o
n
z
a
l
e
z

&

W
o
o
d
s
,

D
i
g
i
t
a
l

I
m
a
g
e

P
r
o
c
e
s
s
i
n
g

(
2
0
0
2
)

20
of
30
Simplified Image Enhancement (cont)
I
m
a
g
e
s

t
a
k
e
n

f
r
o
m

G
o
n
z
a
l
e
z

&

W
o
o
d
s
,

D
i
g
i
t
a
l

I
m
a
g
e

P
r
o
c
e
s
s
i
n
g

(
2
0
0
2
)

21
of
30
Variants On The Simple Laplacian
There are lots of slightly different versions of
the Laplacian that can be used:
0 1 0
1 -4 1
0 1 0
1 1 1
1 -8 1
1 1 1
-1 -1 -1
-1 9 -1
-1 -1 -1
Simple
Laplacian
Variant of
Laplacian
I
m
a
g
e
s

t
a
k
e
n

f
r
o
m

G
o
n
z
a
l
e
z

&

W
o
o
d
s
,

D
i
g
i
t
a
l

I
m
a
g
e

P
r
o
c
e
s
s
i
n
g

(
2
0
0
2
)

22
of
30
Simple Convolution Tool In Java
A great tool for testing out different filters
From the book Image Processing tools in
Java
Available from webCT later on today
To launch: java ConvolutionTool Moon.jpg
23
of
30
1
st
Derivative Filtering
Implementing 1
st
derivative filters is difficult in
practice
For a function f(x, y) the gradient of f at
coordinates (x, y) is given as the column
vector:
(
(
(
(

c
c
c
c
=
(

= V
y
f
x
f
G
G
y
x
f
24
of
30
1
st
Derivative Filtering (cont)
The magnitude of this vector is given by:





For practical reasons this can be simplified as:

) f (V = V mag f
| |
2
1
2 2
y x
G G + =
2
1
2
2
(
(

|
|
.
|

\
|
c
c
+
|
.
|

\
|
c
c
=
y
f
x
f
y x
G G f + ~ V
25
of
30
1
st
Derivative Filtering (cont)
There is some debate as to how best to
calculate these gradients but we will use:


which is based on these coordinates

( ) ( )
3 2 1 9 8 7
2 2 z z z z z z f + + + + ~ V
( ) ( )
7 4 1 9 6 3
2 2 z z z z z z + + + + +
z
1
z
2
z
3
z
4
z
5
z
6
z
7
z
8
z
9
26
of
30
Sobel Operators
Based on the previous equations we can
derive the Sobel Operators




To filter an image it is filtered using both
operators the results of which are added
together
-1 -2 -1
0 0 0
1 2 1
-1 0 1
-2 0 2
-1 0 1
27
of
30
Sobel Example





Sobel filters are typically used for edge
detection
I
m
a
g
e
s

t
a
k
e
n

f
r
o
m

G
o
n
z
a
l
e
z

&

W
o
o
d
s
,

D
i
g
i
t
a
l

I
m
a
g
e

P
r
o
c
e
s
s
i
n
g

(
2
0
0
2
)

An image of a
contact lens which
is enhanced in
order to make
defects (at four
and five oclock in
the image) more
obvious
28
of
30
1
st
& 2
nd
Derivatives
Comparing the 1
st
and 2
nd
derivatives we
can conclude the following:
1
st
order derivatives generally produce thicker
edges
2
nd
order derivatives have a stronger
response to fine detail e.g. thin lines
1
st
order derivatives have stronger response
to grey level step
2
nd
order derivatives produce a double
response at step changes in grey level
29
of
30
Summary
In this lecture we looked at:
Sharpening filters
1
st
derivative filters
2
nd
derivative filters
Combining filtering techniques
30
of
30
Combining Spatial Enhancement
Methods
Successful image
enhancement is typically not
achieved using a single
operation
Rather we combine a range
of techniques in order to
achieve a final result
This example will focus on
enhancing the bone scan to
the right
I
m
a
g
e
s

t
a
k
e
n

f
r
o
m

G
o
n
z
a
l
e
z

&

W
o
o
d
s
,

D
i
g
i
t
a
l

I
m
a
g
e

P
r
o
c
e
s
s
i
n
g

(
2
0
0
2
)

31
of
30
Combining Spatial Enhancement
Methods (cont)
I
m
a
g
e
s

t
a
k
e
n

f
r
o
m

G
o
n
z
a
l
e
z

&

W
o
o
d
s
,

D
i
g
i
t
a
l

I
m
a
g
e

P
r
o
c
e
s
s
i
n
g

(
2
0
0
2
)

Laplacian filter of
bone scan (a)
Sharpened version of
bone scan achieved
by subtracting (a)
and (b) Sobel filter of bone
scan (a)
(a)
(b)
(c)
(d)
32
of
30
Combining Spatial Enhancement
Methods (cont)
I
m
a
g
e
s

t
a
k
e
n

f
r
o
m

G
o
n
z
a
l
e
z

&

W
o
o
d
s
,

D
i
g
i
t
a
l

I
m
a
g
e

P
r
o
c
e
s
s
i
n
g

(
2
0
0
2
)

The product of (c)
and (e) which will be
used as a mask
Sharpened image
which is sum of (a)
and (f)
Result of applying a
power-law trans. to
(g)
(e)
(f)
(g)
(h)
Image (d) smoothed with
a 5*5 averaging filter
33
of
30
Combining Spatial Enhancement
Methods (cont)
Compare the original and final images
I
m
a
g
e
s

t
a
k
e
n

f
r
o
m

G
o
n
z
a
l
e
z

&

W
o
o
d
s
,

D
i
g
i
t
a
l

I
m
a
g
e

P
r
o
c
e
s
s
i
n
g

(
2
0
0
2
)