SlideShare a Scribd company logo
Issues in Image Registration –
multimodal image acquisition &
image super‐resolution.
DARSHANA MISTRY
SUPERVISOR:- DR. ASIM BANERJEE-DAIICT
CO-SUPTERVISOR:- DR. SHISHIR SHAH,
UNIVERSITY OF HOUSTON
DPC:- DR ADITYA TATU-DAIICT
DR TANISH ZAVERI- NIT, NU
Outline
 Introduction of Image Registration(IR)
 Issues of Image Registration
 Steps for Image Registration
 Review Comments on DPC-2
 Affine Transformation
 Entropy
 Mutual Information
Introduction
 Image

Registration:-It
is a process of overlying
of two or more images
of the same scene taken
at
different
times,
different
viewpoints
and/or
different
sensors.

Fig. 1. Image Registration
Issues of Image Registration
 Multimodal Registration
 Registration of images of the same scene acquired from
different sensors.
 Viewpoint Registration
 Registration of images taken from different viewpoints.
 Temporal Registration
 Registration of images of same scene taken at different times
or under different conditions
Steps of Image Registration
 B. Zitova, J. Flusser[1] introduced basic 4 steps

of image registration.


Fig. 2. Four steps of Image Registration (Top row: feature detection, middle row: feature
matching, model estimation, bottom right: image resampling and transformation
Previous Review Comments on
DPC-2 (21-Dec. 12)
 Implement affine transformation and use mutual

information and plots its variations.
 Identify standard image databases that will be used
for future work.
 Identify recent registration approaches reported in
literature for future exploration during the next
review period.
Affine Transformation[1/4]
 The affine transformation parameters can be

calculated by coordinates of control points, and then
geometrically transformation may be conducted for
registered image.
Affine Transformation[2/4]

(a)

(b)
Fig. 3. (a) Transform of
an image (b) Rotate of
an image, (c) Scaling of
an image

(c)
Affine Transformation[3/4]

(a)

(b)
 Fig. 4. (a) Transform of an

image (b) Rotate of an image,
(c) Scaling of an image

(c)
Affine Transformation[4/4]

Fig. 5. Affine Transformation of an image
Entropy[1/7]
A

key measure of information is known as
entropy[2], which is usually expressed by average
amount of information received when the value of
random value X is observed (the average number of
bits needed to store or communicate one symbol in a
message).
 Shannon introduced an adopted measure in 1948,
which weights the information per outcome by the
probability of that outcome occurring. Given events
occurring with probabilities
the Shannon entropy is defined as,
Entropy[2/7]
 The units for entropy are “nats” when the natural

logarithm is used and “bits" for base 2 logarithms.
 When all messages are equally likely to occur, the
entropy is maximal, because you are completely
uncertain which message you will receive.
 When one of the messages has a much higher chance of
being sent than the other messages, the uncertainty
decreases.
 The amount of information for the individual messages
that have a small chance of occurring is high, but an
average, the information (entropy/ uncertainty ) is lower.
Entropy[3/7]
14

 Example:1.
Mummy-0.35, daddy-0.2, cat-0.2, cow-0.25
The entropy of child’s language-0.35 log(0.35)-0.2 log(0.2)-0.2 log(0.2)- 0.25
log(0.25)=1.96
Mummy- 0.05, daddy-0.05, cat- 0.02, train-0.02, car0.02, cookie-0.02, telly-0.02, no-0.8
The entropy of child’s language- 1.25
2.
Entropy[4/7]
15

 Base on the distribution of the grey values of the

image[4], a probability distribution of grey values can be
estimated by counting the number of times each grey
value occurs in the image and dividing those numbers by
the total number of occurrences.

 A single intensity of image will have a low entropy; it

contains very little information.
 A high entropy value will be yielded by an image with
more or less equal quantities of many different
intensities, which is an image containing a lot of
information.
Entropy[5/7]
Entropy[6/7]
Entropy[7/7]
18

 Entropy has three interpretations:
1.
The amount of information an event(message, grey value of a
point) gives when it takes place,
2.
The uncertainty about the outcome of an event, and
3.
The dispersion of the probabilities with which the events
take place.
Mutual Information[1/3]
 Mutual

Information
(transformation)[1]
measures the amount of information that can be
obtained about one random variable by observing
another.
 It is important in communication where it can be
used to maximize the amount of information shared
between sent and received signals.
 A basic property of the mutual information is that



I(X;Y) = H(X) - H(X|Y)
Mutual information is the amount by which the uncertainty
about Y decrease when X is given: the amount of information
X contains about Y.
Mutual Information[2/3]
20

 The second form of mutual information is most

closely related to joint entropy.


I(X:Y) = H(X) + H(Y) – H(X,Y)

 -H(X,Y) means that maximizing mutual information

is related to minimizing joint entropy.
 The advantage of mutual information over joint
entropy per se, is that it includes the entropies of the
separate images.
Mutual Information[3/3]
21

 The final form of mutual information is based on Kullback-

Leibler distance[KLD][2]

 Where SI (Specific mutual Information) is the point wise

mutual information.
 The interpretation of this form is that it measures the distance
between the joint distribution of the images’ grey values p(x,
y) and the joint distribution in case of independence of the
images, p(x)p(y).
 It is measure of dependence between two images.
 If the testing images are well registered, then the value of KLD
becomes small or is equal to zero[17].
Issues in Image Registration and Image similarity based on mutual information
Issues in Image Registration and Image similarity based on mutual information
Issues in Image Registration and Image similarity based on mutual information
Issues in Image Registration and Image similarity based on mutual information
Issues in Image Registration and Image similarity based on mutual information
Issues in Image Registration and Image similarity based on mutual information
 Tools:
 OpenCV(open source computer vision)2.3/2.4.2
 Microsoft Visual Studio 2008/2010 express
 cMake(cross platform make) 2.8
Data Set

512 X 512 CT and MRI images
a

b

c

d

e

f
Conclusion
 Image similarity is find based on entropy and mutual

information.
 The entropy of an image is a measure of the amount
of uncertainty with gray values.
 Mutual information measures the amount of
information, one image that can be obtained about
one random variable by observing another.
 Entropy value is high image similarity is less. Mutual
information is maximum then image similarity is
high.
References
1.
2.

3.
4.

5.
6.

7.

B.Zitova,J.Flusser,“ Image Registration methods :A survey”, Image and
vision computing, vol.21-no.-11,pp977-1000,2003.
J. P.W.Pluim, J.B. A. Maintz, and M. A. Viergever, “Mutual Information
based registration of medical images: a survey”, IEEE Transactions on
Medical Images, Vol.-XX, Issues-Y, 2003.
R. M. Gray, “Entropy and Information Theory”, Springr-Verlag, New
York, 2009.
F. P. M. Oliveira, J. M. R. S. Tavares , “ Medical Image Registration: a
Review ”, Computer Methods in Biomechanics and Biomedical
Engineering, 2012.
A. Sotiras , C. Davatazikos, N. Paragios, “Deformable Medical Image
Registration: A Survey”, Research Report n° 7919 September 2012.
M.V.Sruthi1, K.Soundararajan, V.Usha Sree , “ Accurate Multimodality
Registration of medical images”, Accurate Multimodality Registration of
medical images , Volume 1, Issue 3 , PP.33-36 , June 2012 .
Q. Xie, S. Kurtek, G. Christensen, Z. Ding, E. Klassen,A. Srivastava, “A
Novel Framework for Metric-Based Image Registration”, WBIR2012
8.

9.
10.

11.

12.

13.
14.

M.V.Wyavahare, P.M.Patil, H.K.Abhyankar,“Image Registration Techniques: An
overview”, International Journal of Signal Processing, Image Processing, and
PatternReorganization,Vol.2,No.3,2009.
J.B.A.Maintz, A.Viegever, “A Survey of Medical Image Registration”, Medical
Image Analysis”,Vol.2,No.1,pp(1-37),1998.
G.Junbin,G.Xiaosong,W.Wei;P.Pengcheng, “Geometric Global Registration of
Parallax Images Based on Wavelet Transform”, International Conference of
Electronic Measurement and Instruments, pp 2862-2865,2007.
Gang Hong; Yun Zhang, “Combination of feature based and area based image
registration technique for high resolution remote sensing image”, International
Conference on Geo science and Remote Sensing Symposium, pp 377-380, 2007
Malviya A.; Bhirud,S.G., “Wavelet based image registration using mutual
information”, International Conferenceon Emerging Trendsin Electronic and
Photonic Devices and Systems (ELECTRO‟09),245-244,2009.
HongG.,ZhangY;“Wavelet based image registration technique for high resolution
remote sensing image”, Journal of Compute Science and Geosciences 2006.
Hui Lin; Peijun Du; Weichang Zhao; Lianpeng Zhang; Huasheng Sun, “Image
Registration based on corner detection and affine transformation”, International
conference on Image and Signal Processing (CISP), pp2184-2188,2010.
Y. Yamamura,;H. Kim;J. Tan; S. Yamamura,; Yamamoto, “A method
for reducing of computational time on image registration employing
wavelet transformation”, International conference on Control
Automation and Systems (ICCAS), pp 1286-1291,2007.
16. Y. Pei; H. Wu; J. Yu; G. Cai, “Effective Image Registration based on
Improved Harris Corner Detection”, International Conference on
Information Networking an Automation (ICINA), V193-V196,2010.
17. R. Gan, J. Wu, A. C.S. Chung, S.C.H. Yu,W.M. Wells, Multiresolution
Image Registration Based on Kullback-Leibler Distance”, 7th
International Conference on Medical Image Computing and
Computer Assisted Intervention (MICCAI’04, 2004.
15.
Ad

Recommended

A METHODICAL WAY OF IMAGE REGISTRATION IN DIGITAL IMAGE PROCESSING
A METHODICAL WAY OF IMAGE REGISTRATION IN DIGITAL IMAGE PROCESSING
International Journal of Technical Research & Application
 
Image Registration
Image Registration
Angu Ramesh
 
Medical Image Fusion Using Discrete Wavelet Transform
Medical Image Fusion Using Discrete Wavelet Transform
IJERA Editor
 
Wavelet Transform based Medical Image Fusion With different fusion methods
Wavelet Transform based Medical Image Fusion With different fusion methods
IJERA Editor
 
Dd25624627
Dd25624627
IJERA Editor
 
Comparison of Segmentation Algorithms and Estimation of Optimal Segmentation ...
Comparison of Segmentation Algorithms and Estimation of Optimal Segmentation ...
Pinaki Ranjan Sarkar
 
Image Fusion and Image Quality Assessment of Fused Images
Image Fusion and Image Quality Assessment of Fused Images
CSCJournals
 
Comparative analysis of multimodal medical image fusion using pca and wavelet...
Comparative analysis of multimodal medical image fusion using pca and wavelet...
IJLT EMAS
 
Q0460398103
Q0460398103
IJERA Editor
 
www.ijerd.com
www.ijerd.com
IJERD Editor
 
Mutual Information for Registration of Monomodal Brain Images using Modified ...
Mutual Information for Registration of Monomodal Brain Images using Modified ...
IDES Editor
 
Ijarcet vol-2-issue-3-1280-1284
Ijarcet vol-2-issue-3-1280-1284
Editor IJARCET
 
ADOPTING AND IMPLEMENTATION OF SELF ORGANIZING FEATURE MAP FOR IMAGE FUSION
ADOPTING AND IMPLEMENTATION OF SELF ORGANIZING FEATURE MAP FOR IMAGE FUSION
ijistjournal
 
Report medical image processing image slice interpolation and noise removal i...
Report medical image processing image slice interpolation and noise removal i...
Shashank
 
COLOUR BASED IMAGE SEGMENTATION USING HYBRID KMEANS WITH WATERSHED SEGMENTATION
COLOUR BASED IMAGE SEGMENTATION USING HYBRID KMEANS WITH WATERSHED SEGMENTATION
IAEME Publication
 
International Journal of Engineering Research and Development
International Journal of Engineering Research and Development
IJERD Editor
 
Dh33653657
Dh33653657
IJERA Editor
 
Object-Oriented Approach of Information Extraction from High Resolution Satel...
Object-Oriented Approach of Information Extraction from High Resolution Satel...
iosrjce
 
A Dualistic Sub-Image Histogram Equalization Based Enhancement and Segmentati...
A Dualistic Sub-Image Histogram Equalization Based Enhancement and Segmentati...
inventy
 
Survey on Brain MRI Segmentation Techniques
Survey on Brain MRI Segmentation Techniques
Editor IJMTER
 
Multimodality medical image fusion using improved contourlet transformation
Multimodality medical image fusion using improved contourlet transformation
IAEME Publication
 
An ensemble classification algorithm for hyperspectral images
An ensemble classification algorithm for hyperspectral images
sipij
 
OBJECT SEGMENTATION USING MULTISCALE MORPHOLOGICAL OPERATIONS
OBJECT SEGMENTATION USING MULTISCALE MORPHOLOGICAL OPERATIONS
ijcseit
 
Ch4201557563
Ch4201557563
IJERA Editor
 
ADOPTING AND IMPLEMENTATION OF SELF ORGANIZING FEATURE MAP FOR IMAGE FUSION
ADOPTING AND IMPLEMENTATION OF SELF ORGANIZING FEATURE MAP FOR IMAGE FUSION
ijistjournal
 
Biomedical Image Retrieval using LBWP
Biomedical Image Retrieval using LBWP
IRJET Journal
 
Lecture 06 geometric transformations and image registration
Lecture 06 geometric transformations and image registration
obertksg
 
Image Fusion
Image Fusion
Vijaykumar Kulkarni
 
Fast Mesh-Based Medical Image Registration
Fast Mesh-Based Medical Image Registration
Ahmadreza Baghaie
 
Improper Rotation
Improper Rotation
SCIENCE Pakistan
 

More Related Content

What's hot (18)

Q0460398103
Q0460398103
IJERA Editor
 
www.ijerd.com
www.ijerd.com
IJERD Editor
 
Mutual Information for Registration of Monomodal Brain Images using Modified ...
Mutual Information for Registration of Monomodal Brain Images using Modified ...
IDES Editor
 
Ijarcet vol-2-issue-3-1280-1284
Ijarcet vol-2-issue-3-1280-1284
Editor IJARCET
 
ADOPTING AND IMPLEMENTATION OF SELF ORGANIZING FEATURE MAP FOR IMAGE FUSION
ADOPTING AND IMPLEMENTATION OF SELF ORGANIZING FEATURE MAP FOR IMAGE FUSION
ijistjournal
 
Report medical image processing image slice interpolation and noise removal i...
Report medical image processing image slice interpolation and noise removal i...
Shashank
 
COLOUR BASED IMAGE SEGMENTATION USING HYBRID KMEANS WITH WATERSHED SEGMENTATION
COLOUR BASED IMAGE SEGMENTATION USING HYBRID KMEANS WITH WATERSHED SEGMENTATION
IAEME Publication
 
International Journal of Engineering Research and Development
International Journal of Engineering Research and Development
IJERD Editor
 
Dh33653657
Dh33653657
IJERA Editor
 
Object-Oriented Approach of Information Extraction from High Resolution Satel...
Object-Oriented Approach of Information Extraction from High Resolution Satel...
iosrjce
 
A Dualistic Sub-Image Histogram Equalization Based Enhancement and Segmentati...
A Dualistic Sub-Image Histogram Equalization Based Enhancement and Segmentati...
inventy
 
Survey on Brain MRI Segmentation Techniques
Survey on Brain MRI Segmentation Techniques
Editor IJMTER
 
Multimodality medical image fusion using improved contourlet transformation
Multimodality medical image fusion using improved contourlet transformation
IAEME Publication
 
An ensemble classification algorithm for hyperspectral images
An ensemble classification algorithm for hyperspectral images
sipij
 
OBJECT SEGMENTATION USING MULTISCALE MORPHOLOGICAL OPERATIONS
OBJECT SEGMENTATION USING MULTISCALE MORPHOLOGICAL OPERATIONS
ijcseit
 
Ch4201557563
Ch4201557563
IJERA Editor
 
ADOPTING AND IMPLEMENTATION OF SELF ORGANIZING FEATURE MAP FOR IMAGE FUSION
ADOPTING AND IMPLEMENTATION OF SELF ORGANIZING FEATURE MAP FOR IMAGE FUSION
ijistjournal
 
Biomedical Image Retrieval using LBWP
Biomedical Image Retrieval using LBWP
IRJET Journal
 
Mutual Information for Registration of Monomodal Brain Images using Modified ...
Mutual Information for Registration of Monomodal Brain Images using Modified ...
IDES Editor
 
Ijarcet vol-2-issue-3-1280-1284
Ijarcet vol-2-issue-3-1280-1284
Editor IJARCET
 
ADOPTING AND IMPLEMENTATION OF SELF ORGANIZING FEATURE MAP FOR IMAGE FUSION
ADOPTING AND IMPLEMENTATION OF SELF ORGANIZING FEATURE MAP FOR IMAGE FUSION
ijistjournal
 
Report medical image processing image slice interpolation and noise removal i...
Report medical image processing image slice interpolation and noise removal i...
Shashank
 
COLOUR BASED IMAGE SEGMENTATION USING HYBRID KMEANS WITH WATERSHED SEGMENTATION
COLOUR BASED IMAGE SEGMENTATION USING HYBRID KMEANS WITH WATERSHED SEGMENTATION
IAEME Publication
 
International Journal of Engineering Research and Development
International Journal of Engineering Research and Development
IJERD Editor
 
Object-Oriented Approach of Information Extraction from High Resolution Satel...
Object-Oriented Approach of Information Extraction from High Resolution Satel...
iosrjce
 
A Dualistic Sub-Image Histogram Equalization Based Enhancement and Segmentati...
A Dualistic Sub-Image Histogram Equalization Based Enhancement and Segmentati...
inventy
 
Survey on Brain MRI Segmentation Techniques
Survey on Brain MRI Segmentation Techniques
Editor IJMTER
 
Multimodality medical image fusion using improved contourlet transformation
Multimodality medical image fusion using improved contourlet transformation
IAEME Publication
 
An ensemble classification algorithm for hyperspectral images
An ensemble classification algorithm for hyperspectral images
sipij
 
OBJECT SEGMENTATION USING MULTISCALE MORPHOLOGICAL OPERATIONS
OBJECT SEGMENTATION USING MULTISCALE MORPHOLOGICAL OPERATIONS
ijcseit
 
ADOPTING AND IMPLEMENTATION OF SELF ORGANIZING FEATURE MAP FOR IMAGE FUSION
ADOPTING AND IMPLEMENTATION OF SELF ORGANIZING FEATURE MAP FOR IMAGE FUSION
ijistjournal
 
Biomedical Image Retrieval using LBWP
Biomedical Image Retrieval using LBWP
IRJET Journal
 

Viewers also liked (19)

Lecture 06 geometric transformations and image registration
Lecture 06 geometric transformations and image registration
obertksg
 
Image Fusion
Image Fusion
Vijaykumar Kulkarni
 
Fast Mesh-Based Medical Image Registration
Fast Mesh-Based Medical Image Registration
Ahmadreza Baghaie
 
Improper Rotation
Improper Rotation
SCIENCE Pakistan
 
Multi modality medical image registration
Multi modality medical image registration
Habib Baluwala
 
Thesis, Image Registration Methods
Thesis, Image Registration Methods
balanou
 
ITK Tutorial Presentation Slides-947
ITK Tutorial Presentation Slides-947
Kitware Kitware
 
Chapter2
Chapter2
Mukti Gupta
 
4.intensity transformations
4.intensity transformations
Yahya Alkhaldi
 
Fuzzy c-means clustering for image segmentation
Fuzzy c-means clustering for image segmentation
Dharmesh Patel
 
Hearn and Baker 2 D transformations
Hearn and Baker 2 D transformations
Taher Barodawala
 
2 d transformations by amit kumar (maimt)
2 d transformations by amit kumar (maimt)
Amit Kapoor
 
Image enhancement techniques
Image enhancement techniques
sakshij91
 
Matlab ppt
Matlab ppt
Dhammpal Ramtake
 
Image enhancement techniques
Image enhancement techniques
Saideep
 
IMAGE FUSION IN IMAGE PROCESSING
IMAGE FUSION IN IMAGE PROCESSING
garima0690
 
Introduction To Advanced Image Processing
Introduction To Advanced Image Processing
Suren Kumar
 
Comparison of image fusion methods
Comparison of image fusion methods
Amr Nasr
 
Image processing ppt
Image processing ppt
Raviteja Chowdary Adusumalli
 
Lecture 06 geometric transformations and image registration
Lecture 06 geometric transformations and image registration
obertksg
 
Fast Mesh-Based Medical Image Registration
Fast Mesh-Based Medical Image Registration
Ahmadreza Baghaie
 
Multi modality medical image registration
Multi modality medical image registration
Habib Baluwala
 
Thesis, Image Registration Methods
Thesis, Image Registration Methods
balanou
 
ITK Tutorial Presentation Slides-947
ITK Tutorial Presentation Slides-947
Kitware Kitware
 
4.intensity transformations
4.intensity transformations
Yahya Alkhaldi
 
Fuzzy c-means clustering for image segmentation
Fuzzy c-means clustering for image segmentation
Dharmesh Patel
 
Hearn and Baker 2 D transformations
Hearn and Baker 2 D transformations
Taher Barodawala
 
2 d transformations by amit kumar (maimt)
2 d transformations by amit kumar (maimt)
Amit Kapoor
 
Image enhancement techniques
Image enhancement techniques
sakshij91
 
Image enhancement techniques
Image enhancement techniques
Saideep
 
IMAGE FUSION IN IMAGE PROCESSING
IMAGE FUSION IN IMAGE PROCESSING
garima0690
 
Introduction To Advanced Image Processing
Introduction To Advanced Image Processing
Suren Kumar
 
Comparison of image fusion methods
Comparison of image fusion methods
Amr Nasr
 
Ad

Similar to Issues in Image Registration and Image similarity based on mutual information (20)

Mutual Information Algorithm applied to rigid registration
Mutual Information Algorithm applied to rigid registration
Miami Cancer Institute
 
Mutualinfo Deformregistration Upci 04aug05
Mutualinfo Deformregistration Upci 04aug05
martindudziak
 
A Survey OF Image Registration
A Survey OF Image Registration
CSCJournals
 
Behavior study of entropy in a digital image through an iterative algorithm
Behavior study of entropy in a digital image through an iterative algorithm
ijscmcj
 
BEHAVIOR STUDY OF ENTROPY IN A DIGITAL IMAGE THROUGH AN ITERATIVE ALGORITHM O...
BEHAVIOR STUDY OF ENTROPY IN A DIGITAL IMAGE THROUGH AN ITERATIVE ALGORITHM O...
ijscmcj
 
Image Retrieval using Equalized Histogram Image Bins Moments
Image Retrieval using Equalized Histogram Image Bins Moments
IDES Editor
 
International Journal of Engineering Inventions (IJEI),
International Journal of Engineering Inventions (IJEI),
International Journal of Engineering Inventions www.ijeijournal.com
 
IRJET - Symmetric Image Registration based on Intensity and Spatial Informati...
IRJET - Symmetric Image Registration based on Intensity and Spatial Informati...
IRJET Journal
 
Image similarity using fourier transform
Image similarity using fourier transform
IAEME Publication
 
Image Registration for Recovering Affine Transformation Using Nelder Mead Sim...
Image Registration for Recovering Affine Transformation Using Nelder Mead Sim...
CSCJournals
 
Image Registration (Digital Image Processing)
Image Registration (Digital Image Processing)
VARUN KUMAR
 
Image compression notes.pdf
Image compression notes.pdf
2BA19CS073SmitaDAmbi
 
Robust Block-Matching Motion Estimation of Flotation Froth Using Mutual Infor...
Robust Block-Matching Motion Estimation of Flotation Froth Using Mutual Infor...
CSCJournals
 
Lec15: Medical Image Registration (Introduction)
Lec15: Medical Image Registration (Introduction)
Ulaş Bağcı
 
Corner Detection Using Mutual Information
Corner Detection Using Mutual Information
CSCJournals
 
IMAGE TRANSFORMATION & DWT BASED IMAGE DECOMPOSITION FOR COVERT COMMUNICATION
IMAGE TRANSFORMATION & DWT BASED IMAGE DECOMPOSITION FOR COVERT COMMUNICATION
Editor Jacotech
 
image enhancement-POINT AND HISTOGRAM PROCESSING.pptx
image enhancement-POINT AND HISTOGRAM PROCESSING.pptx
mythilybme
 
Image Denoising Based On Sparse Representation In A Probabilistic Framework
Image Denoising Based On Sparse Representation In A Probabilistic Framework
CSCJournals
 
Image processing and compression.pptx
Image processing and compression.pptx
dudoo1
 
F44083035
F44083035
IJERA Editor
 
Mutual Information Algorithm applied to rigid registration
Mutual Information Algorithm applied to rigid registration
Miami Cancer Institute
 
Mutualinfo Deformregistration Upci 04aug05
Mutualinfo Deformregistration Upci 04aug05
martindudziak
 
A Survey OF Image Registration
A Survey OF Image Registration
CSCJournals
 
Behavior study of entropy in a digital image through an iterative algorithm
Behavior study of entropy in a digital image through an iterative algorithm
ijscmcj
 
BEHAVIOR STUDY OF ENTROPY IN A DIGITAL IMAGE THROUGH AN ITERATIVE ALGORITHM O...
BEHAVIOR STUDY OF ENTROPY IN A DIGITAL IMAGE THROUGH AN ITERATIVE ALGORITHM O...
ijscmcj
 
Image Retrieval using Equalized Histogram Image Bins Moments
Image Retrieval using Equalized Histogram Image Bins Moments
IDES Editor
 
IRJET - Symmetric Image Registration based on Intensity and Spatial Informati...
IRJET - Symmetric Image Registration based on Intensity and Spatial Informati...
IRJET Journal
 
Image similarity using fourier transform
Image similarity using fourier transform
IAEME Publication
 
Image Registration for Recovering Affine Transformation Using Nelder Mead Sim...
Image Registration for Recovering Affine Transformation Using Nelder Mead Sim...
CSCJournals
 
Image Registration (Digital Image Processing)
Image Registration (Digital Image Processing)
VARUN KUMAR
 
Robust Block-Matching Motion Estimation of Flotation Froth Using Mutual Infor...
Robust Block-Matching Motion Estimation of Flotation Froth Using Mutual Infor...
CSCJournals
 
Lec15: Medical Image Registration (Introduction)
Lec15: Medical Image Registration (Introduction)
Ulaş Bağcı
 
Corner Detection Using Mutual Information
Corner Detection Using Mutual Information
CSCJournals
 
IMAGE TRANSFORMATION & DWT BASED IMAGE DECOMPOSITION FOR COVERT COMMUNICATION
IMAGE TRANSFORMATION & DWT BASED IMAGE DECOMPOSITION FOR COVERT COMMUNICATION
Editor Jacotech
 
image enhancement-POINT AND HISTOGRAM PROCESSING.pptx
image enhancement-POINT AND HISTOGRAM PROCESSING.pptx
mythilybme
 
Image Denoising Based On Sparse Representation In A Probabilistic Framework
Image Denoising Based On Sparse Representation In A Probabilistic Framework
CSCJournals
 
Image processing and compression.pptx
Image processing and compression.pptx
dudoo1
 
Ad

Recently uploaded (20)

How to Customize Quotation Layouts in Odoo 18
How to Customize Quotation Layouts in Odoo 18
Celine George
 
A Visual Introduction to the Prophet Jeremiah
A Visual Introduction to the Prophet Jeremiah
Steve Thomason
 
GREAT QUIZ EXCHANGE 2025 - GENERAL QUIZ.pptx
GREAT QUIZ EXCHANGE 2025 - GENERAL QUIZ.pptx
Ronisha Das
 
YSPH VMOC Special Report - Measles Outbreak Southwest US 6-14-2025.pptx
YSPH VMOC Special Report - Measles Outbreak Southwest US 6-14-2025.pptx
Yale School of Public Health - The Virtual Medical Operations Center (VMOC)
 
ECONOMICS, DISASTER MANAGEMENT, ROAD SAFETY - STUDY MATERIAL [10TH]
ECONOMICS, DISASTER MANAGEMENT, ROAD SAFETY - STUDY MATERIAL [10TH]
SHERAZ AHMAD LONE
 
Public Health For The 21st Century 1st Edition Judy Orme Jane Powell
Public Health For The 21st Century 1st Edition Judy Orme Jane Powell
trjnesjnqg7801
 
M&A5 Q1 1 differentiate evolving early Philippine conventional and contempora...
M&A5 Q1 1 differentiate evolving early Philippine conventional and contempora...
ErlizaRosete
 
THE PSYCHOANALYTIC OF THE BLACK CAT BY EDGAR ALLAN POE (1).pdf
THE PSYCHOANALYTIC OF THE BLACK CAT BY EDGAR ALLAN POE (1).pdf
nabilahk908
 
LAZY SUNDAY QUIZ "A GENERAL QUIZ" JUNE 2025 SMC QUIZ CLUB, SILCHAR MEDICAL CO...
LAZY SUNDAY QUIZ "A GENERAL QUIZ" JUNE 2025 SMC QUIZ CLUB, SILCHAR MEDICAL CO...
Ultimatewinner0342
 
LDMMIA Yoga S10 Free Workshop Grad Level
LDMMIA Yoga S10 Free Workshop Grad Level
LDM & Mia eStudios
 
University of Ghana Cracks Down on Misconduct: Over 100 Students Sanctioned
University of Ghana Cracks Down on Misconduct: Over 100 Students Sanctioned
Kweku Zurek
 
CRYPTO TRADING COURSE BY FINANCEWORLD.IO
CRYPTO TRADING COURSE BY FINANCEWORLD.IO
AndrewBorisenko3
 
Peer Teaching Observations During School Internship
Peer Teaching Observations During School Internship
AjayaMohanty7
 
Q1_TLE 8_Week 1- Day 1 tools and equipment
Q1_TLE 8_Week 1- Day 1 tools and equipment
clairenotado3
 
June 2025 Progress Update With Board Call_In process.pptx
June 2025 Progress Update With Board Call_In process.pptx
International Society of Service Innovation Professionals
 
Tanja Vujicic - PISA for Schools contact Info
Tanja Vujicic - PISA for Schools contact Info
EduSkills OECD
 
Birnagar High School Platinum Jubilee Quiz.pptx
Birnagar High School Platinum Jubilee Quiz.pptx
Sourav Kr Podder
 
INDUCTIVE EFFECT slide for first prof pharamacy students
INDUCTIVE EFFECT slide for first prof pharamacy students
SHABNAM FAIZ
 
ENGLISH_Q1_W1 PowerPoint grade 3 quarter 1 week 1
ENGLISH_Q1_W1 PowerPoint grade 3 quarter 1 week 1
jutaydeonne
 
K12 Tableau User Group virtual event June 18, 2025
K12 Tableau User Group virtual event June 18, 2025
dogden2
 
How to Customize Quotation Layouts in Odoo 18
How to Customize Quotation Layouts in Odoo 18
Celine George
 
A Visual Introduction to the Prophet Jeremiah
A Visual Introduction to the Prophet Jeremiah
Steve Thomason
 
GREAT QUIZ EXCHANGE 2025 - GENERAL QUIZ.pptx
GREAT QUIZ EXCHANGE 2025 - GENERAL QUIZ.pptx
Ronisha Das
 
ECONOMICS, DISASTER MANAGEMENT, ROAD SAFETY - STUDY MATERIAL [10TH]
ECONOMICS, DISASTER MANAGEMENT, ROAD SAFETY - STUDY MATERIAL [10TH]
SHERAZ AHMAD LONE
 
Public Health For The 21st Century 1st Edition Judy Orme Jane Powell
Public Health For The 21st Century 1st Edition Judy Orme Jane Powell
trjnesjnqg7801
 
M&A5 Q1 1 differentiate evolving early Philippine conventional and contempora...
M&A5 Q1 1 differentiate evolving early Philippine conventional and contempora...
ErlizaRosete
 
THE PSYCHOANALYTIC OF THE BLACK CAT BY EDGAR ALLAN POE (1).pdf
THE PSYCHOANALYTIC OF THE BLACK CAT BY EDGAR ALLAN POE (1).pdf
nabilahk908
 
LAZY SUNDAY QUIZ "A GENERAL QUIZ" JUNE 2025 SMC QUIZ CLUB, SILCHAR MEDICAL CO...
LAZY SUNDAY QUIZ "A GENERAL QUIZ" JUNE 2025 SMC QUIZ CLUB, SILCHAR MEDICAL CO...
Ultimatewinner0342
 
LDMMIA Yoga S10 Free Workshop Grad Level
LDMMIA Yoga S10 Free Workshop Grad Level
LDM & Mia eStudios
 
University of Ghana Cracks Down on Misconduct: Over 100 Students Sanctioned
University of Ghana Cracks Down on Misconduct: Over 100 Students Sanctioned
Kweku Zurek
 
CRYPTO TRADING COURSE BY FINANCEWORLD.IO
CRYPTO TRADING COURSE BY FINANCEWORLD.IO
AndrewBorisenko3
 
Peer Teaching Observations During School Internship
Peer Teaching Observations During School Internship
AjayaMohanty7
 
Q1_TLE 8_Week 1- Day 1 tools and equipment
Q1_TLE 8_Week 1- Day 1 tools and equipment
clairenotado3
 
Tanja Vujicic - PISA for Schools contact Info
Tanja Vujicic - PISA for Schools contact Info
EduSkills OECD
 
Birnagar High School Platinum Jubilee Quiz.pptx
Birnagar High School Platinum Jubilee Quiz.pptx
Sourav Kr Podder
 
INDUCTIVE EFFECT slide for first prof pharamacy students
INDUCTIVE EFFECT slide for first prof pharamacy students
SHABNAM FAIZ
 
ENGLISH_Q1_W1 PowerPoint grade 3 quarter 1 week 1
ENGLISH_Q1_W1 PowerPoint grade 3 quarter 1 week 1
jutaydeonne
 
K12 Tableau User Group virtual event June 18, 2025
K12 Tableau User Group virtual event June 18, 2025
dogden2
 

Issues in Image Registration and Image similarity based on mutual information

  • 1. Issues in Image Registration – multimodal image acquisition & image super‐resolution. DARSHANA MISTRY SUPERVISOR:- DR. ASIM BANERJEE-DAIICT CO-SUPTERVISOR:- DR. SHISHIR SHAH, UNIVERSITY OF HOUSTON DPC:- DR ADITYA TATU-DAIICT DR TANISH ZAVERI- NIT, NU
  • 2. Outline  Introduction of Image Registration(IR)  Issues of Image Registration  Steps for Image Registration  Review Comments on DPC-2  Affine Transformation  Entropy  Mutual Information
  • 3. Introduction  Image Registration:-It is a process of overlying of two or more images of the same scene taken at different times, different viewpoints and/or different sensors. Fig. 1. Image Registration
  • 4. Issues of Image Registration  Multimodal Registration  Registration of images of the same scene acquired from different sensors.  Viewpoint Registration  Registration of images taken from different viewpoints.  Temporal Registration  Registration of images of same scene taken at different times or under different conditions
  • 5. Steps of Image Registration  B. Zitova, J. Flusser[1] introduced basic 4 steps of image registration.
  • 6.  Fig. 2. Four steps of Image Registration (Top row: feature detection, middle row: feature matching, model estimation, bottom right: image resampling and transformation
  • 7. Previous Review Comments on DPC-2 (21-Dec. 12)  Implement affine transformation and use mutual information and plots its variations.  Identify standard image databases that will be used for future work.  Identify recent registration approaches reported in literature for future exploration during the next review period.
  • 8. Affine Transformation[1/4]  The affine transformation parameters can be calculated by coordinates of control points, and then geometrically transformation may be conducted for registered image.
  • 9. Affine Transformation[2/4] (a) (b) Fig. 3. (a) Transform of an image (b) Rotate of an image, (c) Scaling of an image (c)
  • 10. Affine Transformation[3/4] (a) (b)  Fig. 4. (a) Transform of an image (b) Rotate of an image, (c) Scaling of an image (c)
  • 11. Affine Transformation[4/4] Fig. 5. Affine Transformation of an image
  • 12. Entropy[1/7] A key measure of information is known as entropy[2], which is usually expressed by average amount of information received when the value of random value X is observed (the average number of bits needed to store or communicate one symbol in a message).  Shannon introduced an adopted measure in 1948, which weights the information per outcome by the probability of that outcome occurring. Given events occurring with probabilities the Shannon entropy is defined as,
  • 13. Entropy[2/7]  The units for entropy are “nats” when the natural logarithm is used and “bits" for base 2 logarithms.  When all messages are equally likely to occur, the entropy is maximal, because you are completely uncertain which message you will receive.  When one of the messages has a much higher chance of being sent than the other messages, the uncertainty decreases.  The amount of information for the individual messages that have a small chance of occurring is high, but an average, the information (entropy/ uncertainty ) is lower.
  • 14. Entropy[3/7] 14  Example:1. Mummy-0.35, daddy-0.2, cat-0.2, cow-0.25 The entropy of child’s language-0.35 log(0.35)-0.2 log(0.2)-0.2 log(0.2)- 0.25 log(0.25)=1.96 Mummy- 0.05, daddy-0.05, cat- 0.02, train-0.02, car0.02, cookie-0.02, telly-0.02, no-0.8 The entropy of child’s language- 1.25 2.
  • 15. Entropy[4/7] 15  Base on the distribution of the grey values of the image[4], a probability distribution of grey values can be estimated by counting the number of times each grey value occurs in the image and dividing those numbers by the total number of occurrences.  A single intensity of image will have a low entropy; it contains very little information.  A high entropy value will be yielded by an image with more or less equal quantities of many different intensities, which is an image containing a lot of information.
  • 18. Entropy[7/7] 18  Entropy has three interpretations: 1. The amount of information an event(message, grey value of a point) gives when it takes place, 2. The uncertainty about the outcome of an event, and 3. The dispersion of the probabilities with which the events take place.
  • 19. Mutual Information[1/3]  Mutual Information (transformation)[1] measures the amount of information that can be obtained about one random variable by observing another.  It is important in communication where it can be used to maximize the amount of information shared between sent and received signals.  A basic property of the mutual information is that   I(X;Y) = H(X) - H(X|Y) Mutual information is the amount by which the uncertainty about Y decrease when X is given: the amount of information X contains about Y.
  • 20. Mutual Information[2/3] 20  The second form of mutual information is most closely related to joint entropy.  I(X:Y) = H(X) + H(Y) – H(X,Y)  -H(X,Y) means that maximizing mutual information is related to minimizing joint entropy.  The advantage of mutual information over joint entropy per se, is that it includes the entropies of the separate images.
  • 21. Mutual Information[3/3] 21  The final form of mutual information is based on Kullback- Leibler distance[KLD][2]  Where SI (Specific mutual Information) is the point wise mutual information.  The interpretation of this form is that it measures the distance between the joint distribution of the images’ grey values p(x, y) and the joint distribution in case of independence of the images, p(x)p(y).  It is measure of dependence between two images.  If the testing images are well registered, then the value of KLD becomes small or is equal to zero[17].
  • 28.  Tools:  OpenCV(open source computer vision)2.3/2.4.2  Microsoft Visual Studio 2008/2010 express  cMake(cross platform make) 2.8
  • 29. Data Set 512 X 512 CT and MRI images a b c d e f
  • 30. Conclusion  Image similarity is find based on entropy and mutual information.  The entropy of an image is a measure of the amount of uncertainty with gray values.  Mutual information measures the amount of information, one image that can be obtained about one random variable by observing another.  Entropy value is high image similarity is less. Mutual information is maximum then image similarity is high.
  • 31. References 1. 2. 3. 4. 5. 6. 7. B.Zitova,J.Flusser,“ Image Registration methods :A survey”, Image and vision computing, vol.21-no.-11,pp977-1000,2003. J. P.W.Pluim, J.B. A. Maintz, and M. A. Viergever, “Mutual Information based registration of medical images: a survey”, IEEE Transactions on Medical Images, Vol.-XX, Issues-Y, 2003. R. M. Gray, “Entropy and Information Theory”, Springr-Verlag, New York, 2009. F. P. M. Oliveira, J. M. R. S. Tavares , “ Medical Image Registration: a Review ”, Computer Methods in Biomechanics and Biomedical Engineering, 2012. A. Sotiras , C. Davatazikos, N. Paragios, “Deformable Medical Image Registration: A Survey”, Research Report n° 7919 September 2012. M.V.Sruthi1, K.Soundararajan, V.Usha Sree , “ Accurate Multimodality Registration of medical images”, Accurate Multimodality Registration of medical images , Volume 1, Issue 3 , PP.33-36 , June 2012 . Q. Xie, S. Kurtek, G. Christensen, Z. Ding, E. Klassen,A. Srivastava, “A Novel Framework for Metric-Based Image Registration”, WBIR2012
  • 32. 8. 9. 10. 11. 12. 13. 14. M.V.Wyavahare, P.M.Patil, H.K.Abhyankar,“Image Registration Techniques: An overview”, International Journal of Signal Processing, Image Processing, and PatternReorganization,Vol.2,No.3,2009. J.B.A.Maintz, A.Viegever, “A Survey of Medical Image Registration”, Medical Image Analysis”,Vol.2,No.1,pp(1-37),1998. G.Junbin,G.Xiaosong,W.Wei;P.Pengcheng, “Geometric Global Registration of Parallax Images Based on Wavelet Transform”, International Conference of Electronic Measurement and Instruments, pp 2862-2865,2007. Gang Hong; Yun Zhang, “Combination of feature based and area based image registration technique for high resolution remote sensing image”, International Conference on Geo science and Remote Sensing Symposium, pp 377-380, 2007 Malviya A.; Bhirud,S.G., “Wavelet based image registration using mutual information”, International Conferenceon Emerging Trendsin Electronic and Photonic Devices and Systems (ELECTRO‟09),245-244,2009. HongG.,ZhangY;“Wavelet based image registration technique for high resolution remote sensing image”, Journal of Compute Science and Geosciences 2006. Hui Lin; Peijun Du; Weichang Zhao; Lianpeng Zhang; Huasheng Sun, “Image Registration based on corner detection and affine transformation”, International conference on Image and Signal Processing (CISP), pp2184-2188,2010.
  • 33. Y. Yamamura,;H. Kim;J. Tan; S. Yamamura,; Yamamoto, “A method for reducing of computational time on image registration employing wavelet transformation”, International conference on Control Automation and Systems (ICCAS), pp 1286-1291,2007. 16. Y. Pei; H. Wu; J. Yu; G. Cai, “Effective Image Registration based on Improved Harris Corner Detection”, International Conference on Information Networking an Automation (ICINA), V193-V196,2010. 17. R. Gan, J. Wu, A. C.S. Chung, S.C.H. Yu,W.M. Wells, Multiresolution Image Registration Based on Kullback-Leibler Distance”, 7th International Conference on Medical Image Computing and Computer Assisted Intervention (MICCAI’04, 2004. 15.