GmE 202 Lecture 5 Imaging Geometry and Correction Rev
GmE 202 Lecture 5 Imaging Geometry and Correction Rev
Correction
GmE 202 Principles of Remote Sensing
Lecturer: Ariel C. Blanco
Introductory Digital Image Processing. 3rd edition. Jensen, 2004
Sensor Geometry
• Frame
• photogrammetric cameras; central perspective projection
• Point (across-track scanner)
• Line (along-track scanner
• Panoramic
Image Acquisition Geometry
Digital Image Processing (DIP)
New
Digital Image Computer Digital Image
• GCPs are specific pixels in an image for which the output map
coordinates (or other output coordinates) are known. GCPs
consist of two X,Y pairs of coordinates:
• Source coordinates—usually data file coordinates in the
image being rectified
• Reference coordinates—the coordinates of the map or
reference image to which the source image is being
registered
• The term map coordinates is sometimes used loosely to apply to
reference coordinates and rectified coordinates. These coordinates
are not limited to map coordinates.
• For example, in image-to-image registration, map coordinates are not
necessary.
GCP’s
GCP’s
Distribution of GCP’s
GCP Selection for High Resolution Satellite Image
Two-Dimensional
Geographic Transformations
Y0 Yn Yn
Yn
Y0
X0
Xn
Xn
Xn X0
Xn S cos X 0 S sin Y0 DX 0
Yn S sin X 0 S cos Y0 DY0
a
Xn a X 0 b Y0 c Xn X 0 Y0 1 0 b
Yn Y
X0 0 1 c
Yn b X 0 a Y0 d 0
d
Conformal/Similarity Transformation
• The formulas can be written in different forms
3. To compute the old coordinates given the parameters and new
coordinates (back substitution)
Xn a X 0 b Y0 c ( Xn c) a X 0 b Y0
Yn b X 0 a Y0 d (Yn d ) b X 0 a Y0
Add equations to get X0
Multiply Eq. 1 by a, Eq 2 by -b
a Xn c b Yn d
X0
a ( Xn c ) a X 0 ab Y0
2
a2 b2
b(Yn d ) b 2 X 0 ab Y0 b Xn c a Yn d
Similar operation to obtain Y0: Y0
a 2 b2
Multiply Eq. 1 by b, Eq 2 by a
Conformal Transformation: Example
• Moves, rotates and scale objects in 2D space.
No Xo Yo Xn Yn
(map) (map) (ground) (ground)
1 10 10 350 190
2 80 60 250 300
Xn a b Xo Cx
Yn b a * Yo Cy
350 a 10 b 10 C x 350 10 10 1 0 a
190 b 10 a 10 Cy
10 10
190 0 1 b
*
250 a 80 b 60 C x 250 80 60 1 0 C x
300 b 80 a 60 C y 300 60 80
0 1 C y
Conformal Transformation: Example
a 10 10 1 0 1 350 0.203
b 10 10 0 1 190 1.716
*
C x 80 60 1 0 250 369.189
C 60 80 0 1 300 174.865
y
preserve orthogonality 2t
t1 y1
Yn
Affine Transformation
DX DY
Physical interpretation: Xn
Xn C x X 0 cos( ) C y Y0 sin DX 0
Yn Cx X 0 sin C y Y0 cos DY0
6 parameters: Cx, Cy, , , Dx0, Dy0, and in linear form:
a Cx cos d C x sin
b C y sin e C y cos
c Dx0 f Dy0
•
𝑋𝑛 𝑎 𝑏 𝑋𝑜 𝑐
[ ][ 𝑌𝑛
=
𝑐 𝑑
∗
] [ ][]
𝑌𝑜
+
𝑓
2-D Affine Transformation
• The formulas for an affine transformation:
xT a A bA xs c A
y d
e A ys f A
T A
• If n control points are measured, this Equation is reorganized as
follows: a A
xT 1 xs1 ys1 1 0 0 0
y 0 bA
T1 0 0 xs1 ys1 1
cA
d A
xTn xsn ysn 1 0 0 0
eA
yTn 0 0 0 xsn ysn 1
f A
y A
Orthogonal Affine Transformation
• Impose condition of orthogonality ( = 0) yielding 5
parameters: Cx, Cy, , x’, y’
Xn Cx X 0 cos C y Y0 sin DX 0
Yn C x X 0 sin C y Y0 cos DY0
Rigid Body Transformation
Xn X 0 cos Y0 sin DX 0
Yn X 0 sin Y0 cos DY0
• 3 parameters: , x’, y’
Projective or Polynomial Transformation
• Instead of 4 or 6 parameters we have many parameters at
least 8 (8 would be the Bi-linear or projective
transformation)
• With more parameters we need more known points to solve
the equations
• N-equations and N unknowns.
• In most cases, it is
advantageous to tolerate a
certain amount of error
rather than take a more
complex transformation.
• The amount of RMS error
that is tolerated can be
thought of as a window For example, if the RMS error
around each source tolerance is 2, then the
coordinate, inside which a retransformed pixel can be 2 pixels
retransformed coordinate is away from the source pixel and still
considered to be correct be considered accurate.
(that is, close enough to use).
RMS Error Tolerance
The next step in the rectification/registration process is to create the output file. Since
the grid of pixels in the source image rarely matches the grid for the reference image,
the pixels are resampled so that new data file values for the output file can be
calculated.
Second-order (and higher)
Transformations
• Transformations of the 2nd-order or higher are nonlinear
transformations that can correct nonlinear distortions. The
process of correcting nonlinear distortions is also known as
rubber sheeting.
• Second-order transformations can be used to convert
Lat/Lon data to a planar projection, for data covering a large
area (to account for the Earth’s curvature), and with
distorted data (for example, due to camera lens distortion).
• Third-order transformations are used with distorted aerial
photographs, on scans of warped maps and with radar
imagery.
• Fourth-order transformations can be used on very distorted
aerial photographs.
ts of Order
To compare the two grids, the input Using a resampling method, the pixel
image is laid over the output grid, so that values of the input image are assigned
the GCPs of the two grids fit together. to pixels in the output grid.
Nearest Neighbor
••Uses
Uses weighted
weighted average
average
of
of values
values of
of 16
16 pixels
pixels
••Images
Images generally
generally more
more
attractive
attractive than
than other
other
procedures
procedures
••Data
Data altered
altered more
more
••Computations
Computations moremore
intensive
intensive and
and number
number of
of
GCPs
GCPs is
is higher
higher
Original image Nearest neighbor