Principle component Analysis

Tasseled Cap Transform

❖ The different bands in a multispectral image can be visualized as defining an N-dimensional space where N is the
number of bands. Each pixel, positioned according to its DN value in each band, lies within the N-dimensional
space.

❖ This pixel distribution is determined by the absorption/reflection spectra of the imaged material. This clustering of
the pixels is termed the data structure (Crist and Kauth, 1986).

❖ The data structure can be considered a multidimensional hyper-ellipsoid.

❖ The principal axes of this data structure are not necessarily aligned with the axes of the data space (defined as the
bands of the input image). They are more directly related to the absorption spectra.

❖ For viewing purposes, it is advantageous to rotate the N-dimensional space such that one or two of the data
structure axes are aligned with the Viewer X and Y axes.

❖ In particular, you could view the axes that are the largest for the data structure produced by the absorption peaks
of special interest for the application.
 Colour space Transform
• To describe the visually perceived colour of an image, instead of using RGB components, sometimes we use
hue, saturation, and intensity (HSI or IHS) for a subjective sensation of colour, colour purity, and brightness,
respectively

• Images in red–green–blue (RGB) color space need to be transformed to other color spaces for image
processing or analysis.

• For example, the well-known hue-saturation-intensity (HSI) color space, which separates hue from saturation
and intensity and is similar to the color perception of humans, can aid many computer vision applications.

• For high-dimensional images, such as multispectral or hyperspectral images, the transformation images to a
color space that can separate hue from saturation and intensity would be useful

• The literature proposes many IHS transformation algorithms, which have been developed for converting the
RGB values. Some are also named HSV (hue, saturation, value) or HLS (hue, luminance/lightness,
saturation). While the complexity of the models varies, they produce similar values for hue and saturation
(a) RGB color cube and (b) HSI hexagon model
 Fourier transform

❖ Fourier transform is a linear transformation that allows calculation of the coefficients necessary for the sine
and cosine terms to adequately represent the image

❖ Fourier transformations are typically used for the removal of noise such as striping, spots, or vibration in
imagery by identifying periodicities (areas of high spatial frequency)

❖ Fast Fourier Transform (FFT), a classical image filtering technique, is used to convert a raster image from
the spatial domain into a frequency domain image
 Image Fusion

✓ Image fusion is the process of combining relevant information from two or more images into a single image.

✓ The image fusion is a novel method for combining spectral information of coarse resolution image with finer
spatial resolution image. The resulting merged image is a product that synergistically integrates the
information provided by various sensors or by the same sensor (Simone et al., 2002), which may be found
useful for human visual perception, provides faster interpretation and can help in extracting more features
(Wen and Chen, 2004)

✓ Further, it also helps in sharpening the images, improving geometric corrections, enhancing certain features
that are not visible in either of the images, replacing the defective data, and complementing the data sets for
better decision-making.

✓ The advantages of image fusion include image sharpening, feature enhancement, improved classification,
and the creation of stereo data sets. Multisensor image fusion provides benefits in terms of the range of
operation, spatial and temporal characteristics, system performance, reduced ambiguity, and improved
reliability

✓ Based on the processing levels, image fusion techniques can be divided into different categories. These are
pixel level, feature level, and symbol level/decision level
✓ The fusion of two data sets can be done in order to obtain one single data set with the qualities of both (Saraf,
1999). For example, the low-resolution multispectral satellite imagery can be combined with the higher resolution
radar imagery by fusion technique to improve the interpretability of fused/merged images.

✓ The resultant data product has the advantages of high spatial resolution, structural information (from radar
images), and spectral resolution (from optical and infrared bands). Thus, with the help of all this cumulative
information, the analyst can explore most of the linear and anomalous features as well as lithologies.

▪ Intensity-Hue-Saturation (IHS) Transform Fusion

▪ PCA Transform Fusion

▪ Wavelet Transform Fusion

▪ Brovey Transform Fusion

 ▪ Intensity-Hue-Saturation (IHS) Transform Fusion
➢ IHS is a common way of fusing high spatial resolution, single band, pan and low spatial resolution, and
multispectral remote sensing images.

➢ The R, G, and B bands of the multispectral image are transformed into HIS components, replacing the intensity
component with the pan image, and performing the inverse transformation to obtain a high spatial resolution
multispectral image.

➢ HIS can enhance spatial details of the multispectral image and improve the textural characteristics of the fused, but
the fusion image exist serious spectral distortion.

➢ The HIS transform is used for geologic mapping because the IHS transform could allow diverse forms of spectral
and spatial landscape information to be combined into a single data set for analysis.

Although the HIS method has been widely used, the method cannot
decompose an image into different frequencies in frequency space such as
higher or lower frequency. Hence the IHS method cannot be used to
enhance certain image characteristics. The color distortion of HIS technique
is often significant. To reduce the color distortion the PAN image is matched
to the intensity component are stretching before the reverse transform.
 ▪ PCA Transform Fusion

➢ PCA transformation is a technique from statistics for

simplifying a data set. The aim of the method is to reduce the
dimensionality of multivariate data whilst preserving as
much of the relevant information as possible.

➢ It translates correlated data sets to the uncorrelated dataset. PCA

data are often more interpretable than the source data. By using this
method, the redundancy of the image data can be decreased.

➢ The PCA involves a mathematical procedure that transforms a

number of correlated variables into a number of uncorrelated
variables called principal components. It computes a compact and
optimal description of the data set. The first principal component is
taken to be along the direction with the maximum variance.
 ▪ Wavelet Transform Fusion
Wavelet transform is a mathematical tool developed in the field of signal
processing. It can decompose a digital image into a set of multi-resolution
images accompanied by wavelet coefficients for each resolution level.

The wavelet coefficients for each level contain the

spatial (detail) differences between two successive
resolution levels. The wavelet-based fusion is
performed in the following way (Figure 3):

(1) decompose a high-resolution panchromatic image

into a set of low-resolution panchromatic images
with wavelet coefficients for each level,
(2) replace a low-resolution panchromatic with a
multispectral band at the same resolution level,
(3) perform a reverse wavelet transform to convert the
decomposed and replaced panchromatic set back to
the original panchromatic resolution level. The
replacement and reverse transform is done three
times, each for one multispectral band.
 ▪ Brovey Transform Fusion
➢ The BT is based on the chromaticity transform. Chromaticity is an objective specification of the quality of a color
regardless of its luminance. Chromaticity consists of two independent parameters, often specified as hue (h) and
colorfulness (s), where the latter is alternatively called saturation, chroma, intensity, or excitation purity

➢ It is a simple method for combining data from multiple sensors with the limitation that only three bands are
involved.

➢ Its purpose is to normalize the three multispectral bands used for RGB display and to multiply the result by any
other desired data to add the intensity or brightness component to the image.

➢ This technique requires an experienced analyst for the specific

adaptation of parameters. This produces the development of a
user-friendly automated tool.

➢ The Brovey Transform was developed to avoid the disadvantages

of the multiplicative method. It is a combination of arithmetic
operations and normalizes the spectral bands before they are
multiplied with the panchromatic image.
➢ The Brovey Transform was developed to visually increase contrast in the low and high ends of an image’s
histogram (i.e., to provide contrast in shadows, water and high reflectance areas such as urban features).

➢ Consequently, the Brovey Transform should not be used if preserving the original scene radiometry is important.
However, it is good for producing RGB images with a higher degree of contrast in the low and high ends of the
image histogram and for producing visually appealing images.

➢ Since the Brovey Transform is intended to produce RGB images, only three bands at a time should be merged
from the input multispectral scene, such as bands 3, 2, 1 from a SPOT or Landsat TM image or 4, 3, 2 from a
Landsat TM image.

➢ The resulting merged image should then be displayed with bands 1, 2, 3 to RGB.