Unit 6 Remote Sensing Data Products and Formats: Structure
Unit 6 Remote Sensing Data Products and Formats: Structure
Structure
6.1 Introduction
Objectives
6.2 What is a Data Product?
6.3 Index Numbers for Data Products
6.4 Types of Data Products
Products Based on Level of Processing
Products Based on Output Media/Scale
Products Based on Area of Coverage
6.5 What is Data Format?
Types of Data Formats
Standards of Data Formats
6.6 Product Code
6.7 Placing an Order for a Data Product
6.8 Activity
6.9 Summary
6.10 Unit End Questions
6.11 References
6.12 Further/Suggested Reading
6.13 Answers
6.1 INTRODUCTION
You have been introduced to the basic concepts of remote sensing, its
principles and applications, in detail in Block 1 Introduction to
Geoinformatics of MGY-001 Overview of Geoinformatics . You will find more
details about remote sensing in Block 1 Introduction to Remote Sensing and
Block 2 Sensors and Space Programmes of the course MGY-002
Remote Sensing and Image Interpretation, which will include electromagnetic
radiation and its interactions with matter, remote sensing regions and bands,
spectral signatures/response patterns of some common natural objects, sensors
and platforms and image resolutions. The raw remote sensing data recorded
through the medium of electromagnetic radiation contain many systematic
distortions and errors. The data have to be processed to remove the distortions
and errors. Finally, the data are converted into various products to be supplied
to users for various applications. There is a remarkable difference between raw
remote sensing data recorded and processed remote sensing data which is
supplied to users.
In this unit, you will be first introduced to remote sensing data products and
formats. You will also get an idea about how and where to procure remote
sensing data products from i.e. data centers/suppliers.
39
Concepts of Geospatial Remote sensing data is a product like a block of aluminium metal before it is
Data
shaped into a usable utensil/vessel. You will find that the whole process with
raw satellite images is just like collecting a raw material and processing the
same into a finished one, just as aluminium ore (i.e. bauxite) is processed into
aluminium metal to be used to make utensils/vessels.
Objectives
After reading this unit you should be able to:
• define what is a data product;
• list out the types of data products;
• discuss about different types of data formats; and
• identify how and where to acquire remote sensing data.
Fig. 6.1: Arrangement of grid cells or pixels in raster data (source: Arc GIS Guide Book
by ESRI, http://kompeni.net/category/pdf-file)
The data from various sensors are presented in a form and format with
specified radiometric and geometric accuracy which can be readily used by
various application scientists for specific themes of their interest. Remote
40
sensing data can be procured by a number of users for various applications and Remote Sensing Data
Products and Formats
information extraction, in the form of a ‘data product’. This may be in the
form of photographic output for visual processing or in a digital format Data Products are: data
amenable for further computer processing. from various sensors in a
suitable and standard
form and format, which
There are varieties of remote sensing data which are acquired by different
can be readily used by
sensors and satellites. Before reaching to users, the data undergo some user.
processing steps. Requirements of users may vary depending upon their
interests and project objectives, hence there are various remote sensing data
providers/suppliers which prepare variety of data products in different formats.
To order, a data the user should be aware of the types of data products
available with the data agencies/suppliers. Once the data are received by the
users, these need to be changed into a form required to perform image analysis
task. To convert the data into required form, the users should have basic
understanding of the characteristics of different data formats. It would be a
time consuming and difficult task for users to understand all different data and
their formats. Hence, there are some standards which are followed by data
centers/suppliers with regard to the data products and formats for sharing with
a variety of users.
Remote sensing data products are generated in certain ‘data formats’ about
which the users must be aware of, for various practical reasons. Pre-processed
remote sensing data are generated into a number of products, like hardcopy
prints on various types of papers, digital data on various types of computer
compatible media, like tapes, compact discs (CDs), DVDs, and various other
computer compatible storage devices. If the data product is in hard copy print
then it is impossible to carry out any further processing or conversion before
use. But if the product is in digital form, it may be possible to convert the data
into a processed digital image. It may be further required to carry out certain
processing before any image analysis operation is performed. Types of data
products may vary from country to country and/or from one data provider to
another. Here, an account is given about the various data products made
available in India to users by the National Data Center (NDC) of National
Remote Sensing Centre (NRSC) of the Indian Space Research Organisation
(ISRO), situated at Hyderabad.
Fig. 6.2: A sample piece from Index chart of IRS-1C. You can see in map that the
Lucknow city is covered in the data having Path-100 and Row-53
Fig. 6.3: Detailed Indexing Method of IRS-1C LISS III and PAN data products
c) Derived Products
Information extracted from remote sensing data is also provided as useful
products by data providers. For example, vegetation index map or sea surface
temperature profiles extracted from various remote sensing data products are
called derived products. These derived products are generated by further
processing /analysing the data, and are readily usable by the user. Based on
output media, data products are available on both photographic as well as
digital media. Photographic products can be supplied as films or prints. Output
products can vary from 1:1 million to 1:50000 or even to 1:25000. The
following table gives detailed information on the type of product available for
various sensors of IRS series of satellites. The table is reproduced from the
content of NRSC website (www.nrsc.gov.in/products.html).
3 Full Scenes with Shift-Along Track PAN & WIFS from LISS-III; AWIFS
from LISS-IV; OCM;
5 Geocoded Mapsheet based (15’x 15’) LISS-III, LISS-II, TM, MLA, PLA
45
Concepts of Geospatial Spend Check Your Progress I
Data 5 mins
1) Define data products.
......................................................................................................................
......................................................................................................................
......................................................................................................................
2) From where will you procure the desire remote sensing data?
......................................................................................................................
......................................................................................................................
......................................................................................................................
3) On which factors do the types of remote sensing data products depend?
......................................................................................................................
......................................................................................................................
......................................................................................................................
4) Name the types of value added remote sensing data products.
......................................................................................................................
......................................................................................................................
......................................................................................................................
Raster image data are laid out in a grid format similar to squares on a
checkerboard. These raster cells are assigned gray shades from darkest shade
for zero digital number to the brightest white shade for digital number 127 or
255 or 511 and so on, and comparative grades of dark and white shades are
assigned in between from digital numbers 1-126 or 1-254 or 1-510 and so on.
Image data format can be defined as the sequential arrangement of pixels,
representing a digital image in a computer compatible storage medium, such
as a compact disk (CDs/DVDs).
Similarly, the concept of image data format comes in, with the question of
how to arrange these pixels to achieve optimum level of desired processing
and display. Let us look at the following example, a data file in jpg format is a
compressed file in a small size, say 10MB; whereas, the same file in tiff
format is uncompressed and its size can go up to 100MB. What happens in
these two cases of files is the data transfer is easier with small size file, like a
jpg file than in tiff format.
When the digital data are provided in this format in a CD-ROM or DVD, the
data contain following five files:
a) volume directory file
b) leader file
c) image file
d) trailer file
e) null volume directory file
a) Volume directory file is the first file of the media containing the data
product. It contains information on file format record length, number of
records, etc. This gives information about all subsequent files present in
the medium, viz. number of bands, arrangement of bands, total number
of files, information about processing station, software version used to
process, etc. 49
Concepts of Geospatial b) Leader file is composed of a file descriptor record and three types of data
Data
record types i.e., header, ancillary and annotation. Header contains
information (such as about mission, sensor, processing parameters, etc.
Ancillary information consists about information related to ephemeris,
attitude, calibration, histogram, map projection and ground control points
(GCP’s), for image geometric correction, radiometric calibration data,
etc.
Volume directory file Volume directory file
Fig. 6.7: Physical layout of three band image data (e.g. IRS-1C/1D LISS-3 B2, B3, B4) in
(a) super structure BSQ; (b) Super structure in BIL format. File desc rec refers
to File descriptor record (source: Joseph, 2005)
c) Image file contains the actual raw or processed data as requested by the
user. It consists of file descriptor records giving information regarding
band number, bite per pixel, etc. and image data records. Image data
record contains the video data in band interleaved by line (BIL) format or
band sequential format (BSQ).
d) Trailer file provides information about the mode of reading the file and
contains information about cloud coverage, etc. This file follows the
image data file.
e) Null volume directory file marks the end of logical volume. It is referred
to as ‘null’ because it defines a non-existent (empty) logical volume. File
contains a volume descriptor record.
The data procurer obtains the necessary information from the different files as
required by the remote sensing data processing software to read the data and to
convert it into an image.
Fast Format
Fast format is a comprehensive digital data format that is suitable for Level-2
data products. The physical layout of fast format is shown in Fig. 6.8. In this
50
format, instead of many numbers of files as in the LSGOWG or super Remote Sensing Data
Products and Formats
structured format, only two files are provided in CD-ROM or DVD. The files
provided in this format are as follows:
a) Header file
b) Image file(s)
a) Header file is the first file on each volume, a Read-Me-First file,
contains header data. It is in American Standard Code for Information
Interchange (ASCII) format. The first record is the Administrative Record
which contains information that identifies the product. The second record
is the Radiometric Record, which contains the coefficients needed to
convert the scene digital values. The third record is the Geometric Record
which contains the scene geographic location (e.g., latitude, longitude,
etc) information.
b) Image files are written into CDROM, DAT or DISK in Band Sequential
(BSQ) order i.e., each image file contains one band of image file.
As in the LSGOWG or super structured format, this format also requires the
user to instruct the remote sensing data processing software to read the data
and to convert it into an image.
GeoTiff Format
Presently, there are various data formats (e.g. PGM, GIF, BMP, and TIFF, etc.)
used for storage of raster image data, but they have limitations in cartographic
applications. GeoTIFF is based on the original TIFF (Tagged Image File
Format) format, with additional geographic information. This format does not
require the user to convert the contents of the CD-ROM or DVD into an
image data. In this format remote sensing data is provided in the form of an
image itself. The digital image data has the *.tiff extension. Users can directly
start their image processing and analysis steps. IRS-1C/1D data products are
supplied in GeoTIFF format in CDROM. The details of GeoTIFF format can
be obtained from www.mipl.jpl.nasa.gov/cartlab/geotiff.
53
Concepts of Geospatial Levels of processing (Seventh character): Depending on the accuracy of the
Data
data products, they are categorised under different levels of processing and
these levels of processing vary from country to country (Table 6.3).
Table 6.3: Level of Processing
0 Raw data
1 Radiometrically corrected data
2 Standard product
6 DEM (external)
P Precision
G Georeference
R Precision Georeference
O Ortho rectified (Stereo derived)
M Multi-sensor (P+SX)
The input raw data received at a ground station is converted into a certain
storage format (level 0). There are several remote sensing data processing
levels, which can have different names and nomenclature among remote
sensing operators. The standard products are generated after applying
radiometric and geometric corrections. The raw data recorded at the Earth’s
You will learn about the
source of these errors and station is corrected to various levels of processing at the Data Processing
their correction in Block 4 System (DPS). The most frequently used are the following levels of
Processing and preliminary data processing:
Classification of Remotely
Sensed Images of MGY- 0– raw (primary) data of the imaging equipment;
002 Remote Sensing and
1A – radiometrically corrected and calibrated data;
Image Interpretation
1B – radiometrically corrected and geo-located data;
2A – radiometrically and geometrically corrected data, represented in a map
projection;
The supply of data products to users, in response to their requests, is carried
out at the data processing and product generation and distribution centre. Data
processing and data product generation comprises transferring the raw data
from the medium on which the raw data is recorded to the computer for data
correction and formatting and finally to the required medium–photographic or
digital–and data product quality checking. The remote sensing data provided
to the users should closely represent the geometric and radiometric properties
of the ground scene. However, there exist a number of errors in the raw data
received at the ground station. These errors could be due to the sensor itself,
platform, intervening atmosphere and data transmission and reception system.
Therefore, the distorted image data has to be corrected for a more faithful
representation of the original scene. The data products are produced after
correction for geometric and radiometric errors (correction for atmospheric
effect is usually not carried). The errors can be broadly classified as systematic
and random errors. Systematic errors are those which are constant or can be
modelled so that they can be eliminated by suitable operation on the data (e.g.,
Earth rotation, panoramic distortion, etc.). Random errors are difficult to
eliminate totally e.g., detector, noise, jitter of spacecraft.
54
The levels of processing are followed by products of a higher processing level, Remote Sensing Data
Products and Formats
when additional data is used to get such output products (ground control
points, DEM for ortho-correction, etc.), usually generated for further thematic
processing. Remote sensing products of higher than level 2A processing levels
are usually distributed in popular archive formats (e.g. GeoTIFF) because in
most cases they are georeferenced images and no more specific information
about satellite orbital parameters and attitude at the time of imaging is
required for their further use. The only requirement is that the format (Table
6.4) must contain raster georeference parameters (for example, in form of map
projection description). Lower processing level products are supposed to
contain (and in most cases it is secured) auxiliary information which is used
further to generate higher level products. Unfortunately, there are no general
formats to archive and distribute the lower processing level products, which
can be explained by the uniqueness of satellites, their imaging instruments,
imaging modes, etc. Probably, in future the remote sensing operators will
come to an agreement and offer unified formats to the users.
Table 6.4: Format and size capacity
Format (Eighth character)
5 False color composite paper print
6 Digital data on LGSOWG/Super Structured, Band interleaved (BIL)
7 Digital data on LGSOWG/Super Structured format, Band Sequential (BSQ)
B Fast format
T GeoTIFF (grey)
R GeoTIFF (RGB)
H HDF
Size capacity (Ninth character)
5 1000 mm (only for photographic products)
J 650 MB CD-ROM
V DVD
6.8 ACTIVITY
1) Following is an example of data format in which a 3 band image data of
size 3×3 (i.e. 3 rows and 3 columns) are stored in the BIL format. How
would the image look like after you have converted it into an image?
6.9 SUMMARY
• Remote sensing data are supplied to a variety and number of users for
various applications and information extraction, in the form of a ‘data
product’.
• The data products are made available to users of our country by the
National Data Center (NDC) of National Remote Sensing Center
(NRSC) of the Indian Space Research Organisation (ISRO) located at
Hyderabad.
• Remote sensing image data, stored in data files/image files on magnetic
tapes, compact disks (CDs/DVDs) or other media, consists of only
digital numbers.
• All remote sensing data products carry a specific index number. Remote
sensing data products vary depending on the level of processing, output
media/scale, and area of coverage.
• There are certain standards when the data is supplied as softcopy in
digital form. Digital products are commonly supplied in the following
formats–LGSOWG, Fast Format, GeoTIFF and HDF. NRSC has
prepared a unique product code in a short form that fully describes and
56 takes care of all the specifications of a desired product.
• Image data format can be defined as the sequential arrangement of pixels, Remote Sensing Data
Products and Formats
representing a digital image in a computer compatible storage medium
such as a compact disk (CDs/DVDs).
• Basically there are three types of data formats – Band Interleaved by
Pixel (BIP), Band Interleaved by Line (BIL), and Band Sequential
(BSQ).
• There are two ways to procure remote sensing data- by ordering online or
by sending indents through post to NRSC Data Centre.
Spend
6.10 UNIT END QUESTIONS 30 mins
6.11 REFERENCES
• Joseph, G. (2005), Fundamentals of Remote Sensing. 2nd Ed., University
Press, 488p.
• http://kompeni.net/category/pdf-file.
The above websites were accessed between 15 and 25 June 2011.
6.13 ANSWERS
Check Your Progress I
1) Data Products are: data from various sensors in a suitable and standard
format, which can be readily used by user.
2) Remote sensing data can be procured by ordering from NDC, NRSC
(ISRO) Hyderabad or from some other websites.
3) Types of remote sensing data product depend upon three factors namely
level of processing, output media/scale and area of coverage.
4) Value added products are basically of four types viz.
• Geocoded products
• Merged products, and
• Ortho products
• Template registered products
57
Concepts of Geospatial Check Your Progress II
Data
1) Data format can be defined as the sequential arrangement of pixels,
representing a digital image in a computer compatible storage medium
such as CDs, DVDs, etc.
2) Types of Data Formats: there are three types of data formats namely, BIP,
BIL and BSQ.
3) Null volume directory file marks the end of logical volume. It is referred
to as ‘null’ because it defines a non-existent (empty) logical volume. File
contains a volume descriptor record.
Unit End Questions
1) Your answer should include points covered in sections 6.2, 6.3 and 6.4.
2) You should discuss important points discussed in Tables 6.2, 6.3 and 6.4.
3) You should discuss three basic types of data formats–BIP, BIL and BSQ,
along with certain standards ones where the data are supplied as softcopy
in digital form i.e. LGSOWG, Fast Format, GeoTIFF, HDF.
4) Refer to section 6.7.
58