1

5.2 Data Acquiring and Storage

5.2.1Data Generation

Data generates at devices that later on, transfers to the Internet through a gateway. Data generates as
follows:

1. Passive devices data: Data generate at the device or system, following the result of interactions. A
passive device does not have its own power source. An external source helps such a device to generate
and send data.
Examples are an RFID or an ATM debit card. The device may or may not have an associated
microcontroller, memory and transceiver. A contactless card is an example of the former and a label or
barcode is the example of the latter.

2. Active devices data: Data generates at the device or system or following the result of interactions.
An active device has its own power source. Examples are active RFID, streetlight sensor or wireless
sensor node. An active device also has an associated microcontroller, memory and transceiver.

3. Event data: A device can generate data on an event only once. For example, on detection of the traffic
or on dark ambient conditions, which signals the event. The event on darkness communicates a need for
lighting up a group of streetlights.

2
 5.2 Data Acquiring and Storage
5.2.1 Data Generation

4. Device Real Time Data: An ATM generates data and communicates it to the server instatanously through
the internet. This initiates and enables Online Transaction Processing [OLTP] in real time.

5. Event Driven Device Data: A device can generate data on an event only once. Example When an
application seeks the status of the device, then only the device communicate the status.

5.2.2 Data Acquisition

Data acquisition means acquiring data from IoT or M2M devices. The data communicates after the
interactions with a data acquisition system (application). The application interacts and communicates with a
number of devices for acquiring the needed data. The devices send data on demand or at programmed
intervals. Data of devices communicate using the network, transport and security layers. Application
configure the devices for data acquiring.
Example: - An ACVM can be configured to communicate the sales data of machine and other information,
every hour. The ACVM system can be configured to communicate instantaneously in event of fault or in
case requirement of a specific chocolate flavour needs the Fill service
3
 Process of acquiring data from the embedded component devices in the
automobiles for Automotive Components and Predictive Automotive Maintenance
System (ACPAMS) application. [Another example helps in learning the concepts]

Problem: Internet of ACPAMS application—How does an ACPAMS application acquire

data from the embedded devices in the automobile components in a car?

⮚ Solution: A number of components, such as engine control system, axle, steering

system, brake linings, wipers, air conditioners, battery and shockers, need predictive
maintenance. Each component embeds computing hardware, software and interface to a
network in an automobile.
⮚ Each embedded device in the automobile communicates to a central computing system
using the Controller Area Network (CAN) bus. Consolidated data then communicates
thorough the Internet to the ACPAMS center .
⮚ An application at the system, first manages each embedded device. This means it allots
the device ID (address), activates, configures (manages device parameters and settings),
registers, deregisters, attaches and detaches. System gateway software communicates to a 4
service-centre application.
5.2.3 Data Validation
⮚ Data acquired from the devices does not mean that data are correct, meaningful or
consistent.

⮚ Data consistency means within expected range data or as per pattern or data not
corrupted during transmission.

⮚ Therefore, data needs validation checks. Data validation software do the validation
checks on the acquired data.

⮚ Validation software applies logic, rules and semantic annotations. The applications or
services depend on valid data. Then only the analytics, predictions, prescriptions,
diagnosis and decisions can be acceptable.

⮚ An adopted strategy may be filtering out the invalid data at the gateway or at device itself
or controlling the frequency of acquiring or cyclically scheduling the set of devices in
industrial systems.

⮚ Data enriches, aggregates, fuses or compacts at the adaptation layer. 5

5.2.4 Data Categorisation for Storage

Services, business processes and business intelligence use data. Valid, useful and relevant data
can be categorised into three categories for storage—data alone, data as well as results of
processing, only the results of data analytics are stored.

Following are three cases for storage:

1. Data which needs to be repeatedly processed, referenced or audited in future, and therefore, data
alone needs to be stored.

2. Data which needs processing only once, and the results are used at a later time using the
analytics, and both the data and results of processing and analytics are stored- Advantages of this
case are quick visualisation and reports generation without reprocessing. Also the data is
available for reference or auditing in future.

3. Online, real-time or streaming data need to be processed and the results of this processing and
analysis need storage.

Data from large number of devices and sources categorises into a fourth category called Big data. 6
Data is stored in databases at a server or in a data warehouse or on a Cloud as Big data.
5.2.5 Assembly Software for the Events

A device can generate events.

For example, a sensor can generate an event when temperature reaches a preset value
or falls below a threshold. A pressure sensor in a boiler generates an event when
pressure exceeds a critical value which warrants attention.

Each event can be assigned an ID.

A logic value sets or resets for an event state. Logic 1 refers to an event generated but
not yet acted upon. Logic 0 refers to an event generated and acted upon or not yet
generated.

A software component in applications can assemble the events (logic value, event ID
and device ID) and can also add Date time stamp. Events from IoTs and logic-flows
assemble using software.

7
5.2.6 Data Store
A data store is a data repository of a set of objects which integrate into the store. Features of data
store are:

⮚ Objects in a data-store are modeled using Classes which are defined by the database schemas.

⮚ A data store is a general concept. It includes data repositories such as database, relational
database, flat file, spreadsheet, mail server, web server, directory services and Vmware

⮚ A data store may be distributed over multiple nodes. Apache Cassandra is an example of
distributed data store.

⮚ A data store may consist of multiple schemas or may consist of data in only one scheme. Example
of only one scheme data store is a relational database.

8
5.2.7 Data Centre Management

A data centre is a facility which has multiple banks of computers, servers, large memory systems, high
speed network and Internet connectivity.

The centre provides data security and protection using advanced tools, full data backups
along with data recovery, redundant data communication connections and full system
power as well as electricity supply backups.

Large industrial units, banks, railways, airlines and units for whom data are the critical components
use the services of data centres. Data centres also possess a dust free, heating, ventilation and air
conditioning (HVAC), cooling, humidification and dehumidification equipment, pressurisation system
with a physically highly secure environment.

The manager of data centre is responsible for all technical and IT issues, operations of computers
and servers, data entries, data security, data quality control, network quality control and the
management of the services and applications used for data processing.

9
5.2.8 Server Management

Server management means managing services, setup and maintenance of systems of all
types associated with the server. A server needs to serve around the clock.

Server management includes managing the following:

⮚ Short reaction times when the system or network is down

⮚ High security standards by routinely performing system maintenance and updation
⮚ Periodic system updates for state-of-the art setups
⮚ Optimised performance
⮚ Monitoring of all critical services, with SMS and email notifications
⮚ Security of systems and protection
⮚ Maintaining confidentiality and privacy of data
⮚ High degree of security and integrity and effective protection of data, files and databases
at the organisation
⮚ Protection of customer data or enterprise internal documents by attackers which includes
spam mails, unauthorised use of the access to the server, viruses, malwares and worms
⮚ Strict documentation and audit of all activities. 10
5.2.9 Spatial Storage

Spatial storage is storage as spatial database which is optimised to store and

later on receives qureies from the applications.
Like, consider goods with RFID tags. When goods move from one place to another, the
IDs of goods as well as locations are needed in tracking or inventory control applications.

Suppose a digital map is required for parking slots in a city. Spatial data refers to data
which represents objects defined in a geometric space. Points, lines and polygons
are common geometric objects which can be represented in spatial databases. Spatial
database can also represent database for 3D objects, topological coverage, linear
networks, triangular irregular networks and other complex structures.

Additional functionality in spatial databases enables efficient processing.

. Internet communication by RFIDs, ATMs, vehicles, ambulances, traffic lights, streetlights,

waste containers are examples of where spatial database are used
11
5.2.9 Spatial Storage
Spatial database functions optimally for spatial queries. A spatial database can perform
typical SQL queries, such as select statements and performs a wide variety of spatial
operations.
Spatial database has the following features:

⮚ Can perform geometry constructors. For example, creating new geometries

⮚ Can define a shape using the vertices (points or nodes)

⮚ Can perform observer functions using queries which replies specific spatial information
such as location of the centre of a geometric object

⮚ Can perform spatial measurements which mean computing distance between

geometries, lengths of lines, areas of polygons and other parameters

⮚ Can change the existing features to new ones using spatial functions and can predicate
spatial relationships between geometries using true or false type queries. 12
Self-Assessment Exercise

1. List the different types of data which is generated at the devices.

2.What does data acquisition mean? What are the benefits of data acquisition by an application after data
aggregation, compaction or fusion and enrichment of data takes place from a number of devices?

3. What does data validation mean? When does a data acquisition application consider data invalid? How can
an application compensate for the missing or invalid data?

4. How does an application or service support software acquired data of industrial plant machines? Show
diagrammatically the in-between physical cum data-link, adaptation network, transport layers.

5. What do you mean by data store? What are the different schemas for a data store?

6. List the features of a data centre and the activities of a data centre manager.

7. What does server management mean?

8. What does spatial database mean? What are additional data fields that spatial *** data possess?

13
Self-Assessment Exercise

1. List the different types of data which is generated at the devices.

2.What does data acquisition mean? What are the benefits of data acquisition by an application after data
aggregation, compaction or fusion and enrichment of data takes place from a number of devices?

3. What does data validation mean? When does a data acquisition application consider data invalid? How can
an application compensate for the missing or invalid data?

14
4. How does an application or service support software acquired data of
industrial plant machines? Show diagrammatically the in-between physical cum
data-link, adaptation network, transport layers.

15
5. What do you mean by data store? What are the different schemas for a data
store?

6. List the features of a data centre and the activities of a data centre manager.

7. What does server management mean?

8. What does spatial database mean? What are additional data fields that
spatial data possess?

16