Scribd
Upload
39 views

Effectively Error Detection On Cloud by Using Time Efficient Technique

This summarizes a research article that proposes a novel error detection approach for big sensor data stored on cloud computing platforms. It aims to minimize the time required for error detection and location in large sensor data sets. The approach uses clustering to partition the large data sets before running error detection algorithms on the cloud. This allows errors to be detected and located more quickly compared to analyzing the entire large data set as a whole.

Uploaded by

Kumara S
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
39 views

Effectively Error Detection On Cloud by Using Time Efficient Technique

This summarizes a research article that proposes a novel error detection approach for big sensor data stored on cloud computing platforms. It aims to minimize the time required for error detection and location in large sensor data sets. The approach uses clustering to partition the large data sets before running error detection algorithms on the cloud. This allows errors to be detected and located more quickly compared to analyzing the entire large data set as a whole.

Uploaded by

Kumara S
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 3

International Journal of Computer Science Trends and Technology (IJCS T) – Volume 4 Issue 5, Sep - Oct 2016

RESEARCH ARTICLE OPEN ACCESS

Effectively Error Detection on Cloud by using Time Efficient


Technique
Vishakha Dattatraya Bajad
M.E (Computer)
Savitaribai Phule University, MESCOE
Pune –India

ABSTRACT
Big sensor data is huge amount of data in both industry and scientific research application in which it generate
high quantity of data. Cloud computing provides a special platform to support this challenge as it provides a
flexible massive data, storage, and different software services in a scalable manner at low cost. Different
technique has been developing in recent years for processing sensor data on cloud, such as sensor-cloud. But,
these techniques do not provide efficient support on fast detection and lo cating of errors in big sensor data. For
faster error detection in big sensor data sets, in this system, it develop a novel data error detection approach
which gives the full feature of cloud platform and the network feature of Wireless sensor network(WSN).
Firstly, it classifies a set of sensor data error types and then defined it. Specifically, in proposed system, the
error detection is based on the scale-free network topology and most of detection operations can be conducted
in clustered form not a whole big data set.
Keywords :- Big data, data abnormality, time efficiency, sensor networks, complex network systems .

big data sets of complex network systems, such as


I. INTRODUCTION WSN on cloud. In Section IV, based on the
Big data is a collection of data sets so large and proposed schema of given system which mainly
complex that it becomes difficult to process with include different approaches for the error detection
on hand database management systems. One of in big sensor data with cloud Computing. Section V,
it conclude the research contributions of this paper.
important source for scientific big data is the data
sets collected by wireless sensor networks (WSN).
For WSN application to get an appropriate result, it
II. LITERATURE REVIEW
is necessary that the data received is clean,
accurate, and lossless. Effective detection and Errors classification is mainly based on
cleaning of sensor big data errors is a challenging different algorithm which were using in error
issue. Develop a novel error detection approach by detection process. In the given system different
exploiting the massive storage, scalability and error classification algorithms are used which gives
computation power of cloud to detect errors in big the textual as well as numeric error [4]. Textual
data sets from sensor networks. Time efficient error is nothing but missing values. In which
approach provides fast detection and locating of commonly occurring error scenario analysis is
errors in big sensor data with error correction, big done. Different error pattern are categorized in it.
data cleaning and recovery technique. It represents Using the different Classification methods it is easy
the progress of the human cognitive processes, to find out the exact type of error and according to
usually it includes data sets with sizes beyond the that its location [1][2][3]. After finding the error
ability of current technology, method and theory to and its location data cleaning process is carried out
capture, manage, and process the data within a using this corrupted files are recover easily.
tolerable elapsed time Big data has typical There are different challenges in wireless
characteristics of five ‘V’s, volume, variety, sensor network but the main challenge is it the
velocity, veracity and value. Using the different source to the high volume of big data set but th e
time efficient technique it i.e. easy to find out and incoming data must be clear[1][2]. Wireless sensor
locate the errors on big data set for this reason the network contain the low cost low-energy operating
system uses a scale free network topology for constraints of such applications. A wireless sensor
better efficiency and faster process. network is inherently vulnerable to different
The reminder of this paper is organized as sources of transient failures. A Novel data error
follows. In Section II, it gives the Literature review detection technique is also developed for data
of big data. In Section III, related work and processing optimization [3][5].The experiment
analysis provided for differentiating error types in

ISSN: 2347-8578 www.ijcstjournal.org Page 28


International Journal of Computer Science Trends and Technology (IJCST) – Volume 4 Issue 5, Sep - Oct 2016

results demonstrate that significant performance This system aims to develop a novel error
gains in term of spatiotemporal compression and detection approach for the big data storage,
scheduling which gives compress data size and data scalability and computation power of cloud to
fidelity loss properties of sensor data network to detect and locate the errors in big data sets from
remove any overhead on the sensor nodes, at the sensor networks.
expense of primary buffer requirements at the data
aggregator nodes, which are much less cost/energy
constrained.
Processing big graph data on Cloud it is IV. PROPOSED SYSTEM
costly. Managing big graph data gives complex and
In proposed approach, error detection is
multiple iterations that introduce challenges such as
conducted in limited time period on big data set.
parallel memory bottlenecks, deadlocks, and
Clustering is done over the big data. It does not
challenges, the system propose a [3]Novel
consider the whole data set instead it uses
technique for effectively managing big graph data
clustering. Therefore the error detection and
on Cloud. Mainly, the big data will be compressed
location process can be done fast. Furthermore the
with its spatiotemporal features on Cloud. By
system uses the User define cloud known as U-
exploring spatial data correlation, the system
cloud. Proposed system can easily minimize the
introduces partition a graph data sets into clusters.
time for error detection and location in big data sets
In a cluster,[4] the workload can be partition by the
generated by large scale sensor network systems
inference based on time series similarity. By
with properly defined error detection accuracy.
introducing temporal correlation, in each time
series or a single graph edge, temporal data
compression is performing.

III. RELATED WORK


To address various challenges of big data,
research works can be found intensively from the
various papers [1], [2], [3]. However, the problem
can be also discussed from the perspective of
parallel systems and cloud [6], [8]. In this section,
Fig. Clustering on Big Data set
related work for big data set processing on cloud
platform, and data error detection and location
In order to effectively deploy proposed algorithm
analysis for complex network systems will be
on cloud, it is necessary to partition the data set
reviewed and compared. There are different types
before feeding to the algorithm on cloud. There are
of work done on the big data set using different
two points should be mentioned when carrying out
types of classification algorithm.In big data set a
partitioning. Firstly, the partition process could not
complex network is represented on which error
bring new data errors into a data set or change and
detection algorithm is applied. The error detection
influence the original errors in a data set.
algorithm firstly analysis whole big data set then it
filters out it. Clustering process is done on given
V. FLOW OF THE SYSTEM
big data set. Clustering can significantly reduce the
time and cost for detecting errors and finds the
That is different to the previous partition
exact location of error on given data set. Efficiently algorithm which normally divides data set
locate the error on big data set and then after according certain application preference or
recover the corrupted files. This is the overall
clustering principles. Secondly, due to the scale-
process using these errors detection strategies are free network systems being a special topology, the
done and find the errors and locate it using partition has to form the data clusters according to
different time efficient technique.

ISSN: 2347-8578 www.ijcstjournal.org Page 29


International Journal of Computer Science Trends and Technology (IJCST) – Volume 4 Issue 5, Sep - Oct 2016

the real world situation of scale free network or effectively recover the corrupted file to avoid loss
Cluster-head based WSN. of data.

REFERENCES

[1] D.J. Wang, X. Shi, D.A. Mcfarland, and J.


Leskovec, “Measuremen Error in Network
Data: A Re-Classification,” Social Networks,
vol. 34, no. 4, pp. 396-409, Oct. 2012.

[2] S. Slijepcevic, S. Megerian, and M.


Potkonjak, “Charaterization of Lacation
Error in Wireless Sensor Networks: Analysis
and Application,” Proc. the Second Int’l
Conf. Information Processing in Sensor
Fig. Architecture diagram Networks (IPSN’03), pp. 593-608, 2003.

 In fig. there is a complex network and [3] A. Sheth, C. Hartung, and Richard Han, “A
cloud platform for running error detecting Decentralized Fault Diagnosis System
algorithms. for Wireless Sensor Netowrks,” Proc.
IEESecond Conf. Mobile Ad-hoc and Sensor
 The error detection algorithm needs to Systems (MASS ’05), Nov. 2005.
filter the whole big data set from the
network.
[4] M.M.H. Khan, H.H.K. Le, H. Ahmadi, T.F.
 Clustering is done on given big data set. It Abdelzaher, and J. Han, “Dustminer:
significantly reduce the time and cost. Troubleshooting Interactive Complexity
Bugs in Sensor Networks,” Proc. ACM Sixth
 Efficiently locate the error and corrupted Conf. Embedded Network Sensor Systems
files are recovered. (SenSys ‘08), pp. 99-112, 2008.
For this Map reduce function is used to map the
error and give its exact location on cloud
[5] X. Zhang, T. Yang, C. Liu, and J. Chen, “A
Scalable Two-Phase Top-Down
V. CONCLUSION
Specialization Approach for Data
In order to detect and find the location of Anonymization Using Systems, in
error in big data set mainly uses a sensor network MapReduc on Cloud,” IEEE Trans. Parallel
systems, a novel approach is developed with cloud and Distributed, vol. 25, no. 2, pp. 363-373,
computing. Firstly the classification of error in big Feb. 2014
data sets is presented. Secondly, the correlation and
comparison between sensor network systems and [6] N. Laptev, K. Zeng, and C. Zaniolo, “Very
the scale-free complex networks are introduced. Fast Estimation for Result and Accuracy of
According to each define error type and the Big Data Analytics: The EARL System,”
features from scale-free networks, the system Proc. IEEE 29th Int’l Conf. Data Eng.
proposed different error detection strategies for (ICDE), pp. 1296-1299, 2013.
detecting and locating errors in big data sets on
cloud. All the process of error detection is [7] J. R. Pansare and V. D. Bajad , “Errors
conducted over the User defined cloud i.e. U-cloud. Detection in Big Sensor Data on Cloud
The significance for the system is: 1It gives the fast using Time Efficient Technique.”
error detection and locating using time efficient http://dl.acm.org/citation.cfm?id=2909071&
approach and 2) after error detection process done dl=ACM&coll=DL&CFID=664730537&CF
TOKEN=123717

ISSN: 2347-8578 www.ijcstjournal.org Page 30

You might also like