Model-View Sensor Data Management in the Cloud

Infinite nature of sensor data poses a serious challenge for query processing even in a cloud infrastructure. Model-based sensor data approximation reduces the amount of data for query processing, but all modeled segments need to be scanned, in the worst case. In this paper, we propose an innovative index for modeled segments in key-value stores, namely KVI-index. KVI-index has an in-memory tree component and a secondary structure materialized in the key-value store that maps the tree nodes to the modeled data segments. Then, we introduce a KVI-index-Scan-MapReduce hybrid approach to perform efficient query processing. As proved by a series of experiments in a real private cloud infrastructure, our approach outperforms in query response time and index updating efficiency both Hadoop-based parallel processing of the raw sensor data and multiple alternative indexing approaches of model-view data.

Published in:
Proceedings of IEEE International Conference on Big Data 2013 (IEEE BigData 2013)
Presented at:
IEEE International Conference on Big Data 2013 (IEEE BigData 2013), Santa Clara, California, USA, October, 6-9,2013

 Record created 2013-11-14, last modified 2019-03-16

Download fulltext

Rate this document:

Rate this document:
(Not yet reviewed)