Managing Sensor Data Using MapReduce

References

[1] K. Aberer, G. Alonso, and D. Kossmann, "Data Management for a Smart Earth - The Swiss NCCR-MICS initiative", SIGMOD Record, Vol. 35, No. 4, pp. 40-45.

[2] K. Aberer, M. Hauswirth, and A. Salehi, "Infrastructure for Data Processing in Large-Scale Interconnected Sensor Networks", 2007 International Conference on Mobile Data Management, pp. 10-11. 198-205, May.

[3] C. Jardak, J. Riihijärvi, and P. Mähönen, "Extremely Large-Scale Sensing Applications for Planetary WSNs," In Proceedings of the 2nd ACM International Workshop on Hot Topics in Planetary-Scale Measurement, pp. 10-11. 1-6, June.

[4] K. Aberer, G. Alonso, and D. Kossmann, "Data Management for a Smart Earth", SIGMOD Record, Vol. 35, No. 4, pp. 40-45.

[5] B. Hayes, "Cloud Computing", Communications of The ACM, Vol. 51, No. 7, pp. 9-11, July.

[6] I. Foster, Y. Zhao, I. Raicu, and S. Lu, "Cloud computing and Grid Computing 360-Degree Compared", Grid Computing Environment Workshop(GCE'08), pp. 1-10, Nov.

[7] R. Buyya, C. S. Yeo, and S. Venugopal, "Market-Oriented Cloud Computing: Vision, Hype, and Reality for Delivering IT Services as Computing Utilities", Proceedings of the 2008 10th IEEE International Conference on High Performance Computing and Communications, pp. 5-13.

[8] J. Dean and S. Ghemawat, "Mapreduce: Simplified Data Processing on Large Clusters", In OSDI'04: 6th Symposium on Operating System Design and Implementation, December.

[9] S. Manakkadu, S. P. Joshi, T. Halverson, and S. Dutta. "Top-k User-Based Collaborative Recommendation System Using MapReduce." In 2021 IEEE International Conference on Big Data (Big Data), pp. 4021-4025. IEEE, 2021.

[10] I. Hwang, K. Jung, . Im, and J. Lee, "Improving the Map/Reduce Model through Data Distribution and Task Progress Scheduling," Journal of the Korea Contents Association, Vol.10, No.10, pp.78-85.

[11] H.-C. Yang, A. Dasdan, R.-L. Hsiao, and D. S. Parker, "Map-Reduce-Merge: Simplified Relational Data Processing on Large Clusters," Proc. of the ACM SIGMOD International Conference on Management of Data.

[12] S. Ghemawat, H. Gobioff, and S. Leung. "The Google File System," Proc. of ACM Symposium on Operating Systems Principles, pp.29-43.

[13] H. Zhao, S. Yang, Z. Chen, S. Jin, H. Yin, and L. Li, "MapReduce Model-Based Optimization of Range Queries," Proc. of the International Conference on Fuzzy Systems and Knowledge Discovery(FSKD '12), pp.2487-2492.

[14] H. Liu and D. Orban, "GridBatch: Cloud Computing for Large-Scale Data-Intensive Batch Applications", Proc. 8th IEEE International Symposium on Cluster Computing and the Grid (CCGRID'08), pp. 295 305, May.

[15] C. Vecchiola, S. Pandey, and R. Buyya, "High-Performance Cloud Computing: A View of Scientific Applications", 2009 10th International Symposium on Pervasive Systems, Algorithms, and Networks, pp. 4-16.

[16] V. Rajesh, J. M. Gnanasekar, R. S. Ponmagal, and P. Anbalagan, "Integration of Wireless Sensor Network with Cloud", 2010 International Conference on Recent Trends in Information, Telecommunication and Computing, pp. 321-323.

[17] M. Hassan, B. Song, and E. Huh, "A Framework of Sensor-cloud Integration Opportunities and Challenges", Conference On Ubiquitous Information Management And Communication, pp. 618-626.

[18] X. Lee, S. Lee, PT True, LT Vinh, AM Khattak, M. Han, DV Hung, MM Hassan, M. Kim, K. Koo, Y. Lee, and E. Huh, "Secured WSN -integrated cloud computing for u-life care", In Proceedings of the 7th IEEE Conference on Consumer Communications and Networking Conference, pp. 702-703, Jan.

[19] Hadoop: http:/ /hadoop.apache.org

[20] HBase: http://hadoop.apache.org/hbase

@article{1703546,
      author = {Rohit Gangpa, Kung wu Park, Kung O. Kim},
      title = {Managing Sensor Data Using MapReduce},
      journal = {Iconic Research And Engineering Journals},
      year = {2022},
      volume = {5},
      number = {12},
      pages = {267-271},
      issn = {2456-8880},
      url = {https://www.irejournals.com/formatedpaper/1703546.pdf},
      abstract = {Recently, as the construction of a large-scale sensor network increases, a system for efficiently managing large-scale sensor data is required. In this paper, we propose a cloud-based sensor data management system with low cost, high scalability, and high efficiency. In the proposed system, sensor data is transmitted to the cloud through the cloud gateway, and abnormal situation detection and event processing are performed at this time. The sensor data sent to the cloud is stored in Hadoop HBase, a distributed column-oriented database, and processed in parallel through the MapReduce model-based query processing module. As the processed result is provided through REST-based web service, it can be linked with application programs of various platforms.},
      keywords = {sensor data management, cloud computing, hadoop, hbase, mapreduce.},
      month = {June},
  }