International Peer-Reviewed Journal•Open Access•ISSN 2456-8880
irejournals@gmail.com•+91-7433024337

Home / Current Issue / Paper 1704643

1704643 Vol 6 · Issue 12 Download Paper

Effective Garbage Data Filtering Algorithm for SNS Big Data Processing by Machine Learning

B. Sravani A. Sharanya M. Akhila G. Swathi

Subject area: Science,Engineering and Technology  ·  Area of research: Machine Learning

Abstract

Recently, as the use of social network services (SNS) increases in modern daily life, the amount of SNS data has become enormous. In addition, more and more efforts are being made to extract different pieces of information by collecting, processing, and analysing large amounts of SNS data. Although various pieces of information can be extracted from SNS data through big data processing, this is a resource-intensive task. Therefore, extracting information from SNS data requires considerable time and material resources. In this paper, we propose a data filtering algorithm that filters out junk data that has no data meaning in SNS data. The proposed algorithm improves the filtering accuracy by iterative learning based on the initial learning data. Experimental results show that the proposed algorithm has a filtering effect of more than 70% on experimental keywords.

Keywords

Social network services, big data, machine learning, iterative learning.

References

[1] J. Qiu, Q. Wu, G. Ding, Y. Xu, S. Feng, “A survey of machine learning for big data processing,” EURASIP J. Adv. Signal Process. vol. 2016, pp. 1-16, 2016.

[2] S. Suthanharan, “Big data classification: Problems and challenges in network intrusion prediction with machine learning,” ACM SIGMETRICS Perf. Eval. Rev. vol. 41, pp. 70-73, 2014. [

[3] O. Jarrah, P. Yoo, S. Muhaidat, G. Karagiannidis, K. Taha, “Efficient Machine Learning for Big Data: A Review,” Big Data Res. vol. 2, pp. 87-93, 2015.

[4] S. Landset, T. Khoshgoftaar, A. Richter, T. Hasanin, “A survey of open source tools for machine learning with big data in the Hadoop ecosystem,” J. Big Data, vol. 2, pp. 1-36, 2015.

[5] E. Xing, Q. Ho, W. Dai, J. Kim, Y. Yu, “Petuum: A New Platform for Distributed Machine Learning on Big Data,” IEEE Trans. Big Data, vol. 1, pp. 49-67, 2015.

[6] M. Chen, Y. Hao, K. Hwang, L. Wang, L. Wang, “Disease Prediction by Machine Learning Over Big Data from Healthcare Communities,” IEEE Access, vol. 5, pp. 8869–8879, 2017.

[7] M. Gunasekaran, V. Vijayakumar, R. Varatharajan, K. Priyan S. Revathi, H. Ching-Hsien, “Machine Learning Based Big Data Processing Framework for Cancer Diagnosis Using Hidden Markov Model and GM Clustering,” Wireless Personal Communications, vol. 102, pp. 2099-2116, 2018.

[8] W. Xiaofei, Z. Yuhua, L. Victor, G. Nadra, J. Tianpeng, “D2D Big Data: Content Deliveries over Wireless Device-to-Device Sharing in Large-Scale Mobile Networks,” IEEE Wireless Communications. vol. 25, pp. 32-38, 2018.

[9] Z. Zhenhua, H. Qing, G. Jing, N. Ming, “A deep learning approach for detecting traffic accidents from social media data,” Transportation Research Part C: Emerging Technologies, vol. 86, pp. 580-596, 2017.

[10] S. Ou; J. Lee, “Implementation of a Spam Message Filtering System using Sentence Similarity Measurements,” KIISE Trans. Comput. Pract. (KTCP), vol. 23, pp. 57-64, 2017.

How to cite this paper

B. Sravani, A. Sharanya, M. Akhila, G. Swathi "Effective Garbage Data Filtering Algorithm for SNS Big Data Processing by Machine Learning" Iconic Research And Engineering Journals Volume 6 Issue 12 2023 Page 350-357
B. Sravani, A. Sharanya, M. Akhila, G. Swathi "Effective Garbage Data Filtering Algorithm for SNS Big Data Processing by Machine Learning" Iconic Research And Engineering Journals, vol. 6, no. 12, Jun. 2023
B. Sravani, A. Sharanya, M. Akhila, G. Swathi (2023). Effective Garbage Data Filtering Algorithm for SNS Big Data Processing by Machine Learning. Iconic Research And Engineering Journals, 6(12).
B. Sravani, A. Sharanya, M. Akhila, G. Swathi "Effective Garbage Data Filtering Algorithm for SNS Big Data Processing by Machine Learning" Iconic Research And Engineering Journals, vol. 6, no. 12, Jun. 2023.
@article{1704643,
      author = {B. Sravani, A. Sharanya, M. Akhila, G. Swathi},
      title = {Effective Garbage Data Filtering Algorithm for SNS Big Data Processing by Machine Learning},
      journal = {Iconic Research And Engineering Journals},
      year = {2023},
      volume = {6},
      number = {12},
      pages = {350-357},
      issn = {2456-8880},
      url = {https://www.irejournals.com/formatedpaper/1704643.pdf},
      abstract = {Recently, as the use of social network services (SNS) increases in modern daily life, the amount of SNS data has become enormous. In addition, more and more efforts are being made to extract different pieces of information by collecting, processing, and analysing large amounts of SNS data. Although various pieces of information can be extracted from SNS data through big data processing, this is a resource-intensive task. Therefore, extracting information from SNS data requires considerable time and material resources. In this paper, we propose a data filtering algorithm that filters out junk data that has no data meaning in SNS data. The proposed algorithm improves the filtering accuracy by iterative learning based on the initial learning data. Experimental results show that the proposed algorithm has a filtering effect of more than 70% on experimental keywords.},
      keywords = {Social network services, big data, machine learning, iterative learning.},
      month = {June},
  }