Human Vs AI Summaries of Exploratory Data Analysis: Trust, Accuracy, And Decision Impact

• Author(s): Sai Lalitesh Pothukuchi
• Paper ID: 1716723
• Page: 1063-1077
• Published Date: 31-05-2023
• Published In: Iconic Research And Engineering Journals
• Publisher: IRE Journals
• e-ISSN: 2456-8880
• Volume/Issue: Volume 6 Issue 11 May-2023

Abstract

The recent progress of artificial intelligence has dramatically changed the environment of data analysis, especially with the introduction of large language models (LLMs) into the process of analysis. Such systems are also becoming able to produce automated summaries of Exploratory Data Analysis (EDA) output and can give narrative explanations of statistical trends, correlations, and anomalies in datasets. With the use of AI-assisted analytics in organizations to enhance efficiency and scalability, concerns have arisen as to the relative reliability and interpretability of summaries prepared by human analysts compared to summaries prepared by AI systems. Recent studies point to the increased role of the analytical tools based on LLM in scientific research, business-level, as well as decision-support settings, both in terms of their transformative power and obstacles to the implementation of such tools in the context of a critical decision-making process (Mienye et al., 2025; Mishra et al., 2024). The paper analyzes the relative features of EDA summaries produced by human analysts and those produced by the LLM, in terms of four dimensions of evaluation, including factual accuracy, analytical completeness, expression of uncertainty, and perceived analytical trustworthiness. The construction of EDA narratives is usually based on domain knowledge, the reasoning of contexts, and interpretive judgment by human analysts, but the construction of EDA narratives based on probabilistic language generation and pattern recognition is based on massive amounts of training data by the systems that are built using the LLM. Though AI-based summaries have their benefits in terms of speed and scalability, their interpretive accuracy and the capacity to make reasonable statements about uncertainty are still on a scholarly research agenda. In addition to correctness in the analysis, the research additionally reviews the way such differences affect the way stakeholders make decisions. The summaries of EDA can be used as a formal linkage between complicated data and strategic actions by managers, policy makers, and other parties involved. As a consequence, misinterpretation or decision bias, or lack of uncertainty in summaries due to inaccuracies, incomplete interpretations, or poor communication of that uncertainty, can occur. The current body of research on AI-driven decision systems states that AI analytics integration can have a significant effect on the quality of decisions, organizational trust in automated systems, and user confidence calibration in the outputs of analytical systems (Guan et al., 2022). This article, by exploring the interaction between human analytical thinking and AI-generated narrative summaries, contributes to the wider debate on an ethical introduction of AI in the data-driven decision-making sphere. Particularly, the paper identifies the benefits and disadvantages of both methods of analysis and explains how the hybrid human-AI work processes can enhance the reliability, openness, and credibility of the EDA-based decision support. The results will be used to guide the development of stronger analytical models that will match the speed at which AI systems can compute with the ability of human analysts in their context.

Keywords

Exploratory Data Analysis (EDA) Summarization, Large Language Models (LLMs), Human–AI Analytical Comparison, Decision Support Systems, Analytical Trust and Reliability, Uncertainty Communication in Data Analysis, Stakeholder Decision Impact

Citations

IRE Journals:
Sai Lalitesh Pothukuchi "Human Vs AI Summaries of Exploratory Data Analysis: Trust, Accuracy, And Decision Impact" Iconic Research And Engineering Journals Volume 6 Issue 11 2023 Page 1063-1077 https://doi.org/10.64388/IREV6I11-1716723

IEEE:
Sai Lalitesh Pothukuchi "Human Vs AI Summaries of Exploratory Data Analysis: Trust, Accuracy, And Decision Impact" Iconic Research And Engineering Journals, 6(11) https://doi.org/10.64388/IREV6I11-1716723