International Peer-Reviewed JournalOpen AccessISSN 2456-8880
irejournals@gmail.com+91-7433024337

Home / Current Issue / Paper 1710278

1710278 Vol 9 · Issue 2 Download Paper

AI Generated Digital Human for Virtual Interactions

C Shalini Bhanupriya K Madhu Kumar A Faiza Siddique Soniya Komal V

Subject area: Science,Engineering and Technology  ·  Area of research: Bengaluru

Abstract

The convergence of artificial intelligence (AI), speech processing, and computer graphics has given rise to digital humans that simulate real-world interactions with remarkable accuracy. This research focuses on the design and development of an AI-generated digital human capable of engaging in natural communication through speech, vision, and expression. Unlike conventional chatbots, this system incorporates multilingual speech-to-text and text-to-speech, a 3D avatar capable of lip synchronization and emotional responses, and a vision module for accessibility support. Built with a modular architecture that integrates Flask, Ollama?s Phi language model, Google Speech Recognition, YOLOv8, and Ready Player Me avatars through Three.js, the system enables virtual interactions that are inclusive, expressive, and human-like. Experimental evaluation indicates significant improvements in conversational engagement, accessibility for visually impaired users, and naturalness of avatar interactions. The proposed system represents a step towards highly interactive digital companions with real-world applicability in education, healthcare, customer support, and assistive technologies.

Keywords

Artificial Intelligence, Digital Human, Human-Computer Interaction, Speech Processing, Multilingual Systems, Accessibility, Virtual Avatar.

References

[1] Allmendinger, K. (2018). The rise of the digital human: Creating realistic virtual characters for interactive applications. Journal of Interactive Media, 12(3), 45-62.

[2] Bailenson, J. N. (2020). Experience on demand: What virtual reality is, how it works, and what it can do. W. W. Norton & Company.

[3] Biocca, F. (1997). The cyborg's dilemma: Progressive embodiment in virtual environments. Journal of Computer-Mediated Communication, 3(2), 1-28.

[4] Bente, G., Rüggeberg, S., Krämer, N., & Eschenburg, F. (2009). The virtual social presence effect: How avatars influence social interaction. International Journal of Human- Computer Studies, 67(9), 773-787.

[5] Blascovich, J., & Bailenson, J. N. (2011). Infinite reality: Avatars, environments, virtual worlds, and the future of epic games. William Morrow.

[6] Chen, M., & Thorson, K. (2021). The uncanny valley revisited: Examining user perception and trust in realistic digital humans. Journal of Virtual Worlds Research, 14(1), 112-130.

[7] De Visser, E. J., Monfort, S. S., McKendrick, R., & Krueger, F. (2016). The effects of a virtual human's social presence and perceived helpfulness on human–robot teaming. Journal of Human-Robot Interaction, 5(2), 5-27.

[8] Gong, E., & Ma, H. (2019). Embodied AI: A review of artificial intelligence and its applications in virtual and augmented reality. IEEE Transactions on Cybernetics, 49(8), 2963- 2975.

[9] Hooi, T. B., & Lim, W. M. (2022). Unveiling the metaverse: A systematic review and research agenda. Journal of Business Research, 148, 252-263.

[10] Jung, E. H., & Yang, S. M. (2023). The ethics of AI-generated digital humans: Privacy, consent, and the challenge of deepfakes. AI & Society, 38(1), 1-17.

[11] Kim, J., & Sundar, S. S. (2022). Why is my virtual human so human? The role of anthropomorphism in user acceptance of virtual assistants. Journal of Computer-Mediated Communication, 27(3), zmac007.

[12] Lee, K. S., & Kim, Y. J. (2021). The impact of digital human avatars on user engagement and purchase intention in virtual commerce. Journal of Retailing and Consumer Services, 63, 102715.

[13] Minsky, M. (2007). The emotion machine: Commonsense thinking, artificial intelligence, and the future of the human mind. Simon and Schuster.

[14] Nakatsu, R., & Tsuruta, S. (2020). Affective computing and human-agent interaction: Designing conversational AI with emotional intelligence. ACM Transactions on Intelligent Systems and Technology, 11(6), 1-21.

[15] Park, C. H., & Kim, J. H. (2018). The effect of avatar realism on social presence and user trust in virtual reality. Computers in Human Behavior, 89, 219-228.

How to cite this paper

C Shalini, Bhanupriya K, Madhu Kumar A, Faiza Siddique, Soniya Komal V "AI Generated Digital Human for Virtual Interactions" Iconic Research And Engineering Journals Volume 9 Issue 2 2025 Page 840-845
C Shalini, Bhanupriya K, Madhu Kumar A, Faiza Siddique, Soniya Komal V "AI Generated Digital Human for Virtual Interactions" Iconic Research And Engineering Journals, vol. 9, no. 2, Aug. 2025
C Shalini, Bhanupriya K, Madhu Kumar A, Faiza Siddique, Soniya Komal V (2025). AI Generated Digital Human for Virtual Interactions. Iconic Research And Engineering Journals, 9(2).
C Shalini, Bhanupriya K, Madhu Kumar A, Faiza Siddique, Soniya Komal V "AI Generated Digital Human for Virtual Interactions" Iconic Research And Engineering Journals, vol. 9, no. 2, Aug. 2025.
@article{1710278,
      author = {C Shalini, Bhanupriya K, Madhu Kumar A, Faiza Siddique, Soniya Komal V},
      title = {AI Generated Digital Human for Virtual Interactions},
      journal = {Iconic Research And Engineering Journals},
      year = {2025},
      volume = {9},
      number = {2},
      pages = {840-845},
      issn = {2456-8880},
      url = {https://www.irejournals.com/formatedpaper/1710278.pdf},
      abstract = {The convergence of artificial intelligence (AI), speech processing, and computer graphics has given rise to digital humans that simulate real-world interactions with remarkable accuracy. This research focuses on the design and development of an AI-generated digital human capable of engaging in natural communication through speech, vision, and expression. Unlike conventional chatbots, this system incorporates multilingual speech-to-text and text-to-speech, a 3D avatar capable of lip synchronization and emotional responses, and a vision module for accessibility support. Built with a modular architecture that integrates Flask, Ollama?s Phi language model, Google Speech Recognition, YOLOv8, and Ready Player Me avatars through Three.js, the system enables virtual interactions that are inclusive, expressive, and human-like. Experimental evaluation indicates significant improvements in conversational engagement, accessibility for visually impaired users, and naturalness of avatar interactions. The proposed system represents a step towards highly interactive digital companions with real-world applicability in education, healthcare, customer support, and assistive technologies.},
      keywords = {Artificial Intelligence, Digital Human, Human-Computer Interaction, Speech Processing, Multilingual Systems, Accessibility, Virtual Avatar.},
      month = {August},
  }