Home / Current Issue / Paper 1706740
Deep Learning-Powered Interactive Art: A Framework for Gesture Recognition and Multi-Style Digital Painting using Media Pipe and Tensor Flow
Subject area: Science,Engineering and Technology · Area of research: Machine Vision
Abstract
This paper presents an interactive virtual painting system that utilizes computer vision and hand-tracking technologies to create a natural and intuitive digital art experience. The system employs Media Pipe for real-time hand landmark detection and Open CV for image processing, allowing users to paint on a virtual canvas using hand gestures. The implementation includes features such as color selection, canvas cleaning, and comprehensive analytics of user interactions. Real- time visualization of hand tracking data and movement patterns provides insight into user behavior and system performance. The system demonstrates successful integration of computer vision techniques with interactive graphics, achieving responsive performance with minimal latency. The analytics reveal patterns in user behavior, color preferences, and gesture accuracy, contributing to the understanding of human-computer interaction in the creation of virtual art.
Keywords
Hand tracking, virtual painting, computer vision, gesture recognition, interactive art, MediaPipe, OpenCV, real-time processing, human-computer interaction, digital art creation, machine learning, artificial intelligence, computer graphics, image processing, motion tracking, gesture-based interfaces, visual computing, interactive systems, user experience design, deep learning, neural networks, real-time rendering, 3D visualization, augmented reality, digital media, user interaction analysis, performance optimization, visual analytics, computer-aided art, creative computing
How to cite this paper
@article{1706740,
author = {Sameer Mankotia},
title = {Deep Learning-Powered Interactive Art: A Framework for Gesture Recognition and Multi-Style Digital Painting using Media Pipe and Tensor Flow},
journal = {Iconic Research And Engineering Journals},
year = {2024},
volume = {8},
number = {6},
pages = {508-522},
issn = {2456-8880},
url = {https://www.irejournals.com/formatedpaper/1706740.pdf},
abstract = {This paper presents an interactive virtual painting system that utilizes computer vision and hand-tracking technologies to create a natural and intuitive digital art experience. The system employs Media Pipe for real-time hand landmark detection and Open CV for image processing, allowing users to paint on a virtual canvas using hand gestures. The implementation includes features such as color selection, canvas cleaning, and comprehensive analytics of user interactions. Real- time visualization of hand tracking data and movement patterns provides insight into user behavior and system performance. The system demonstrates successful integration of computer vision techniques with interactive graphics, achieving responsive performance with minimal latency. The analytics reveal patterns in user behavior, color preferences, and gesture accuracy, contributing to the understanding of human-computer interaction in the creation of virtual art.},
keywords = {Hand tracking, virtual painting, computer vision, gesture recognition, interactive art, MediaPipe, OpenCV, real-time processing, human-computer interaction, digital art creation, machine learning, artificial intelligence, computer graphics, image processing, motion tracking, gesture-based interfaces, visual computing, interactive systems, user experience design, deep learning, neural networks, real-time rendering, 3D visualization, augmented reality, digital media, user interaction analysis, performance optimization, visual analytics, computer-aided art, creative computing},
month = {December},
}