An Open-Set Framework for Robust Hand Gesture Classification

References

[1] J. Cheng et al., “Skeleton-based gesture recognition with learnable paths and signature features,” IEEE Trans. Multimedia, vol. 26, pp. 3951–3961, 2024.

[2] Y. Zhang, C. Cao, J. Cheng, and H. Lu, “EgoGesture: A new dataset and benchmark for egocentric hand gesture recognition,” IEEE Trans. Multimedia, vol. 20, no. 5, pp. 1038–1050, May 2018.

[3] J. Wan et al., “ChaLearn looking at people: IsoGD and conGD largescale RGB-D gesture recognition,” IEEE Trans. Cybern., vol. 52, no. 5, pp. 3422–3433, May 2022.

[4] D. Avola, M. Bernardi, L. Cinque, G. L. Foresti, and C. Massaroni, “Exploiting recurrent neural networks and leap motion controller for the recognition of sign language and semaphoric hand gestures,” IEEE Trans. Multimedia, vol. 21, no. 1, pp. 234–245, Jan. 2019.

[5] S. Sharma and S. Singh, “Vision-based hand gesture recognition using deep learning for the interpretation of sign language,” Expert Syst. with Appl., vol. 182, 2021, Art. no. 115657.

[6] B. Zhou, P.Wang, J.Wan, Y. Liang, and F.Wang, “A unified multimodal deand re-coupling framework for RGB-D motion recognition,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 45, no. 10, pp. 11428–11442, Oct. 2023.

[7] M. M. Damaneh, F. Mohanna, and P. Jafari, “Static hand gesture recognition in sign language based on convolutional neural network with feature extraction method using ORB descriptor and Gabor filter,” Expert Syst. Appl., vol. 211, 2023, Art. no. 118559.

[8] Y. S. Tan, K. M. Lim, and C. P. Lee, “Hand gesture recognition via enhanced densely connected convolutional neural network,” Expert Syst. Appl., vol. 175, 2021, Art. no. 114797.

[9] C. Zhang et al., “Few-shot incremental learning with continually evolved classifiers,” inProc. 2021 IEEE/CVF Conf. Comput. Vis. Pattern Recognit., Jun. 2021, pp. 12455–12464.

[10] D.-W. Zhou et al., “Few-shot class-incremental learning by sampling multi-phase tasks,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 45, no. 11, pp. 12816–12831, Nov. 2023.

[11] Y. Cui, Z. Yu, W. Peng, Q. Tian, and L. Liu, “Rethinking few-shot classincremental learning with open-set hypothesis in hyperbolic geometry,” IEEE Trans. Multimedia, vol. 26, pp. 5897–5910, 2024.

[12] T. Chowdhury et al., “Few-shot class-incremental learning for 3D point cloud objects,” in Proc. Comput. Vis., 2022, pp. 204–220.

[13] Z. Song et al., “Learning with fantasy: Semantic-aware virtual contrastive constraint for few-shot class-incremental learning,” in Proc. 2023 IEEE/CVF Conf. Comput. Vis. Pattern Recognit., Jun. 2023, pp. 24183–24192.

[14] C. Peng et al., “Few-shot class-incremental learning from an open-set perspective,” in Proc. Eur. Conf. Comput. Vis., 2022, pp. 382–397.

[15] D.-W. Zhou et al., “Forward compatible few-shot class-incremental learning,” in Proc. 2022 IEEE/CVF Conf. Comput. Vis. Pattern Recognit., Jun. 2022, pp. 9046–9056.

[16] L. Zhao et al., “Few-shot class-incremental learning via class-aware bilateral distillation,” in Proc. 2023 IEEE/CVF Conf. Comput. Vis. Pattern Recognit., Jun. 2023, pp. 11838–11847.

[17] Y. Cui et al., “Uncertainty-guided semi-supervised few-shot classincremental learning with knowledge distillation,” IEEE Trans. Multimedia, vol. 25, pp. 6422–6435, 2023.

[18] B. Yang et al., “Dynamic support network for few-shot class incremental learning,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 45, no. 3, pp. 2945–2951, Mar. 2023.

[19] C. Xu, L. N. Govindarajan, Y. Zhang, and L. Cheng, “Lie-X: Depth image based articulated object pose estimation, tracking, and action recognition on lie groups,” Int. J. Comput. Vis., vol. 123, no. 3, pp. 454–478, 2017.

[20] X. Zhang and F. Zhang, “Differentiable spatial regression: A novel method for 3D hand pose estimation,” IEEE Trans. Multimedia, vol. 24, pp. 166–176, 2022.

[21] X. Deng et al., “Recurrent 3D hand pose estimation using cascaded poseguided 3D alignments,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 45, no. 1, pp. 932–945, Jan. 2023.

[22] H. Li et al., “Hand gesture recognition enhancement based on spatial fuzzy matching in leap motion,” IEEE Trans. Ind. Inform., vol. 16, no. 3, pp. 1885–1894, Mar. 2020.

[23] M. M. Alam, M. T. Islam, and S. M. Rahman, “Unified learning approach for egocentric hand gesture recognition and fingertip detection,” Pattern Recognit., vol. 121, 2022, Art. no. 108200.

[24] F. Xiong et al., “A2J: Anchor-to-joint regression network for 3D articulated pose estimation from a single depth image,” in Proc. Int. Conf. Comput. Vis., Oct. 2019, pp. 793–802.

[25] Y.-S. Hsiao, J. Sanchez-Riera, T. Lim, K.-L. Hua, and W.-H. Cheng, “Lared: A large RGB-D extensible hand gesture dataset,” in Proc. 5th ACM Multimedia Syst. Conf., New York, NY, USA, 2014, pp. 53–58.

[26] C. Xu et al., “Robust 3D hand detection from a single RGB-D image in unconstrained environments,” Sensors, vol. 20, no. 21, 2020, Art. no. 026520.

[27] N. Pugeault and R. Bowden, “Spelling it out: Real-time asl fingerspelling recognition,” in Proc. 2011 IEEE Int. Conf. Comput. Vis. Workshops, 2011, pp. 1114–1119.

[28] L. Minto, G. Marin, and P. Zanuttigh, “3D hand shape analysis for palm and fingers identification,” in Proc. 11th IEEE Int. Conf. Workshops Autom. Face Gesture Recognit., 2015, pp. 1–6.

[29] P. P. Kumar, P. Vadakkepat, and A. P. Loh, “Hand posture and face recognition using a fuzzy-rough approach,” Int. J. Humanoid Robot., vol. 07, no. 03, pp. 331–356, 2010.

[30] H. Cheng, L. Yang, and Z. Liu, “Survey on 3D hand gesture recognition,” IEEE Trans. Circuits Syst. Video Technol., vol. 26, no. 9, pp. 1659–1673, Sep. 2016.

[31] Z. Yu et al., “Searching multi-rate and multi-modal temporal enhanced networks for gesture recognition,” IEEE Trans. Image Process., vol. 30, pp. 5626–5640, 2021.

[32] C. Wang, Z. Liu, and S.-C. Chan, “Superpixel-based hand gesture recognition with kinect depth camera,” IEEE Trans. Multimedia, vol. 17, no. 1, pp. 29–39, Jan. 2015.

[33] N. H. Dardas and N. D. Georganas, “Real-time hand gesture detection and recognition using bag-of-features and support vector machine techniques,” IEEE Trans. Instrum. Meas., vol. 60, no. 11, pp. 3592–3607, Nov. 2011.

[34] S. P. Priyal and P. K. Bora, “A robust static hand gesture recognition system using geometry based normalizations and Krawtchouk moments,” Pattern Recognit., vol. 46, no. 8, pp. 2202–2219, 2013.

[35] P. K. Pisharady, P. Vadakkepat, and A. P. Loh, “Attention based detection and recognition of hand postures against complex backgrounds,” Int. J. Comput. Vis., vol. 101, no. 3, pp. 403–419, Feb. 2013.

[36] Y. Li, X. Wang, W. Liu, and B. Feng, “Deep attention network for joint hand gesture localization and recognition using static RGB-D images,” Inf. Sci., vol. 441, pp. 66–78, 2018.

[37] A. Bandini and J. Zariffa, “Analysis of the hands in egocentric vision: A survey,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 45, no. 6, pp. 6846–6866, Jun. 2023.

[38] D. Avola et al., “3D hand pose and shape estimation from RGB images for keypoint-based hand gesture recognition,” Pattern Recognit., vol. 129, 2022, Art. no. 108762.

[39] S. Sharma and S. Huang, “An end-to-end framework for unconstrained monocular 3D hand pose estimation,” Pattern Recognit., vol. 115, 2021, Art. no. 107892.

[40] C. Xiao, N. Madapana, and J. Wachs, “One-shot image recognition using prototypical encoders with reduced hubness,” in Proc. 2021 IEEE/CVF Winter Conf. Appl. Comput. Vis., Jan. 2021, pp. 2252–2261.

@article{1715462,
      author = {Prof. B. Venkateswarlu, M. Susmitha, R. Varalakshmi, S K. Muneer, T. Pavan},
      title = {An Open-Set Framework for Robust Hand Gesture Classification},
      journal = {Iconic Research And Engineering Journals},
      year = {2026},
      volume = {9},
      number = {9},
      pages = {2152-2160},
      issn = {2456-8880},
      url = {https://www.irejournals.com/formatedpaper/1715462.pdf},
      abstract = {Hand gesture recognition has become an important component in many modern applications such as human–computer interaction, virtual environments, and sign language interpretation. Most existing gesture recognition systems operate under a closed-set assumption, where the gesture categories used during testing are the same as those present in the training stage. However, this assumption is often unrealistic in real-world environments, where systems may encounter new gesture types or variations that were not previously observed. To overcome this limitation, the concept of open-set hand gesture recognition has gained increasing attention. In an open-set scenario, a recognition system should be capable of identifying known gesture classes while also handling unfamiliar gestures that appear during deployment. This paradigm enables models to adapt to new gesture categories with limited examples and improves their ability to function in dynamic and unconstrained environments. By focusing on the open-set learning framework, this work aims to make gesture recognition systems more flexible, scalable, and suitable for practical real-world applications where the set of possible gestures cannot always be predefined.},
      keywords = {Hand Gesture Recognition, Open-Set Learning, Viewpoint Variation, Joint-based Features, Incremental Learning},
      month = {March},
      doi = {https://doi.org/10.64388/IREV9I9-1715462}
  }