Character Classification and Actor Recognition in Yakshagana Images Using Machine Learning Techniques and Facial Makeup Pattern Analysis

Yakshagana, a traditional theater form from Karnataka, India, features a unique combination of vibrant costumes, dynamic dance movements, and elaborate facial makeup, making character and actor identification a challenging task for automated systems. This research work presents a novel approach to classify Yakshagana characters into two primary categories, Vaishnava and Shaiva, and to identify the actors performing these characters using advanced machine learning techniques. Our research employs a Cyclic Gated Recurrent Neural Network (Cyclic GRNN) for classification and identification tasks. For character category classification, we integrate YOLOv3 and Faster R-CNN models, achieving an accuracy of 92.85% with YOLOv3 and 88.285% with Faster R-CNN. The categorization is specifically focused on distinguishing between Vaishnava and Shaiva characters. Additionally, for actor name identification, we utilize a RESNET-50 model, attaining a high accuracy of 95.60%. The results demonstrate the efficacy of Cyclic GRNN combined with state-of-the-art object detection and image classification models in accurately recognizing and categorizing Yakshagana characters and actors. This research contributes to the preservation and digital documentation of Yakshagana by providing robust tools for automated identification, thereby facilitating cultural heritage studies and enhancing audience engagement with this traditional art form.