Skip to main navigation Skip to search Skip to main content

Transforming Upper Limb Rehabilitation: Real-Time, Holistic Feedback Using Python and Sensor Fusion

  • Vasantha T. Kini*
  • , Haimanti Basu
  • , Aneesha K. Acharya
  • , S. Meenatchisundaram
  • *Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Over the past decade, Python-based rehabilitation tools have dramatically transformed access to interactive, low-cost therapy by combining powerful technologies such as computer vision, sensor fusion, and intuitive user interfaces. This paper presents the development and evaluation of a novel, holistic real-time hand orientation feedback system which can be used in upper limb rehabilitation. Our implementation uses MediaPipe Holistic, OpenCV, and NumPy to estimate elbow, wrist, index finger, and neck angles from synchronized video feeds, comparing live movements to reference motions. Corrective prompts are generated immediately, enabling responsive guidance and enhanced patient autonomy. Preliminary results show smooth, sinusoidal angle tracking, reliable phase segmentation, and accurate real-time feedback, suggesting high potential for deployment in remote and home-based therapy contexts. Future enhancements include adaptive AI calibration, engaging gamification strategies, and multimodal sensor integration to personalize and optimize rehabilitation further.

Original languageEnglish
Title of host publicationCOSMIC 2025 - 2nd IEEE International Conference on Computing, Semiconductor, Mechatronics, Intelligent Systems and Communications, Conference Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages147-153
Number of pages7
ISBN (Electronic)9798331573645
DOIs
Publication statusPublished - 2025
Event2nd IEEE International Conference on Computing, Semiconductor, Mechatronics, Intelligent Systems and Communications, COSMIC 2025 - Mangalore, India
Duration: 21-11-202522-11-2025

Publication series

NameCOSMIC 2025 - 2nd IEEE International Conference on Computing, Semiconductor, Mechatronics, Intelligent Systems and Communications, Conference Proceedings

Conference

Conference2nd IEEE International Conference on Computing, Semiconductor, Mechatronics, Intelligent Systems and Communications, COSMIC 2025
Country/TerritoryIndia
CityMangalore
Period21-11-2522-11-25

All Science Journal Classification (ASJC) codes

  • Artificial Intelligence
  • Computer Networks and Communications
  • Computer Science Applications
  • Information Systems
  • Electrical and Electronic Engineering
  • Mechanical Engineering

Fingerprint

Dive into the research topics of 'Transforming Upper Limb Rehabilitation: Real-Time, Holistic Feedback Using Python and Sensor Fusion'. Together they form a unique fingerprint.

Cite this