🤖 AI Summary
To address the challenges of real-time motion recognition and deviation assessment in remote physical therapy—particularly for edge-device deployment—this paper proposes a lightweight end-to-end action analysis framework. Our method captures human keypoint sequences via smartphone cameras, constructs triangle-angle features for motion representation, and integrates a lightweight supervised model with an enhanced Levenshtein dynamic programming algorithm to achieve frame-level action recognition and fine-grained temporal deviation localization. The key innovation lies in the first integration of triangle-angle features with dynamic sequence matching, enabling millisecond-level, cloud-free inference across full action cycles on edge devices. Experiments demonstrate 92.3% action recognition accuracy and deviation localization error under 0.3 seconds, with stable performance on mainstream mobile platforms. The framework has been validated in real-world remote rehabilitation monitoring scenarios.
📝 Abstract
This work presents an efficient algorithmic framework for real-time identification, classification, and evaluation of human physiotherapy exercises using mobile devices. The proposed method interprets a kinetic movement as a sequence of static poses, which are estimated from camera input using a pose-estimation neural network. Extracted body keypoints are transformed into trigonometric angle-based features and classified with lightweight supervised models to generate frame-level pose predictions and accuracy scores. To recognize full exercise movements and detect deviations from prescribed patterns, we employ a dynamic-programming scheme based on a modified Levenshtein distance algorithm, enabling robust sequence matching and localization of inaccuracies. The system operates entirely on the client side, ensuring scalability and real-time performance. Experimental evaluation demonstrates the effectiveness of the methodology and highlights its applicability to remote physiotherapy supervision and m-health applications.