Publication details

REHAB24-6: Physical Therapy Dataset for Analyzing Pose Estimation Methods

Investor logo
Authors

ČERNEK Andrej SEDMIDUBSKÝ Jan BUDÍKOVÁ Petra

Year of publication 2024
Type Article in Proceedings
Conference 17th International Conference on Similarity Search and Applications (SISAP)
MU Faculty or unit

Faculty of Informatics

Citation
Web
Doi http://dx.doi.org/10.1007/978-3-031-75823-2_2
Keywords pose estimation;motion capture;rehabilitation exercise;skeleton body model;kNN retrieval
Description One of the prospective domains in remote healthcare is monitoring home physical rehabilitation using mobile phones and providing patients with real-time feedback on their exercise performance. Assessing such performance involves analyzing the similarity of spatio-temporal features extracted from human motion data. State-of-the-art research provides multiple tools for estimating human motion from mobile camera video streams. However, their applicability to physical therapy monitoring is not sufficiently explored. To address this problem, we introduce a new rehabilitation dataset (REHAB24-6), which provides untrimmed RGB videos, 2D and 3D skeletal ground truth of human motion, and temporal segmentation for six rehabilitation exercises. We also propose a novel pose transformation technique to evaluate existing 2D and 3D pose estimation methods trained on different datasets with distinct body models. Our experiments explore the current limitations of the state-of-the-art, particularly the depth estimation, and offer recommendations for selecting appropriate models. Finally, we propose similarity-based techniques to assess the ability of estimated pose sequences to discern exercise performance and report promising results of current pose detectors for rehabilitation assistance.
Related projects:

You are running an old browser version. We recommend updating your browser to its latest version.

More info