Introduction: Few 3D modeling approaches have been developed specifically for Adolescent Idiopathic Scoliosis cases to date. Existing solutions still predominantly rely on specialized medical imaging systems that require professional operation. Moreover, these systems tend to involve large-scale devices, which produce primarily 2D postural images. This study aims to develop a mobile-based system for generating three-dimensional human body models from smartphone-captured videos without the intervention of trained technicians, specifically designed for subsequent collection of biomechanical posture data.
Methods: The proposed methodology involves a comprehensive workflow beginning with multi-angle video acquisition around the human torso using standard smartphone cameras. The captured video footage undergoes frame extraction and feature point detection to establish spatial references. The core reconstruction process employs 3D Gaussian Splatting (3DGS) technology for efficient point cloud optimization and surface modeling. To enhance reconstruction accuracy and address inherent ambiguities in human body modeling, the Skinned Multi-Person Linear (SMPL) parametric model is integrated into the pipeline.
Results: Experimental results demonstrate that the 3DGS pipeline achieves 2.1mm Hausdorff Distance (HD) and 6.3mm Chamfer Distance (CD) in surface reconstruction. Compared to conventional posture modeling devices, which typically requires approximately 30 minutes for data acquisition and processing, our smartphone-based approach achieves significant time efficiency, completing the entire workflow (including video capture, analysis, and 3D model generation) in about 10 minutes. This technological advancement demonstrates that high-quality 3D imaging can now be performed outside traditional clinical settings using ubiquitous smartphone devices.
Discussion: Future developments could focus on processing speed optimization while preserving the current accuracy standards.
Conclusion: The system's primary advantages lie in its mobile compatibility, offering significant improvements in accessibility and operational efficiency. Notably, the solution provides a considerable reduction in both time and equipment costs, a variety of portable operation in normal settings and real-time processing capabilities.