Improving the accuracy of markerless gait analysis

In people with gait disabilities (i.e., a pattern of walking—or gait—that is not normal), assessing gait speed, stride length, and joint kinematics are essential. Measurement of gait parameters over a period of time is critical to determine treatment effects, predict fall risk in elderly individuals, and plan physiotherapy treatments. In this regard, optoelectronic marker-based three-dimensional motion capture (3DMC)—a gait analysis tool—can accurately measure gait metrics. However, economic and time constraints, coupled with requirements for a large space, extensive equipment, and technical expertise make 3DMC impractical in clinical settings. Alternate methods include inertial measurement unit (IMU)-based motion capture systems and RGB camera-based methods, which can measure gait without reflective markers when equipped with depth sensors. But these have their own drawbacks. IMU-based systems require many IMU sensors to be attached to human body segments, reducing their feasibility, and compared to optoelectronic 3DMC systems, RGB camera-based methods are less accurate in their measurement of kinematic parameters such as lower limb joint angles.

Hence, improved gait analysis systems are needed.

To this end, a team of researchers comprising Dr. Masataka Yamamoto, Mr. Yuto Ishige, and Professor Hiroshi Takemura from the Faculty of Science and Technology, Tokyo University of Science, and Professor Koji Shimatani from the Prefectural University of Hiroshima, Japan, have developed a simple and accurate sensor-fusion method for accurate gait analysis. “We combined information from a small IMU sensor attached to the shoe with estimated information on the bones and joints of the lower limb, obtained by capturing the gait from a single RGB camera,” explains Dr. Yamamoto, the lead author of the study. In a recent article published in Volume 12 of Scientific Reports on October 21, 2022, the researchers have detailed this method and the results they achieved with it.

The team used single RGB camera-based pose estimation by OpenPose (OP) and an IMU sensor on the foot to measure ankle joint kinematics under various gait conditions for sixteen healthy adult men between 21 and 23 years of age who did not have any limitation of physical activity. The participants’ gait parameters and lower limb joint angles during four gait conditions with varying gait speed and foot progression angles were noted using only OP as well combined measurements from OP and the IMUs. The latter was the team’s novel proposed method. Results from these techniques were compared to gait analysis using 3DMC, the current gold standard.

The proposed combination method could measure gait parameters and lower limb joint angles in the sagittal plane (which divides the body into right and left). Moreover, the mean absolute errors of peak ankle joint angles calculated by the combination method were significantly less compared to OP alone in all the four gait conditions. This is a significant development in gait analysis. “Our method has the potential to be used not in medicine and welfare, but also to predict the decline of gait function in healthcare, for training and skill evaluation in gyms and sports facilities, and accurate projection of human movements onto an avatar by integrating with virtual reality systems,” notes Dr. Yamamoto.

With further research, this method can be adapted to clinical settings and a larger demographic.

***

Reference                     

DOI: https://doi.org/10.1038/s41598-022-22246-5

About The Tokyo University of Science
Tokyo University of Science (TUS) is a well-known and respected university, and the largest science-specialized private research university in Japan, with four campuses in central Tokyo and its suburbs and in Hokkaido. Established in 1881, the university has continually contributed to Japan’s development in science through inculcating the love for science in researchers, technicians, and educators.

With a mission of “Creating science and technology for the harmonious development of nature, human beings, and society”, TUS has undertaken a wide range of research from basic to applied science. TUS has embraced a multidisciplinary approach to research and undertaken intensive study in some of today’s most vital fields. TUS is a meritocracy where the best in science is recognized and nurtured. It is the only private university in Japan that has produced a Nobel Prize winner and the only private university in Asia to produce Nobel Prize winners within the natural sciences field.

Website: https://www.tus.ac.jp/en/mediarelations/

About Dr. Masataka Yamamoto from Tokyo University of Science
Dr. Masataka Yamamoto is an Assistant Professor in the Faculty of Science and Technology, Department of Mechanical Engineering, Tokyo University of Science, Japan. His research focus includes rehabilitation, human modeling, and biomechanics in the areas of medical engineering, biomedical engineering, biomaterial science and engineering, medical systems, rehabilitation science and welfare engineering. He earned his Ph.D. from Hiroshima University Graduate School, Division of Engineering, The Department of System Cybernetics in 2018. He has served as a member of The Japan Society of Mechanical Engineers. Dr. Yamamoto has authored about 30 refereed papers and proceedings and another 30 presentations, garnering over 50 citations.

Funding information
This study was supported in part by JSPS KAKENHI under Grant number JP19K20748.