Lower Limb Motion Estimation Using Ultrasound Imaging: A Framework for Assistive Device Control

Mohammad Hassan Jahanandish, Nicholas P. Fey, Kenneth Hoyt

Research output: Contribution to journalArticle

3 Citations (Scopus)

Abstract

Objective: Powered assistive devices need improved control intuitiveness to enhance their clinical adoption. Therefore, the intent of individuals should be identified and the device movement should adhere to it. Skeletal muscles contract synergistically to produce defined lower limb movements, so unique contraction patterns in lower extremity musculature may provide a means of device joint control. Ultrasound (US) imaging enables direct measurement of the local deformation of muscle segments. Hence, the objective of this study was to assess the feasibility of using US to estimate human lower limb movements. Methods: A novel algorithm was developed to calculate US features of the rectus femoris muscle during a non-weight-bearing knee flexion/extension experiment by nine able-bodied subjects. Five US features of the skeletal muscle tissue were studied, namely thickness, angle between aponeuroses, pennation angle, fascicle length, and echogenicity. A multiscale ridge filter was utilized to extract the structures in the image and a random sample consensus (RANSAC) model was used to segment muscle aponeuroses and fascicles. A localization scheme further guided RANSAC to enable tracking in a US image sequence. Gaussian process regression models were trained using segmented features to estimate both knee joint angle and angular velocity. Results: The proposed segmentation-estimation approach could estimate knee joint angle and angular velocity with an average root mean square error value of 7.45° and 0.262 rad/s, respectively. The average processing rate was 3-6 frames/s that is promising toward real-time implementation. Conclusion: Experimental results demonstrate the feasibility of using US to estimate human lower extremity motion. The ability of the algorithm to work in real time may enable the use of US as a neural interface for lower limb applications. Significance: Intuitive intent recognition of human lower extremity movements using wearable US imaging may enable volitional assistive device control and enhance locomotor outcomes for those with mobility impairments.

Original languageEnglish (US)
Article number8606176
Pages (from-to)2505-2514
Number of pages10
JournalIEEE Journal of Biomedical and Health Informatics
Volume23
Issue number6
DOIs
StatePublished - Nov 2019

Fingerprint

Self-Help Devices
Motion estimation
Lower Extremity
Ultrasonography
Ultrasonics
Imaging techniques
Muscle
Muscles
Knee Joint
Skeletal Muscle
Angular velocity
Equipment and Supplies
Bearings (structural)
Quadriceps Muscle
Knee
Joints
Mean square error
Tissue

Keywords

  • Lower-limb assistive robots
  • machine learning
  • motion estimation
  • rehabilitation robotics
  • ultrasound imaging

ASJC Scopus subject areas

  • Biotechnology
  • Computer Science Applications
  • Electrical and Electronic Engineering
  • Health Information Management

Cite this

Lower Limb Motion Estimation Using Ultrasound Imaging : A Framework for Assistive Device Control. / Jahanandish, Mohammad Hassan; Fey, Nicholas P.; Hoyt, Kenneth.

In: IEEE Journal of Biomedical and Health Informatics, Vol. 23, No. 6, 8606176, 11.2019, p. 2505-2514.

Research output: Contribution to journalArticle

@article{8bcab7e3593d418aafc32bc3757bef7b,
title = "Lower Limb Motion Estimation Using Ultrasound Imaging: A Framework for Assistive Device Control",
abstract = "Objective: Powered assistive devices need improved control intuitiveness to enhance their clinical adoption. Therefore, the intent of individuals should be identified and the device movement should adhere to it. Skeletal muscles contract synergistically to produce defined lower limb movements, so unique contraction patterns in lower extremity musculature may provide a means of device joint control. Ultrasound (US) imaging enables direct measurement of the local deformation of muscle segments. Hence, the objective of this study was to assess the feasibility of using US to estimate human lower limb movements. Methods: A novel algorithm was developed to calculate US features of the rectus femoris muscle during a non-weight-bearing knee flexion/extension experiment by nine able-bodied subjects. Five US features of the skeletal muscle tissue were studied, namely thickness, angle between aponeuroses, pennation angle, fascicle length, and echogenicity. A multiscale ridge filter was utilized to extract the structures in the image and a random sample consensus (RANSAC) model was used to segment muscle aponeuroses and fascicles. A localization scheme further guided RANSAC to enable tracking in a US image sequence. Gaussian process regression models were trained using segmented features to estimate both knee joint angle and angular velocity. Results: The proposed segmentation-estimation approach could estimate knee joint angle and angular velocity with an average root mean square error value of 7.45° and 0.262 rad/s, respectively. The average processing rate was 3-6 frames/s that is promising toward real-time implementation. Conclusion: Experimental results demonstrate the feasibility of using US to estimate human lower extremity motion. The ability of the algorithm to work in real time may enable the use of US as a neural interface for lower limb applications. Significance: Intuitive intent recognition of human lower extremity movements using wearable US imaging may enable volitional assistive device control and enhance locomotor outcomes for those with mobility impairments.",
keywords = "Lower-limb assistive robots, machine learning, motion estimation, rehabilitation robotics, ultrasound imaging",
author = "Jahanandish, {Mohammad Hassan} and Fey, {Nicholas P.} and Kenneth Hoyt",
year = "2019",
month = "11",
doi = "10.1109/JBHI.2019.2891997",
language = "English (US)",
volume = "23",
pages = "2505--2514",
journal = "IEEE Journal of Biomedical and Health Informatics",
issn = "2168-2194",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
number = "6",

}

TY - JOUR

T1 - Lower Limb Motion Estimation Using Ultrasound Imaging

T2 - A Framework for Assistive Device Control

AU - Jahanandish, Mohammad Hassan

AU - Fey, Nicholas P.

AU - Hoyt, Kenneth

PY - 2019/11

Y1 - 2019/11

N2 - Objective: Powered assistive devices need improved control intuitiveness to enhance their clinical adoption. Therefore, the intent of individuals should be identified and the device movement should adhere to it. Skeletal muscles contract synergistically to produce defined lower limb movements, so unique contraction patterns in lower extremity musculature may provide a means of device joint control. Ultrasound (US) imaging enables direct measurement of the local deformation of muscle segments. Hence, the objective of this study was to assess the feasibility of using US to estimate human lower limb movements. Methods: A novel algorithm was developed to calculate US features of the rectus femoris muscle during a non-weight-bearing knee flexion/extension experiment by nine able-bodied subjects. Five US features of the skeletal muscle tissue were studied, namely thickness, angle between aponeuroses, pennation angle, fascicle length, and echogenicity. A multiscale ridge filter was utilized to extract the structures in the image and a random sample consensus (RANSAC) model was used to segment muscle aponeuroses and fascicles. A localization scheme further guided RANSAC to enable tracking in a US image sequence. Gaussian process regression models were trained using segmented features to estimate both knee joint angle and angular velocity. Results: The proposed segmentation-estimation approach could estimate knee joint angle and angular velocity with an average root mean square error value of 7.45° and 0.262 rad/s, respectively. The average processing rate was 3-6 frames/s that is promising toward real-time implementation. Conclusion: Experimental results demonstrate the feasibility of using US to estimate human lower extremity motion. The ability of the algorithm to work in real time may enable the use of US as a neural interface for lower limb applications. Significance: Intuitive intent recognition of human lower extremity movements using wearable US imaging may enable volitional assistive device control and enhance locomotor outcomes for those with mobility impairments.

AB - Objective: Powered assistive devices need improved control intuitiveness to enhance their clinical adoption. Therefore, the intent of individuals should be identified and the device movement should adhere to it. Skeletal muscles contract synergistically to produce defined lower limb movements, so unique contraction patterns in lower extremity musculature may provide a means of device joint control. Ultrasound (US) imaging enables direct measurement of the local deformation of muscle segments. Hence, the objective of this study was to assess the feasibility of using US to estimate human lower limb movements. Methods: A novel algorithm was developed to calculate US features of the rectus femoris muscle during a non-weight-bearing knee flexion/extension experiment by nine able-bodied subjects. Five US features of the skeletal muscle tissue were studied, namely thickness, angle between aponeuroses, pennation angle, fascicle length, and echogenicity. A multiscale ridge filter was utilized to extract the structures in the image and a random sample consensus (RANSAC) model was used to segment muscle aponeuroses and fascicles. A localization scheme further guided RANSAC to enable tracking in a US image sequence. Gaussian process regression models were trained using segmented features to estimate both knee joint angle and angular velocity. Results: The proposed segmentation-estimation approach could estimate knee joint angle and angular velocity with an average root mean square error value of 7.45° and 0.262 rad/s, respectively. The average processing rate was 3-6 frames/s that is promising toward real-time implementation. Conclusion: Experimental results demonstrate the feasibility of using US to estimate human lower extremity motion. The ability of the algorithm to work in real time may enable the use of US as a neural interface for lower limb applications. Significance: Intuitive intent recognition of human lower extremity movements using wearable US imaging may enable volitional assistive device control and enhance locomotor outcomes for those with mobility impairments.

KW - Lower-limb assistive robots

KW - machine learning

KW - motion estimation

KW - rehabilitation robotics

KW - ultrasound imaging

UR - http://www.scopus.com/inward/record.url?scp=85070512754&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85070512754&partnerID=8YFLogxK

U2 - 10.1109/JBHI.2019.2891997

DO - 10.1109/JBHI.2019.2891997

M3 - Article

C2 - 30629522

AN - SCOPUS:85070512754

VL - 23

SP - 2505

EP - 2514

JO - IEEE Journal of Biomedical and Health Informatics

JF - IEEE Journal of Biomedical and Health Informatics

SN - 2168-2194

IS - 6

M1 - 8606176

ER -