-
A Human-Centered Machine-Learning Approach for Muscle-Tendon Junction Tracking in Ultrasound Images
Authors:
Christoph Leitner,
Robert Jarolim,
Bernhard Englmair,
Annika Kruse,
Karen Andrea Lara Hernandez,
Andreas Konrad,
Eric Su,
Jörg Schröttner,
Luke A. Kelly,
Glen A. Lichtwark,
Markus Tilp,
Christian Baumgartner
Abstract:
Biomechanical and clinical gait research observes muscles and tendons in limbs to study their functions and behaviour. Therefore, movements of distinct anatomical landmarks, such as muscle-tendon junctions, are frequently measured. We propose a reliable and time efficient machine-learning approach to track these junctions in ultrasound videos and support clinical biomechanists in gait analysis. In…
▽ More
Biomechanical and clinical gait research observes muscles and tendons in limbs to study their functions and behaviour. Therefore, movements of distinct anatomical landmarks, such as muscle-tendon junctions, are frequently measured. We propose a reliable and time efficient machine-learning approach to track these junctions in ultrasound videos and support clinical biomechanists in gait analysis. In order to facilitate this process, a method based on deep-learning was introduced. We gathered an extensive dataset, covering 3 functional movements, 2 muscles, collected on 123 healthy and 38 impaired subjects with 3 different ultrasound systems, and providing a total of 66864 annotated ultrasound images in our network training. Furthermore, we used data collected across independent laboratories and curated by researchers with varying levels of experience. For the evaluation of our method a diverse test-set was selected that is independently verified by four specialists. We show that our model achieves similar performance scores to the four human specialists in identifying the muscle-tendon junction position. Our method provides time-efficient tracking of muscle-tendon junctions, with prediction times of up to 0.078 seconds per frame (approx. 100 times faster than manual labeling). All our codes, trained models and test-set were made publicly available and our model is provided as a free-to-use online service on https://deepmtj.org/.
△ Less
Submitted 10 February, 2022;
originally announced February 2022.
-
Automatic Tracking of the Muscle Tendon Junction in Healthy and Impaired Subjects using Deep Learning
Authors:
Christoph Leitner,
Robert Jarolim,
Andreas Konrad,
Annika Kruse,
Markus Tilp,
Jörg Schröttner,
Christian Baumgartner
Abstract:
Recording muscle tendon junction displacements during movement, allows separate investigation of the muscle and tendon behaviour, respectively. In order to provide a fully-automatic tracking method, we employ a novel deep learning approach to detect the position of the muscle tendon junction in ultrasound images. We utilize the attention mechanism to enable the network to focus on relevant regions…
▽ More
Recording muscle tendon junction displacements during movement, allows separate investigation of the muscle and tendon behaviour, respectively. In order to provide a fully-automatic tracking method, we employ a novel deep learning approach to detect the position of the muscle tendon junction in ultrasound images. We utilize the attention mechanism to enable the network to focus on relevant regions and to obtain a better interpretation of the results. Our data set consists of a large cohort of 79 healthy subjects and 28 subjects with movement limitations performing passive full range of motion and maximum contraction movements. Our trained network shows robust detection of the muscle tendon junction on a diverse data set of varying quality with a mean absolute error of 2.55$\pm$1 mm. We show that our approach can be applied for various subjects and can be operated in real-time. The complete software package is available for open-source use via: https://github.com/luuleitner/deepMTJ
△ Less
Submitted 5 May, 2020;
originally announced May 2020.
-
Automated quantification of myocardial tissue characteristics from native T1 map** using neural networks with Bayesian inference for uncertainty-based quality-control
Authors:
Esther Puyol Anton,
Bram Ruijsink,
Christian F. Baumgartner,
Matthew Sinclair,
Ender Konukoglu,
Reza Razavi,
Andrew P. King
Abstract:
Tissue characterisation with CMR parametric map** has the potential to detect and quantify both focal and diffuse alterations in myocardial structure not assessable by late gadolinium enhancement. Native T1 map** in particular has shown promise as a useful biomarker to support diagnostic, therapeutic and prognostic decision-making in ischaemic and non-ischaemic cardiomyopathies. Convolutional…
▽ More
Tissue characterisation with CMR parametric map** has the potential to detect and quantify both focal and diffuse alterations in myocardial structure not assessable by late gadolinium enhancement. Native T1 map** in particular has shown promise as a useful biomarker to support diagnostic, therapeutic and prognostic decision-making in ischaemic and non-ischaemic cardiomyopathies. Convolutional neural networks with Bayesian inference are a category of artificial neural networks which model the uncertainty of the network output. This study presents an automated framework for tissue characterisation from native ShMOLLI T1 map** at 1.5T using a Probabilistic Hierarchical Segmentation (PHiSeg) network. In addition, we use the uncertainty information provided by the PHiSeg network in a novel automated quality control (QC) step to identify uncertain T1 values. The PHiSeg network and QC were validated against manual analysis on a cohort of the UK Biobank containing healthy subjects and chronic cardiomyopathy patients. We used the proposed method to obtain reference T1 ranges for the left ventricular myocardium in healthy subjects as well as common clinical cardiac conditions. T1 values computed from automatic and manual segmentations were highly correlated (r=0.97). Bland-Altman analysis showed good agreement between the automated and manual measurements. The average Dice metric was 0.84 for the left ventricular myocardium. The sensitivity of detection of erroneous outputs was 91%. Finally, T1 values were automatically derived from 14,683 CMR exams from the UK Biobank. The proposed pipeline allows for automatic analysis of myocardial native T1 map** and includes a QC process to detect potentially erroneous results. T1 reference values were presented for healthy subjects and common clinical cardiac conditions from the largest cohort to date using T1-map** images.
△ Less
Submitted 31 January, 2020;
originally announced January 2020.
-
Ultrasound in Locomotion Research -- The Quest for Wider Views
Authors:
Christoph Leitner,
Christian Baumgartner,
Christian Peham,
Markus Tilp
Abstract:
In a systematic review, we investigate current applications of ultrasound in locomotion research. Shortcomings in the range of view of ultrasound systems affect the direct validation of musculoskeletal simulations as inverse approaches have to be applied. We present currently used methods to estimate muscle and tendon length in human plantarflexors.
In a systematic review, we investigate current applications of ultrasound in locomotion research. Shortcomings in the range of view of ultrasound systems affect the direct validation of musculoskeletal simulations as inverse approaches have to be applied. We present currently used methods to estimate muscle and tendon length in human plantarflexors.
△ Less
Submitted 18 January, 2020;
originally announced January 2020.