-
High-resolution segmentations of the hypothalamus and its subregions for training of segmentation models
Authors:
Livia Rodrigues,
Martina Bocchetta,
Oula Puonti,
Douglas Greve,
Ana Carolina Londe,
Marcondes França,
Simone Appenzeller,
Leticia Rittner,
Juan Eugenio Iglesias
Abstract:
Segmentation of brain structures on magnetic resonance imaging (MRI) is a highly relevant neuroimaging topic, as it is a prerequisite for different analyses such as volumetry or shape analysis. Automated segmentation facilitates the study of brain structures in larger cohorts when compared with manual segmentation, which is time-consuming. However, the development of most automated methods relies…
▽ More
Segmentation of brain structures on magnetic resonance imaging (MRI) is a highly relevant neuroimaging topic, as it is a prerequisite for different analyses such as volumetry or shape analysis. Automated segmentation facilitates the study of brain structures in larger cohorts when compared with manual segmentation, which is time-consuming. However, the development of most automated methods relies on large and manually annotated datasets, which limits the generalizability of these methods. Recently, new techniques using synthetic images have emerged, reducing the need for manual annotation. Here we provide HELM, Hypothalamic ex vivo Label Maps, a dataset composed of label maps built from publicly available ultra-high resolution ex vivo MRI from 10 whole hemispheres, which can be used to develop segmentation methods using synthetic data. The label maps are obtained with a combination of manual labels for the hypothalamic regions and automated segmentations for the rest of the brain, and mirrored to simulate entire brains. We also provide the pre-processed ex vivo scans, as this dataset can support future projects to include other structures after these are manually segmented.
△ Less
Submitted 27 June, 2024;
originally announced June 2024.
-
H-SynEx: Using synthetic images and ultra-high resolution ex vivo MRI for hypothalamus subregion segmentation
Authors:
Livia Rodrigues,
Martina Bocchetta,
Oula Puonti,
Douglas Greve,
Ana Carolina Londe,
Marcondes França,
Simone Appenzeller,
Juan Eugenio Iglesias,
Leticia Rittner
Abstract:
The hypothalamus is a small structure located in the center of the brain and is involved in significant functions such as slee**, temperature, and appetite control. Various neurological disorders are also associated with hypothalamic abnormalities. Automated image analysis of this structure from brain MRI is thus highly desirable to study the hypothalamus in vivo. However, most automated segment…
▽ More
The hypothalamus is a small structure located in the center of the brain and is involved in significant functions such as slee**, temperature, and appetite control. Various neurological disorders are also associated with hypothalamic abnormalities. Automated image analysis of this structure from brain MRI is thus highly desirable to study the hypothalamus in vivo. However, most automated segmentation tools currently available focus exclusively on T1w images. In this study, we introduce H-SynEx, a machine learning method for automated segmentation of hypothalamic subregions that generalizes across different MRI sequences and resolutions without retraining. H-synEx was trained with synthetic images built from label maps derived from ultra-high resolution ex vivo MRI scans, which enables finer-grained manual segmentation when compared with 1mm isometric in vivo images. We validated our method using Dice Coefficient (DSC) and Average Hausdorff distance (AVD) across in vivo images from six different datasets with six different MRI sequences (T1, T2, proton density, quantitative T1, fractional anisotrophy, and FLAIR). Statistical analysis compared hypothalamic subregion volumes in controls, Alzheimer's disease (AD), and behavioral variant frontotemporal dementia (bvFTD) subjects using the Area Under the Receiving Operating Characteristic curve (AUROC) and Wilcoxon rank sum test. Our results show that H-SynEx successfully leverages information from ultra-high resolution scans to segment in vivo from different MRI sequences. Our automated segmentation was able to discriminate controls versus Alzheimer's Disease patients on FLAIR images with 5mm spacing. H-SynEx is openly available at https://github.com/liviamarodrigues/hsynex.
△ Less
Submitted 1 July, 2024; v1 submitted 30 January, 2024;
originally announced January 2024.
-
Optimal Observer Design Using Reinforcement Learning and Quadratic Neural Networks
Authors:
Soroush Asri,
Luis Rodrigues
Abstract:
This paper introduces an innovative approach based on policy iteration (PI), a reinforcement learning (RL) algorithm, to obtain an optimal observer with a quadratic cost function. This observer is designed for systems with a given linearized model and a stabilizing Luenberger observer gain. We utilize two-layer quadratic neural networks (QNN) for policy evaluation and derive a linear correction te…
▽ More
This paper introduces an innovative approach based on policy iteration (PI), a reinforcement learning (RL) algorithm, to obtain an optimal observer with a quadratic cost function. This observer is designed for systems with a given linearized model and a stabilizing Luenberger observer gain. We utilize two-layer quadratic neural networks (QNN) for policy evaluation and derive a linear correction term using the input and output data. This correction term effectively rectifies inaccuracies introduced by the linearized model employed within the observer design. A unique feature of the proposed methodology is that the QNN is trained through convex optimization. The main advantage is that the QNN's input-output map** has an analytical expression as a quadratic form, which can then be used to obtain a linear correction term policy. This is in stark contrast to the available techniques in the literature that must train a second neural network to obtain policy improvement. It is proven that the obtained linear correction term is optimal for linear systems, as both the value function and the QNN's input-output map** are quadratic. The proposed method is applied to a simple pendulum, demonstrating an enhanced correction term policy compared to relying solely on the linearized model. This shows its promise for addressing nonlinear systems.
△ Less
Submitted 27 November, 2023;
originally announced November 2023.
-
Data-Driven LQR using Reinforcement Learning and Quadratic Neural Networks
Authors:
Soroush Asri,
Luis Rodrigues
Abstract:
This paper introduces a novel data-driven approach to design a linear quadratic regulator (LQR) using a reinforcement learning (RL) algorithm that does not require a system model. The key contribution is to perform policy iteration (PI) by designing the policy evaluator as a two-layer quadratic neural network (QNN). This network is trained through convex optimization. To the best of our knowledge,…
▽ More
This paper introduces a novel data-driven approach to design a linear quadratic regulator (LQR) using a reinforcement learning (RL) algorithm that does not require a system model. The key contribution is to perform policy iteration (PI) by designing the policy evaluator as a two-layer quadratic neural network (QNN). This network is trained through convex optimization. To the best of our knowledge, this is the first time that a QNN trained through convex optimization is employed as the Q-function approximator (QFA). The main advantage is that the QNN's input-output map** has an analytical expression as a quadratic form, which can then be used to obtain an analytical expression for policy improvement. This is in stark contrast to the available techniques in the literature that must train a second neural network to obtain policy improvement. The article establishes the convergence of the learning algorithm to the optimal control, provided the system is controllable and one starts from a stabilitzing policy. A quadrotor example demonstrates the effectiveness of the proposed approach.
△ Less
Submitted 16 November, 2023;
originally announced November 2023.
-
Automated computed tomography and magnetic resonance imaging segmentation using deep learning: a beginner's guide
Authors:
Diedre Carmo,
Gustavo Pinheiro,
Lívia Rodrigues,
Thays Abreu,
Roberto Lotufo,
Letícia Rittner
Abstract:
Medical image segmentation is an increasingly popular area of research in medical imaging processing and analysis. However, many researchers who are new to the field struggle with basic concepts. This tutorial paper aims to provide an overview of the fundamental concepts of medical imaging, with a focus on Magnetic Resonance and Computerized Tomography. We will also discuss deep learning algorithm…
▽ More
Medical image segmentation is an increasingly popular area of research in medical imaging processing and analysis. However, many researchers who are new to the field struggle with basic concepts. This tutorial paper aims to provide an overview of the fundamental concepts of medical imaging, with a focus on Magnetic Resonance and Computerized Tomography. We will also discuss deep learning algorithms, tools, and frameworks used for segmentation tasks, and suggest best practices for method development and image analysis. Our tutorial includes sample tasks using public data, and accompanying code is available on GitHub (https://github.com/MICLab-Unicamp/Medical-ImagingTutorial). By sharing our insights gained from years of experience in the field and learning from relevant literature, we hope to assist researchers in overcoming the initial challenges they may encounter in this exciting and important area of research.
△ Less
Submitted 12 April, 2023;
originally announced April 2023.
-
Adversarial Robustness and Feature Impact Analysis for Driver Drowsiness Detection
Authors:
João Vitorino,
Lourenço Rodrigues,
Eva Maia,
Isabel Praça,
André Lourenço
Abstract:
Drowsy driving is a major cause of road accidents, but drivers are dismissive of the impact that fatigue can have on their reaction times. To detect drowsiness before any impairment occurs, a promising strategy is using Machine Learning (ML) to monitor Heart Rate Variability (HRV) signals. This work presents multiple experiments with different HRV time windows and ML models, a feature impact analy…
▽ More
Drowsy driving is a major cause of road accidents, but drivers are dismissive of the impact that fatigue can have on their reaction times. To detect drowsiness before any impairment occurs, a promising strategy is using Machine Learning (ML) to monitor Heart Rate Variability (HRV) signals. This work presents multiple experiments with different HRV time windows and ML models, a feature impact analysis using Shapley Additive Explanations (SHAP), and an adversarial robustness analysis to assess their reliability when processing faulty input data and perturbed HRV signals. The most reliable model was Extreme Gradient Boosting (XGB) and the optimal time window had between 120 and 150 seconds. Furthermore, SHAP enabled the selection of the 18 most impactful features and the training of new smaller models that achieved a performance as good as the initial ones. Despite the susceptibility of all models to adversarial attacks, adversarial training enabled them to preserve significantly higher results, especially XGB. Therefore, ML models can significantly benefit from realistic adversarial training to provide a more robust driver drowsiness detection.
△ Less
Submitted 23 March, 2023;
originally announced March 2023.
-
Optimal Cruise Airspeed for Hybrid-Electric and Electric Aircraft: Applications to Air Mobility
Authors:
Steven Li,
Luis Rodrigues
Abstract:
Electric and hybrid-electric aircraft can help our society transition towards more sustainable aviation and lower greenhouse gas (GHG) emissions. This paper provides solutions to minimize the direct operating cost (DOC) for hybrid-electric aircraft. The solution is the positive real root of a quintic polynomial which is derived using Pontryagin's minimum principle. By properly selecting a hybridiz…
▽ More
Electric and hybrid-electric aircraft can help our society transition towards more sustainable aviation and lower greenhouse gas (GHG) emissions. This paper provides solutions to minimize the direct operating cost (DOC) for hybrid-electric aircraft. The solution is the positive real root of a quintic polynomial which is derived using Pontryagin's minimum principle. By properly selecting a hybridization factor, one can also find the cruise airspeed corresponding to the minimum DOC of an electric aircraft. The optimal airspeed is integrated into the Rapidly-exploring Random Trees Star (RRT*) path planning algorithm. The minimum DOC solutions are investigated in a hybrid-electric international travel scenario and the path planning approach is applied to an electric aircraft city scenario.
△ Less
Submitted 14 February, 2023;
originally announced February 2023.
-
Anxolotl, an Anxiety Companion App -- Stress Detection
Authors:
Nuno Gomes,
Matilde Pato,
Pedro Santos,
André Lourenço,
Lourenço Rodrigues
Abstract:
Stress has a great effect on people's lives that can not be understated. While it can be good, since it helps humans to adapt to new and different situations, it can also be harmful when not dealt with properly, leading to chronic stress. The objective of this paper is develo** a stress monitoring solution, that can be used in real life, while being able to tackle this challenge in a positive wa…
▽ More
Stress has a great effect on people's lives that can not be understated. While it can be good, since it helps humans to adapt to new and different situations, it can also be harmful when not dealt with properly, leading to chronic stress. The objective of this paper is develo** a stress monitoring solution, that can be used in real life, while being able to tackle this challenge in a positive way. The SMILE data set was provided to team Anxolotl, and all it was needed was to develop a robust model. We developed a supervised learning model for classification in Python, presenting the final result of 64.1% in accuracy and a f1-score of 54.96%. The resulting solution stood the robustness test, presenting low variation between runs, which was a major point for it's possible integration in the Anxolotl app in the future.
△ Less
Submitted 3 January, 2023; v1 submitted 28 December, 2022;
originally announced December 2022.
-
From LQR to Static Output Feedback: a New LMI Approach
Authors:
Luis Rodrigues
Abstract:
This paper proposes a new Linear Matrix Inequality (LMI) for static output feedback control assuming that a Linear Quadratic Regulator (LQR) has been previously designed for the system. The main idea is to use a quadratic candidate Lyapunov function for the closed-loop system parameterized by the unique positive definite matrix that solves the Riccati equation. A converse result will also be prove…
▽ More
This paper proposes a new Linear Matrix Inequality (LMI) for static output feedback control assuming that a Linear Quadratic Regulator (LQR) has been previously designed for the system. The main idea is to use a quadratic candidate Lyapunov function for the closed-loop system parameterized by the unique positive definite matrix that solves the Riccati equation. A converse result will also be proved guaranteeing the existence of matrices verifying the LMI if the system is static output feedback stabilizable. The proposed method will then be extended to the design of static output feedback for the H1 control problem. Besides being a sufficient condition for which a converse result is proved, there are another four main advantages of the proposed methodology. First, it is computationally tractable. Second, one can use weighting matrices and obtain a solution in a similar way to LQR design. Third, the proposed method has an extremely simple LMI structure when compared with other LMI methods proposed in the literature. Finally, for the cases where the output is equal to the state it is shown that the LQR solution verifies the proposed LMI. Therefore, the static output feedback includes the LQR solution as a special case when the state is available, which is a desired property. Several examples show that the method is consistently successful and works well in practice.
△ Less
Submitted 17 November, 2022;
originally announced November 2022.
-
Inverse Optimal Control with Discount Factor for Continuous and Discrete-Time Control-Affine Systems and Reinforcement Learning
Authors:
Luis Rodrigues
Abstract:
This paper addresses the inverse optimal control problem of finding the state weighting function that leads to a quadratic value function when the cost on the input is fixed to be quadratic. The paper focuses on a class of infinite horizon discrete-time and continuous-time optimal control problems whose dynamics are control-affine and whose cost is quadratic in the input. The optimal control polic…
▽ More
This paper addresses the inverse optimal control problem of finding the state weighting function that leads to a quadratic value function when the cost on the input is fixed to be quadratic. The paper focuses on a class of infinite horizon discrete-time and continuous-time optimal control problems whose dynamics are control-affine and whose cost is quadratic in the input. The optimal control policy for this problem is the projection of minus the gradient of the value function onto the space formed by all feasible control directions. This projection points along the control direction of steepest decrease of the value function. For discrete-time systems and a quadratic value function the optimal control law can be obtained as the solution of a regularized least squares program, which corresponds to a receding horizon control with a single step ahead. For the single input case and a quadratic value function the solution for small weights in the control energy is interpreted as a control policy that at each step brings the trajectories of the system as close as possible to the origin, as measured by an appropriate norm. Conditions under which the optimal control law is linear are also stated. Additionally, the paper offers a map** of the optimal control formulation to an equivalent reinforcement learning formulation. Examples show the application of the theoretical results.
△ Less
Submitted 17 November, 2022;
originally announced November 2022.
-
Automated recognition of the pericardium contour on processed CT images using genetic algorithms
Authors:
E. O. Rodrigues,
L. O. Rodrigues,
L. S. N. Oliveira,
A. Conci,
P. Liatsis
Abstract:
This work proposes the use of Genetic Algorithms (GA) in tracing and recognizing the pericardium contour of the human heart using Computed Tomography (CT) images. We assume that each slice of the pericardium can be modelled by an ellipse, the parameters of which need to be optimally determined. An optimal ellipse would be one that closely follows the pericardium contour and, consequently, separate…
▽ More
This work proposes the use of Genetic Algorithms (GA) in tracing and recognizing the pericardium contour of the human heart using Computed Tomography (CT) images. We assume that each slice of the pericardium can be modelled by an ellipse, the parameters of which need to be optimally determined. An optimal ellipse would be one that closely follows the pericardium contour and, consequently, separates appropriately the epicardial and mediastinal fats of the human heart. Tracing and automatically identifying the pericardium contour aids in medical diagnosis. Usually, this process is done manually or not done at all due to the effort required. Besides, detecting the pericardium may improve previously proposed automated methodologies that separate the two types of fat associated to the human heart. Quantification of these fats provides important health risk marker information, as they are associated with the development of certain cardiovascular pathologies. Finally, we conclude that GA offers satisfiable solutions in a feasible amount of processing time.
△ Less
Submitted 30 August, 2022;
originally announced August 2022.
-
An approach for the aggregation of power system controllers with different topologies
Authors:
Jonas Pesente,
Paulo Galassi,
Leonardo Rodrigues,
Felipe Crestani,
Guilherme Justino,
Rodrigo Ramos
Abstract:
This paper proposes an approach to aggregate nonstructured power system controllers preserving the dynamical characteristics of the original devices. The method is based on linear operations that use the frequency response of the elements, resulting in an accurate input-output description of the equivalent controller when compared to the original ones. The developed method was applied to a model o…
▽ More
This paper proposes an approach to aggregate nonstructured power system controllers preserving the dynamical characteristics of the original devices. The method is based on linear operations that use the frequency response of the elements, resulting in an accurate input-output description of the equivalent controller when compared to the original ones. The developed method was applied to a model of the future interconnected Paraguayan-Argentinean power system to produce a dynamic equivalent used in a real-time simulator to test the special protection scheme needed for the safe operation of the this future system. Transient and small-signal stability studies presented matching simulation results in the time domain with significantly reduced computational burden and processing time.
△ Less
Submitted 15 December, 2021;
originally announced December 2021.
-
Automated Detection of Coronary Artery Stenosis in X-ray Angiography using Deep Neural Networks
Authors:
Dinis L. Rodrigues,
Miguel Nobre Menezes,
Fausto J. Pinto,
Arlindo L. Oliveira
Abstract:
Coronary artery disease leading up to stenosis, the partial or total blocking of coronary arteries, is a severe condition that affects millions of patients each year. Automated identification and classification of stenosis severity from minimally invasive procedures would be of great clinical value, but existing methods do not match the accuracy of experienced cardiologists, due to the complexity…
▽ More
Coronary artery disease leading up to stenosis, the partial or total blocking of coronary arteries, is a severe condition that affects millions of patients each year. Automated identification and classification of stenosis severity from minimally invasive procedures would be of great clinical value, but existing methods do not match the accuracy of experienced cardiologists, due to the complexity of the task. Although a number of computational approaches for quantitative assessment of stenosis have been proposed to date, the performance of these methods is still far from the required levels for clinical applications. In this paper, we propose a two-step deep-learning framework to partially automate the detection of stenosis from X-ray coronary angiography images. In the two steps, we used two distinct convolutional neural network architectures, one to automatically identify and classify the angle of view, and another to determine the bounding boxes of the regions of interest in frames where stenosis is visible. Transfer learning and data augmentation techniques were used to boost the performance of the system in both tasks. We achieved a 0.97 accuracy on the task of classifying the Left/Right Coronary Artery (LCA/RCA) angle view and 0.68/0.73 recall on the determination of the regions of interest, for LCA and RCA, respectively. These results compare favorably with previous results obtained using related approaches, and open the way to a fully automated method for the identification of stenosis severity from X-ray angiographies.
△ Less
Submitted 4 March, 2021;
originally announced March 2021.
-
Multi-Coil MRI Reconstruction Challenge -- Assessing Brain MRI Reconstruction Models and their Generalizability to Varying Coil Configurations
Authors:
Youssef Beauferris,
Jonas Teuwen,
Dimitrios Karkalousos,
Nikita Moriakov,
Mattha Caan,
George Yiasemis,
Lívia Rodrigues,
Alexandre Lopes,
Hélio Pedrini,
Letícia Rittner,
Maik Dannecker,
Viktor Studenyak,
Fabian Gröger,
Devendra Vyas,
Shahrooz Faghih-Roohi,
Amrit Kumar Jethi,
Jaya Chandra Raju,
Mohanasankar Sivaprakasam,
Mike Lasby,
Nikita Nogovitsyn,
Wallace Loos,
Richard Frayne,
Roberto Souza
Abstract:
Deep-learning-based brain magnetic resonance imaging (MRI) reconstruction methods have the potential to accelerate the MRI acquisition process. Nevertheless, the scientific community lacks appropriate benchmarks to assess MRI reconstruction quality of high-resolution brain images, and evaluate how these proposed algorithms will behave in the presence of small, but expected data distribution shifts…
▽ More
Deep-learning-based brain magnetic resonance imaging (MRI) reconstruction methods have the potential to accelerate the MRI acquisition process. Nevertheless, the scientific community lacks appropriate benchmarks to assess MRI reconstruction quality of high-resolution brain images, and evaluate how these proposed algorithms will behave in the presence of small, but expected data distribution shifts. The Multi-Coil Magnetic Resonance Image (MC-MRI) Reconstruction Challenge provides a benchmark that aims at addressing these issues, using a large dataset of high-resolution, three-dimensional, T1-weighted MRI scans. The challenge has two primary goals: 1) to compare different MRI reconstruction models on this dataset and 2) to assess the generalizability of these models to data acquired with a different number of receiver coils. In this paper, we describe the challenge experimental design, and summarize the results of a set of baseline and state of the art brain MRI reconstruction models. We provide relevant comparative information on the current MRI reconstruction state-of-the-art and highlight the challenges of obtaining generalizable models that are required prior to broader clinical adoption. The MC-MRI benchmark data, evaluation code and current challenge leaderboard are publicly available. They provide an objective performance assessment for future developments in the field of brain MRI reconstruction.
△ Less
Submitted 21 December, 2021; v1 submitted 9 November, 2020;
originally announced November 2020.
-
UAV Optimal Guidance in Wind Fields Using ZEM/ZEV with Generalized Performance Index
Authors:
Ely C. de Paiva,
Bruno Carvalho,
Luis Rodrigues
Abstract:
This paper presents an optimal guidance approach for a UAV navigation between two given points in 3D considering the wind influence. The proposed cost function to be minimized involves the weighting of the travel time and the control energy. An analytical expression is derived for the optimal cost yielding a fourth-order polynomial whose positive real roots correspond to the optimal travel times.…
▽ More
This paper presents an optimal guidance approach for a UAV navigation between two given points in 3D considering the wind influence. The proposed cost function to be minimized involves the weighting of the travel time and the control energy. An analytical expression is derived for the optimal cost yielding a fourth-order polynomial whose positive real roots correspond to the optimal travel times. The optimization problem is shown to be equivalent to the Zero-Effort-Miss/Zero-Effort-Velocity (ZEM/ZEV) optimal guidance approach for the case of a constant wind acceleration. Case studies for the rendez-vous and the intercept problems are shown through simulation examples for different wind conditions.
△ Less
Submitted 16 June, 2020;
originally announced June 2020.
