-
Disentangling Hippocampal Shape Variations: A Study of Neurological Disorders Using Graph Variational Autoencoder with Contrastive Learning
Authors:
Jakaria Rabbi,
Johannes Kiechle,
Christian Beaulieu,
Nilanjan Ray,
Dana Cobzas
Abstract:
This paper presents a comprehensive study focused on disentangling hippocampal shape variations from diffusion tensor imaging (DTI) datasets within the context of neurological disorders. Leveraging a Graph Variational Autoencoder (VAE) enhanced with Supervised Contrastive Learning, our approach aims to improve interpretability by disentangling two distinct latent variables corresponding to age and…
▽ More
This paper presents a comprehensive study focused on disentangling hippocampal shape variations from diffusion tensor imaging (DTI) datasets within the context of neurological disorders. Leveraging a Graph Variational Autoencoder (VAE) enhanced with Supervised Contrastive Learning, our approach aims to improve interpretability by disentangling two distinct latent variables corresponding to age and the presence of diseases. In our ablation study, we investigate a range of VAE architectures and contrastive loss functions, showcasing the enhanced disentanglement capabilities of our approach. This evaluation uses synthetic 3D torus mesh data and real 3D hippocampal mesh datasets derived from the DTI hippocampal dataset. Our supervised disentanglement model outperforms several state-of-the-art (SOTA) methods like attribute and guided VAEs in terms of disentanglement scores. Our model distinguishes between age groups and disease status in patients with Multiple Sclerosis (MS) using the hippocampus data. Our Graph VAE with Supervised Contrastive Learning shows the volume changes of the hippocampus of MS populations at different ages, and the result is consistent with the current neuroimaging literature. This research provides valuable insights into the relationship between neurological disorder and hippocampal shape changes in different age groups of MS populations using a Graph VAE with Supervised Contrastive loss.
△ Less
Submitted 31 March, 2024;
originally announced April 2024.
-
Is a Recent Surge in Global Warming Detectable?
Authors:
Claudie Beaulieu,
Colin Gallagher,
Rebecca Killick,
Robert Lund,
Xueheng Shi
Abstract:
The global mean surface temperature is widely studied to monitor climate change. A current debate centers around whether there has been a recent (post-1970s) surge/acceleration in the warming rate. This paper addresses whether an acceleration in the warming rate is detectable from a statistical perspective. We use changepoint models, which are statistical techniques specifically designed for ident…
▽ More
The global mean surface temperature is widely studied to monitor climate change. A current debate centers around whether there has been a recent (post-1970s) surge/acceleration in the warming rate. This paper addresses whether an acceleration in the warming rate is detectable from a statistical perspective. We use changepoint models, which are statistical techniques specifically designed for identifying structural changes in time series. Four global mean surface temperature records over 1850-2023 are scrutinized within. Our results show limited evidence for a warming surge; in most surface temperature time series, no change in the warming rate beyond the 1970s is detected. As such, we estimate minimum changes in the warming trend for a surge to be detectable in the near future.
△ Less
Submitted 5 March, 2024;
originally announced March 2024.
-
Diffusion-weighted MR spectroscopy: consensus, recommendations and resources from acquisition to modelling
Authors:
Clémence Ligneul,
Chloé Najac,
André Döring,
Christian Beaulieu,
Francesca Branzoli,
William T Clarke,
Cristina Cudalbu,
Guglielmo Genovese,
Saad Jbabdi,
Ileana Jelescu,
Dimitrios Karampinos,
Roland Kreis,
Henrik Lundell,
Małgorzata Marjańska,
Harald E. Möller,
Jessie Mosso,
Eloïse Mougel,
Stefan Posse,
Stefan Ruschke,
Kadir Simsek,
Filip Szczepankiewicz,
Assaf Tal,
Chantal Tax,
Georg Oeltzschner,
Marco Palombo
, et al. (2 additional authors not shown)
Abstract:
Brain cell structure and function reflect neurodevelopment, plasticity and ageing, and changes can help flag pathological processes such as neurodegeneration and neuroinflammation. Accurate and quantitative methods to non-invasively disentangle cellular structural features are needed and are a substantial focus of brain research. Diffusion-weighted MR spectroscopy (dMRS) gives access to diffusion…
▽ More
Brain cell structure and function reflect neurodevelopment, plasticity and ageing, and changes can help flag pathological processes such as neurodegeneration and neuroinflammation. Accurate and quantitative methods to non-invasively disentangle cellular structural features are needed and are a substantial focus of brain research. Diffusion-weighted MR spectroscopy (dMRS) gives access to diffusion properties of endogenous intracellular brain metabolites that are preferentially located inside specific brain cell populations. Despite its great potential, dMRS remains a challenging technique on all levels: from the data acquisition to the analysis, quantification, modelling and interpretation of results. These challenges were the motivation behind the organisation of the Lorentz Workshop on 'Best Practices and Tools for Diffusion MR Spectroscopy' held in Leiden in September 2021. During the workshop, the dMRS community established a set of recommendations to execute robust dMRS studies. This paper provides a description of the steps needed for acquiring, processing, fitting and modelling dMRS data and provides links to useful resources.
△ Less
Submitted 18 May, 2023;
originally announced May 2023.
-
The Rapid Rise of Severe Marine Heat Wave Systems
Authors:
J. Xavier Prochaska,
Claudie Beaulieu,
Katerina Giamalaki
Abstract:
We introduce a new methodology to study marine heat waves, extreme events in the sea surface temperature (SST) of the global ocean. Motivated by previously large and impactful marine heat waves and by theoretical expectation that the dominant heating processes coherently affect large regions of the ocean, we introduce a methodology from computer vision to construct marine heat wave systems (MWHSs)…
▽ More
We introduce a new methodology to study marine heat waves, extreme events in the sea surface temperature (SST) of the global ocean. Motivated by previously large and impactful marine heat waves and by theoretical expectation that the dominant heating processes coherently affect large regions of the ocean, we introduce a methodology from computer vision to construct marine heat wave systems (MWHSs) -- the collation of SST extrema in dimensions of area and time. We identify 649,475 MHWSs in the 37 year period (1983-2019) of daily SST records and find that the duration t_dur (days), maximum area A_max (km$^2$), and total ``volume'' N_vox (days km$^2$) for the majority of MHWSs are well-described by power-law distributions: t_dur^(-3), A_max^(-2) and N_vox^(-2). These characteristics confirm SST extrema exhibit strong spatial coherence that define the formation and evolution of marine heat waves. Furthermore, the most severe MHWSs deviate from these power-laws and are the dominant manifestation of marine heat waves: extrema in ocean heating are driven by the ~200 systems with largest area and duration. We further demonstrate that the previously purported rise in the incidence of marine heat wave events over the past decade is only significant in these severe systems. A change point analysis reveals a rapid increase in days under a severe MHW in most regions of the global ocean over the period of 2000-2005. Understanding the origin and impacts of marine heat waves in the current and future ocean, therefore, should focus on the production and evolution of the largest-scale and longest-duration heating phenomena.
△ Less
Submitted 14 April, 2023;
originally announced April 2023.
-
Good Practices and Common Pitfalls in Climate Time Series Changepoint Techniques: A Review
Authors:
Robert B. Lund,
Claudie Beaulieu,
Rebecca Killick,
Qiqi Lu,
Xueheng Shi
Abstract:
Climate changepoint (homogenization) methods abound today, with a myriad of techniques existing in both the climate and statistics literature. Unfortunately, the appropriate changepoint technique to use remains unclear to many. Further complicating issues, changepoint conclusions are not robust to small perturbations in assumptions; for example, allowing for a trend or correlation in the series ca…
▽ More
Climate changepoint (homogenization) methods abound today, with a myriad of techniques existing in both the climate and statistics literature. Unfortunately, the appropriate changepoint technique to use remains unclear to many. Further complicating issues, changepoint conclusions are not robust to small perturbations in assumptions; for example, allowing for a trend or correlation in the series can drastically change conclusions. This paper is a review of the changepoint topic, with an emphasis on illuminating the models and techniques that allow the scientist to make reliable conclusions. Pitfalls to avoid are demonstrated via actual applications. The discourse begins by narrating the salient statistical features of most climate time series. Thereafter, single and multiple changepoint problems are considered. Several pitfalls are discussed en route and good practices are recommended. While the majority of our applications involve temperature series, other settings are mentioned.
△ Less
Submitted 5 December, 2022;
originally announced December 2022.
-
Changepoint Detection: An Analysis of the Central England Temperature Series
Authors:
Xueheng Shi,
Claudie Beaulieu,
Rebecca Killick,
Robert Lund
Abstract:
This paper presents a statistical analysis of structural changes in the Central England temperature series, one of the longest surface temperature records available. A changepoint analysis is performed to detect abrupt changes, which can be regarded as a preliminary step before further analysis is conducted to identify the causes of the changes (e.g., artificial, human-induced or natural variabili…
▽ More
This paper presents a statistical analysis of structural changes in the Central England temperature series, one of the longest surface temperature records available. A changepoint analysis is performed to detect abrupt changes, which can be regarded as a preliminary step before further analysis is conducted to identify the causes of the changes (e.g., artificial, human-induced or natural variability). Regression models with structural breaks, including mean and trend shifts, are fitted to the series and compared via two commonly used multiple changepoint penalized likelihood criteria that balance model fit quality (as measured by likelihood) against parsimony considerations. Our changepoint model fits, with independent and short-memory errors, are also compared with a different class of models termed long-memory models that have been previously used by other authors to describe persistence features in temperature series. In the end, the optimal model is judged to be one containing a changepoint in the late 1980s, with a transition to an intensified warming regime. This timing and warming conclusion is consistent across changepoint models compared in this analysis. The variability of the series is not found to be significantly changing, and shift features are judged to be more plausible than either short- or long-memory autocorrelations. The final proposed model is one including trend-shifts (both intercept and slope parameters) with independent errors. The analysis serves as a walk-through tutorial of different changepoint techniques, illustrating what can be statistically inferred.
△ Less
Submitted 13 June, 2022; v1 submitted 23 June, 2021;
originally announced June 2021.
-
Joint Resource Management for MC-NOMA: A Deep Reinforcement Learning Approach
Authors:
Shaoyang Wang,
Tiejun Lv,
Wei Ni,
Norman C. Beaulieu,
Y. Jay Guo
Abstract:
This paper presents a novel and effective deep reinforcement learning (DRL)-based approach to addressing joint resource management (JRM) in a practical multi-carrier non-orthogonal multiple access (MC-NOMA) system, where hardware sensitivity and imperfect successive interference cancellation (SIC) are considered. We first formulate the JRM problem to maximize the weighted-sum system throughput. Th…
▽ More
This paper presents a novel and effective deep reinforcement learning (DRL)-based approach to addressing joint resource management (JRM) in a practical multi-carrier non-orthogonal multiple access (MC-NOMA) system, where hardware sensitivity and imperfect successive interference cancellation (SIC) are considered. We first formulate the JRM problem to maximize the weighted-sum system throughput. Then, the JRM problem is decoupled into two iterative subtasks: subcarrier assignment (SA, including user grou**) and power allocation (PA). Each subtask is a sequential decision process. Invoking a deep deterministic policy gradient algorithm, our proposed DRL-based JRM (DRL-JRM) approach jointly performs the two subtasks, where the optimization objective and constraints of the subtasks are addressed by a new joint reward and internal reward mechanism. A multi-agent structure and a convolutional neural network are adopted to reduce the complexity of the PA subtask. We also tailor the neural network structure for the stability and convergence of DRL-JRM. Corroborated by extensive experiments, the proposed DRL-JRM scheme is superior to existing alternatives in terms of system throughput and resistance to interference, especially in the presence of many users and strong inter-cell interference. DRL-JRM can flexibly meet individual service requirements of users.
△ Less
Submitted 29 March, 2021;
originally announced March 2021.
-
Analysis and Optimization of Service Delay for Multi-quality Videos in Multi-tier Heterogeneous Network with Random Caching
Authors:
Xuewei Zhang,
Tiejun Lv,
Yuan Ren,
Wei Ni,
Norman C. Beaulieu
Abstract:
Aiming to minimize service delay, we propose a new random caching scheme in device-to-device (D2D)-assisted heterogeneous network. To support diversified viewing qualities of multimedia video services, each video file is encoded into a base layer (BL) and multiple enhancement layers (ELs) by scalable video coding (SVC). A super layer, including the BL and several ELs, is transmitted to every user.…
▽ More
Aiming to minimize service delay, we propose a new random caching scheme in device-to-device (D2D)-assisted heterogeneous network. To support diversified viewing qualities of multimedia video services, each video file is encoded into a base layer (BL) and multiple enhancement layers (ELs) by scalable video coding (SVC). A super layer, including the BL and several ELs, is transmitted to every user. We define and quantify the service delay of multi-quality videos by deriving successful transmission probabilities when a user is served by a D2D helper, a small-cell base station (SBS) and a macro-cell base station (MBS). We formulate a delay minimization problem subject to the limited cache sizes of D2D helpers and SBSs. The structure of the optimal solutions to the problem is revealed, and then an improved standard gradient projection method is designed to effectively obtain the solutions. Both theoretical analysis and Monte-Carlo simulations validate the successful transmission probabilities. Compared with three benchmark caching policies, the proposed SVC-based random caching scheme is superior in terms of reducing the service delay.
△ Less
Submitted 21 July, 2020;
originally announced July 2020.
-
Economical Caching for Scalable Videos in Cache-enabled Heterogeneous Networks
Authors:
Xuewei Zhang,
Tiejun Lv,
Yuan Ren,
Wei Ni,
Norman C. Beaulieu,
Y. Jay Guo
Abstract:
We develop the optimal economical caching schemes in cache-enabled heterogeneous networks, while delivering multimedia video services with personalized viewing qualities to mobile users. By applying scalable video coding (SVC), each video file to be requested is divided into one base layer (BL) and several enhancement layers (ELs). In order to assign different transmission tasks, the serving small…
▽ More
We develop the optimal economical caching schemes in cache-enabled heterogeneous networks, while delivering multimedia video services with personalized viewing qualities to mobile users. By applying scalable video coding (SVC), each video file to be requested is divided into one base layer (BL) and several enhancement layers (ELs). In order to assign different transmission tasks, the serving small-cell base stations (SBSs) are grouped into K clusters. The SBSs are able to cache and cooperatively transmit BL and EL contents to the user. We analytically derive the expressions for successful transmission probability and ergodic service rate, and then the closed form of EConomical Efficiency (ECE) is obtained. In order to enhance the ECE performance, we formulate the ECE optimization problems for two cases. In the first case, with equal cache size equipped at each SBS, the layer caching indicator is determined. Since this problem is NP-hard, after the l0-norm approximation, the discrete optimization variables are relaxed to be continuous, and this relaxed problem is convex. Next, based on the optimal solution derived from the relaxed problem, we devise a greedystrategy based heuristic algorithm to achieve the near-optimal layer caching indicators. In the second case, the cache size for each SBS, the layer size and the layer caching indicator are jointly optimized. This problem is a mixed integer programming problem, which is more challenging. To effectively solve this problem, the original ECE maximization problem is divided into two subproblems. These two subproblems are iteratively solved until the original optimization problem is convergent. Numerical results verify the correctness of theoretical derivations. Additionally, compared to the most popular layer placement strategy, the performance superiority of the proposed SVC-based caching schemes is testified.
△ Less
Submitted 5 May, 2019;
originally announced May 2019.
-
Energy-Efficient Caching for Scalable Videos in Heterogeneous Networks
Authors:
Xuewei Zhang,
Tiejun Lv,
Wei Ni,
John M. Cioffi,
Norman C. Beaulieu,
Y. Jay Guo
Abstract:
By suppressing repeated content deliveries, wireless caching has the potential to substantially improve the energy efficiency (EE) of the fifth generation (5G) communication networks. In this paper, we propose two novel energy-efficient caching schemes in heterogeneous networks, namely, scalable video coding (SVC)-based fractional caching and SVC-based random caching, which can provide on-demand v…
▽ More
By suppressing repeated content deliveries, wireless caching has the potential to substantially improve the energy efficiency (EE) of the fifth generation (5G) communication networks. In this paper, we propose two novel energy-efficient caching schemes in heterogeneous networks, namely, scalable video coding (SVC)-based fractional caching and SVC-based random caching, which can provide on-demand video services with different perceptual qualities. We derive the expressions for successful transmission probabilities and ergodic service rates. Based on the derivations and the established power consumption models, the EE maximization problems are formulated for the two proposed caching schemes. By taking logarithmic approximations of the l0-norm, the problems are efficiently solved by the standard gradient projection method. Numerical results validate the theoretical analysis and demonstrate the superiority of our proposed caching schemes, compared to three benchmark strategies.
△ Less
Submitted 30 May, 2018;
originally announced May 2018.
-
An Improved and More Accurate Expression for a PDF Related to Eigenvalue-Based Spectrum Sensing
Authors:
Fuhui Zhou,
Norman C. Beaulieu
Abstract:
Cooperative spectrum sensing based on the limiting eigenvalue ratio of the covariance matrix offers superior detection performance and overcomes the noise uncertainty problem. While an exact expression exists, it is complex and multiple useful approximate expressions have been published in the literature. An improved, more accurate, integral solution for the probability density function of the rat…
▽ More
Cooperative spectrum sensing based on the limiting eigenvalue ratio of the covariance matrix offers superior detection performance and overcomes the noise uncertainty problem. While an exact expression exists, it is complex and multiple useful approximate expressions have been published in the literature. An improved, more accurate, integral solution for the probability density function of the ratio is derived using order statistical analysis to remove the simplifying, but incorrect, independence assumption. Thereby, the letter makes an advance in the rigorous theory of eigenvalue-based spectrum sensing.
△ Less
Submitted 12 February, 2018;
originally announced February 2018.
-
Adaptive Local Window for Level Set Segmentation of CT and MRI Liver Lesions
Authors:
Assaf Hoogi,
Christopher F. Beaulieu,
Guilherme M. Cunha,
Elhamy Heba,
Claude B. Sirlin,
Sandy Napel,
Daniel L. Rubin
Abstract:
We propose a novel method, the adaptive local window, for improving level set segmentation technique. The window is estimated separately for each contour point, over iterations of the segmentation process, and for each individual object. Our method considers the object scale, the spatial texture, and changes of the energy functional over iterations. Global and local statistics are considered by ca…
▽ More
We propose a novel method, the adaptive local window, for improving level set segmentation technique. The window is estimated separately for each contour point, over iterations of the segmentation process, and for each individual object. Our method considers the object scale, the spatial texture, and changes of the energy functional over iterations. Global and local statistics are considered by calculating several gray level co-occurrence matrices. We demonstrate the capabilities of the method in the domain of medical imaging for segmenting 233 images with liver lesions. To illustrate the strength of our method, those images were obtained by either Computed Tomography or Magnetic Resonance Imaging. Moreover, we analyzed images using three different energy models. We compare our method to a global level set segmentation and to local framework that uses predefined fixed-size square windows. The results indicate that our proposed method outperforms the other methods in terms of agreement with the manual marking and dependence on contour initialization or the energy model used. In case of complex lesions, such as low contrast lesions, heterogeneous lesions, or lesions with a noisy background, our method shows significantly better segmentation with an improvement of 0.25+- 0.13 in Dice similarity coefficient, compared with state of the art fixed-size local windows (Wilcoxon, p < 0.001).
△ Less
Submitted 12 June, 2016;
originally announced June 2016.
-
Equivalent Codes, Optimality, and Performance Analysis of OSTBC: Textbook Study
Authors:
Alex E. Geyer,
Reza Nikjah,
Sergiy A. Vorobyov,
Norman C. Beaulieu
Abstract:
An equivalent model for a multi-input multi-output (MIMO) communication system with orthogonal space-time block codes (OSTBCs) is proposed based on a newly revealed connection between OSTBCs and Euclidean codes. Examples of distance spectra, signal constellations, and signal coordinate diagrams of Euclidean codes equivalent to simplest OSTBCs are given. A new asymptotic upper bound for the symbol…
▽ More
An equivalent model for a multi-input multi-output (MIMO) communication system with orthogonal space-time block codes (OSTBCs) is proposed based on a newly revealed connection between OSTBCs and Euclidean codes. Examples of distance spectra, signal constellations, and signal coordinate diagrams of Euclidean codes equivalent to simplest OSTBCs are given. A new asymptotic upper bound for the symbol error rate (SER) of OSTBCs, based on the distance spectra of the introduced equivalent Euclidean codes is derived, and new general design criteria for signal constellations of the optimal OSTBC are proposed. Some bounds relating distance properties, dimensionality, and cardinality of OSTBCs with constituent signals of equal energy are given, and new optimal signal constellations with cardinalities M = 8 and M = 16 for Alamouti's code are designed. Using the new model for MIMO communication systems with OSTBCs, a general methodology for performance analysis of OSTBCs is developed. As an example of the application of this methodology, an exact evaluation of the SER of any OSTBC is given. Namely, a new expression for the SER of Alamouti's OSTBC with binary phase shift keying (BPSK) signals is derived.
△ Less
Submitted 15 January, 2014;
originally announced January 2014.