-
Detection of a structural break in intraday volatility pattern
Authors:
Piotr Kokoszka,
Tim Kutta,
Neda Mohammadi,
Haonan Wang,
Shixuan Wang
Abstract:
We develop theory leading to testing procedures for the presence of a change point in the intraday volatility pattern. The new theory is developed in the framework of Functional Data Analysis. It is based on a model akin to the stochastic volatility model for scalar point-to-point returns. In our context, we study intraday curves, one curve per trading day. After postulating a suitable model for s…
▽ More
We develop theory leading to testing procedures for the presence of a change point in the intraday volatility pattern. The new theory is developed in the framework of Functional Data Analysis. It is based on a model akin to the stochastic volatility model for scalar point-to-point returns. In our context, we study intraday curves, one curve per trading day. After postulating a suitable model for such functional data, we present three tests focusing, respectively, on changes in the shape, the magnitude and arbitrary changes in the sequences of the curves of interest. We justify the respective procedures by showing that they have asymptotically correct size and by deriving consistency rates for all tests. These rates involve the sample size (the number of trading days) and the grid size (the number of observations per day). We also derive the corresponding change point estimators and their consistency rates. All procedures are additionally validated by a simulation study and an application to US stocks.
△ Less
Submitted 17 April, 2024;
originally announced April 2024.
-
Using digital twins for managing change in complex projects
Authors:
Jennifer Whyte,
Ranjith Soman,
Rafael Sacks,
Neda Mohammadi,
Nader Naderpajouh,
Wei-Ting Hong,
Ghang Lee
Abstract:
Complex systems are not entirely decomposable, hence interdependences arise at the interfaces in complex projects. When changes occur, significant risks arise at these interfaces as it is hard to identify, manage and visualise the systemic consequences of changes. Particularly problematic are the interfaces in which there are multiple interdependencies, which occur where the boundaries between des…
▽ More
Complex systems are not entirely decomposable, hence interdependences arise at the interfaces in complex projects. When changes occur, significant risks arise at these interfaces as it is hard to identify, manage and visualise the systemic consequences of changes. Particularly problematic are the interfaces in which there are multiple interdependencies, which occur where the boundaries between design components, contracts and organisation coincide, such as between design disciplines. In this paper, we propose an approach to digital twin-based interface management, through an underpinning state-of-the-art review of the existing technical literature and a small pilot to identify the characteristics of future data-driven solutions. We set out an approach to digital twin-based interface management and an agenda for research on advanced methodologies for managing change in complex projects. This agenda includes the need to integrate work on identifying systems interfaces, change propagation and visualisation, and the potential to significantly extend the limitations of existing solutions by using developments in the digital twin, such as linked data, semantic enrichment, network analyses, natural language processing (NLP)-enhanced ontology and machine learning.
△ Less
Submitted 30 May, 2024; v1 submitted 31 January, 2024;
originally announced February 2024.
-
Functional diffusion driven stochastic volatility model
Authors:
Piotr Kokoszka,
Neda Mohammadi,
Haonan Wang,
Shixuan Wang
Abstract:
We propose a stochastic volatility model for time series of curves. It is motivated by dynamics of intraday price curves that exhibit both between days dependence and intraday price evolution. The curves are suitably normalized to stationary in a function space and are functional analogs of point-to-point daily returns. The between curves dependence is modeled by a latent autoregression. The withi…
▽ More
We propose a stochastic volatility model for time series of curves. It is motivated by dynamics of intraday price curves that exhibit both between days dependence and intraday price evolution. The curves are suitably normalized to stationary in a function space and are functional analogs of point-to-point daily returns. The between curves dependence is modeled by a latent autoregression. The within curves behavior is modeled by a diffusion process. We establish the properties of the model and propose several approaches to its estimation. These approaches are justified by asymptotic arguments that involve an interplay between between the latent autoregression and the intraday diffusions. The asymptotic framework combines the increasing number of daily curves and the refinement of the discrete grid on which each daily curve is observed. Consistency rates for the estimators of the intraday volatility curves are derived as well as the asymptotic normality of the estimators of the latent autoregression. The estimation approaches are further explored and compared by an application to intraday price curves of over seven thousand U.S. stocks and an informative simulation study.
△ Less
Submitted 6 May, 2023;
originally announced May 2023.
-
Omnifont Persian OCR System Using Primitives
Authors:
Azarakhsh Keipour,
Mohammad Eshghi,
Sina Mohammadzadeh Ghadikolaei,
Negin Mohammadi,
Shahab Ensafi
Abstract:
In this paper, we introduce a model-based omnifont Persian OCR system. The system uses a set of 8 primitive elements as structural features for recognition. First, the scanned document is preprocessed. After normalizing the preprocessed image, text rows and sub-words are separated and then thinned. After recognition of dots in sub-words, strokes are extracted and primitive elements of each sub-wor…
▽ More
In this paper, we introduce a model-based omnifont Persian OCR system. The system uses a set of 8 primitive elements as structural features for recognition. First, the scanned document is preprocessed. After normalizing the preprocessed image, text rows and sub-words are separated and then thinned. After recognition of dots in sub-words, strokes are extracted and primitive elements of each sub-word are recognized using the strokes. Finally, the primitives are compared with a predefined set of character identification vectors in order to identify sub-word characters. The separation and recognition steps of the system are concurrent, eliminating unavoidable errors of independent separation of letters. The system has been tested on documents with 14 standard Persian fonts in 6 sizes. The achieved precision is 97.06%.
△ Less
Submitted 13 February, 2022;
originally announced February 2022.
-
Detecting Whether a Stochastic Process is Finitely Expressed in a Basis
Authors:
Neda Mohammadi,
Victor M. Panaretos
Abstract:
Is it possible to detect if the sample paths of a stochastic process almost surely admit a finite expansion with respect to some/any basis? The determination is to be made on the basis of a finite collection of discretely/noisily observed sample paths. We show that it is indeed possible to construct a hypothesis testing scheme that is almost surely guaranteed to make only finitely many incorrect d…
▽ More
Is it possible to detect if the sample paths of a stochastic process almost surely admit a finite expansion with respect to some/any basis? The determination is to be made on the basis of a finite collection of discretely/noisily observed sample paths. We show that it is indeed possible to construct a hypothesis testing scheme that is almost surely guaranteed to make only finitely many incorrect decisions as more data are collected. Said differently, our scheme almost certainly detects whether the process has a finite or infinite basis expansion for all sufficiently large sample sizes. Our approach relies on Cover's classical test for the irrationality of a mean, combined with tools for the non-parametric estimation of covariance operators.
△ Less
Submitted 2 November, 2021;
originally announced November 2021.
-
Nonparametric Estimation for SDE with Sparsely Sampled Paths: an FDA Perspective
Authors:
Neda Mohammadi,
Leonardo Santoro,
Victor M. Panaretos
Abstract:
We consider the problem of nonparametric estimation of the drift and diffusion coefficients of a Stochastic Differential Equation (SDE), based on $n$ independent replicates $\left\{X_i(t)\::\: t\in [0,1]\right\}_{1
\leq i \leq n}$, observed sparsely and irregularly on the unit interval, and subject to additive noise corruption. By sparse we intend to mean that the number of measurements per path…
▽ More
We consider the problem of nonparametric estimation of the drift and diffusion coefficients of a Stochastic Differential Equation (SDE), based on $n$ independent replicates $\left\{X_i(t)\::\: t\in [0,1]\right\}_{1
\leq i \leq n}$, observed sparsely and irregularly on the unit interval, and subject to additive noise corruption. By sparse we intend to mean that the number of measurements per path can be arbitrary (as small as two), and remain constant with respect to $n$. We focus on time-inhomogeneous SDE of the form $dX_t = μ(t)X_t^αdt + σ(t)X_t^βdW_t$, where $α\in \{0,1\}$ and $β\in \{0,1/2,1\}$, which includes prominent examples such as Brownian motion, Ornstein-Uhlenbeck process, geometric Brownian motion, and Brownian bridge. Our estimators are constructed by relating the local (drift/diffusion) parameters of the diffusion to their global parameters (mean/covariance, and their derivatives) by means of an apparently novel Partial Differential Equation (PDE). This allows us to use methods inspired by functional data analysis, and pool information across the sparsely measured paths. The methodology we develop is fully non-parametric and avoids any functional form specification on the time-dependency of either the drift function or the diffusion function. We establish almost sure uniform asymptotic convergence rates of the proposed estimators as the number of observed curves $n$ grows to infinity. Our rates are non-asymptotic in the number of measurements per path, explicitly reflecting how different sampling frequency might affect the speed of convergence. Our framework suggests possible further fruitful interactions between FDA and SDE methods in problems with replication.
△ Less
Submitted 24 November, 2023; v1 submitted 27 October, 2021;
originally announced October 2021.
-
On the Geometry of Stable Steiner Tree Instances
Authors:
James Freitag,
Neshat Mohammadi,
Aditya Potukuchi,
Lev Reyzin
Abstract:
In this note we consider the Steiner tree problem under Bilu-Linial stability. We give strong geometric structural properties that need to be satisfied by stable instances. We then make use of, and strengthen, these geometric properties to show that $1.562$-stable instances of Euclidean Steiner trees are polynomial-time solvable. We also provide a connection between certain approximation algorithm…
▽ More
In this note we consider the Steiner tree problem under Bilu-Linial stability. We give strong geometric structural properties that need to be satisfied by stable instances. We then make use of, and strengthen, these geometric properties to show that $1.562$-stable instances of Euclidean Steiner trees are polynomial-time solvable. We also provide a connection between certain approximation algorithms and Bilu-Linial stability for Steiner trees.
△ Less
Submitted 27 September, 2021;
originally announced September 2021.
-
Combining physics-based modeling and deep learning for ultrasound elastography
Authors:
Narges Mohammadi,
Marvin M. Doyley,
Mujdat Cetin
Abstract:
Ultrasound elasticity images which enable the visualization of quantitative maps of tissue stiffness can be reconstructed by solving an inverse problem. Classical model-based approaches for ultrasound elastography use deterministic finite element methods (FEMs) to incorporate the governing physical laws resulting in poor performance in noisy conditions. Moreover, these approaches utilize fixed reg…
▽ More
Ultrasound elasticity images which enable the visualization of quantitative maps of tissue stiffness can be reconstructed by solving an inverse problem. Classical model-based approaches for ultrasound elastography use deterministic finite element methods (FEMs) to incorporate the governing physical laws resulting in poor performance in noisy conditions. Moreover, these approaches utilize fixed regularizers for various tissue patterns while appropriate data-adaptive priors might be required for capturing the complex spatial elasticity distribution. In this regard, we propose a joint model-based and learning-based framework for estimating the elasticity distribution by solving a regularized optimization problem. We present an integrated objective function composed of a statistical physics-based forward model and a data-driven regularizer to leverage deep neural networks for learning the underlying elasticity prior. This constrained optimization problem is solved using the gradient descent (GD) method and the gradient of regularizer is simply replaced by the residual of the trained denoiser network for having an explicit objective function with reduced computation time.
△ Less
Submitted 27 July, 2021;
originally announced July 2021.
-
Regularization by Adversarial Learning for Ultrasound Elasticity Imaging
Authors:
Narges Mohammadi,
Marvin M. Doyley,
Mujdat Cetin
Abstract:
Classical model-based imaging methods for ultrasound elasticity inverse problem require prior constraints about the underlying elasticity patterns, while finding the appropriate hand-crafted prior for each tissue type is a challenge. In contrast, standard data-driven methods count solely on supervised learning on the training data pairs leading to massive network parameters for unnecessary physica…
▽ More
Classical model-based imaging methods for ultrasound elasticity inverse problem require prior constraints about the underlying elasticity patterns, while finding the appropriate hand-crafted prior for each tissue type is a challenge. In contrast, standard data-driven methods count solely on supervised learning on the training data pairs leading to massive network parameters for unnecessary physical model relearning which might not be consistent with the governing physical models of the imaging system. Fusing the physical forward model and noise statistics with data-adaptive priors leads to a united reconstruction framework that guarantees the learned reconstruction agrees with the physical models while co** with the limited training data. In this paper, we propose a new methodology for estimating the elasticity image by solving a regularized optimization problem which benefits from the physics-based modeling via a data-fidelity term and adversarially learned priors via a regularization term. In this method, the regularizer is trained based on the Wasserstein Generative Adversarial Network (WGAN) objective function which tries to distinguish the distribution of clean and noisy images. Leveraging such an adversarial regularizer for parameterizing the distribution of latent images and using gradient descent (GD) for solving the corresponding regularized optimization task leads to stability and convergence of the reconstruction compared to pixel-wise supervised learning schemes. Our simulation results verify the effectiveness and robustness of the proposed methodology with limited training datasets.
△ Less
Submitted 14 June, 2021; v1 submitted 31 May, 2021;
originally announced June 2021.
-
MR elasticity reconstruction using statistical physical modeling and explicit data-driven denoising regularizer
Authors:
Narges Mohammadi,
Marvin M. Doyley,
Mujdat Cetin
Abstract:
Elasticity image, visualizing the quantitative map of tissue stiffness, can be reconstructed by solving an inverse problem. Classical methods for magnetic resonance elastography (MRE) try to solve a regularized optimization problem comprising a deterministic physical model and a prior constraint as data-fidelity term and regularization term, respectively. For improving the elasticity reconstructio…
▽ More
Elasticity image, visualizing the quantitative map of tissue stiffness, can be reconstructed by solving an inverse problem. Classical methods for magnetic resonance elastography (MRE) try to solve a regularized optimization problem comprising a deterministic physical model and a prior constraint as data-fidelity term and regularization term, respectively. For improving the elasticity reconstructions, appropriate prior about the underlying elasticity distribution is required which is not unique. This article proposes an infused approach for MRE reconstruction by integrating the statistical representation of the physical laws of harmonic motions and learning-based prior. For data-fidelity term, we use a statistical linear-algebraic model of equilibrium equations and for the regularizer, data-driven regularization by denoising (RED) is utilized. In the proposed optimization paradigm, the regularizer gradient is simply replaced by the residual of learned denoiser leading to time-efficient computation and convex explicit objective function. Simulation results of elasticity reconstruction verify the effectiveness of the proposed approach.
△ Less
Submitted 26 May, 2021;
originally announced May 2021.
-
Functional Data Analysis with Rough Sample Paths?
Authors:
Neda Mohammadi,
Victor M. Panaretos
Abstract:
Functional data are typically modeled as sample paths of smooth stochastic processes in order to mitigate the fact that they are often observed discretely and noisily, occasionally irregularly and sparsely. The smoothness assumption is imposed to allow for the use of smoothing techniques that annihilate the noise. At the same time, imposing the smoothness assumption excludes a considerable range o…
▽ More
Functional data are typically modeled as sample paths of smooth stochastic processes in order to mitigate the fact that they are often observed discretely and noisily, occasionally irregularly and sparsely. The smoothness assumption is imposed to allow for the use of smoothing techniques that annihilate the noise. At the same time, imposing the smoothness assumption excludes a considerable range of stochastic processes, most notably diffusion processes. Under perfect observation of the sample paths, such processes would not need to be excluded from the realm of functional data analysis. In this paper, we introduce a careful modification of existing methods, dubbed the "reflected triangle estimator", and show that this allows for the functional data analysis of processes with nowhere differentiable sample paths, even when these are discretely and noisily observed, including under irregular and sparse designs. Our estimator matches the established rates of convergence for processes with smooth paths, and furthermore attains the same optimal rates as one would get under perfect observation. Thus, with reflected triangle estimation, the scope of applicability of much of the methodology developed for discretely/irregularly/noisily/sparsely sampled functional data is considerably extended. By way of simulation it is shown that the advantages furnished are reflected in practice, hinting at potential closer links with the field of diffusion inference.
△ Less
Submitted 22 December, 2021; v1 submitted 25 May, 2021;
originally announced May 2021.
-
Finite Element Reconstruction Of Stiffness Images In MR Elastography Using Statistical Physical Forward Modeling And Proximal Optimization Methods
Authors:
Narges Mohammadi,
Marvin M. Doyley,
Mujdat Cetin
Abstract:
Quantitative characterization of tissue properties, known as elasticity imaging, can be cast as solving an ill-posed inverse problem. The finite element methods (FEMs) in magnetic resonance elastography (MRE) imaging are based on solving a constrained optimization problem consisting of a physical forward model and a regularizer as the data-fidelity term and the prior term, respectively. In existin…
▽ More
Quantitative characterization of tissue properties, known as elasticity imaging, can be cast as solving an ill-posed inverse problem. The finite element methods (FEMs) in magnetic resonance elastography (MRE) imaging are based on solving a constrained optimization problem consisting of a physical forward model and a regularizer as the data-fidelity term and the prior term, respectively. In existing formulation for the elasticity forward model, physical laws that arise from equilibrium equation of harmonic motion, indicate a deterministic relationship between MRE-measured data and unknown elasticity distribution which leads to the poor and unstable elasticity distribution estimation in the presence of noise. Toward this end, we propose an efficient statistical methodology for physical forward model refinement by formulating it as linear algebraic representation with respect to the unknown elasticity distribution and incorporating an analytical noise model. To solve the subsequent total variation regularized optimization task, we benefit from a fixed-point scheme involving proximal gradient methods. Simulation results of elasticity reconstruction in various SNR conditions verify the effectiveness of the proposed approach.
△ Less
Submitted 26 March, 2021;
originally announced March 2021.
-
Ultrasound Elasticity Imaging Using Physics-based Models And Learning-based Plug-And-Play Priors
Authors:
Narges Mohammadi,
Marvin M. Doyley,
Mujdat Cetin
Abstract:
Existing physical model-based imaging methods for ultrasound elasticity reconstruction utilize fixed variational regularizers that may not be appropriate for the application of interest or may not capture complex spatial prior information about the underlying tissues. On the other hand, end-to-end learning-based methods count solely on the training data, not taking advantage of the governing physi…
▽ More
Existing physical model-based imaging methods for ultrasound elasticity reconstruction utilize fixed variational regularizers that may not be appropriate for the application of interest or may not capture complex spatial prior information about the underlying tissues. On the other hand, end-to-end learning-based methods count solely on the training data, not taking advantage of the governing physical laws of the imaging system. Integrating learning-based priors with physical forward models for ultrasound elasticity imaging, we present a joint reconstruction framework which guarantees that learning driven reconstructions are consistent with the underlying physics. For solving the elasticity inverse problem as a regularized optimization problem, we propose a plug-and-play (PnP) reconstruction approach in which each iteration of the elasticity image estimation process involves separate updates incorporating data fidelity and learning-based regularization. In this methodology, the data fidelity term is developed using a statistical linear algebraic model of quasi-static equilibrium equation revealing the relationship of the observed displacement fields \cmmnt{measured deformation data} to the unobserved elastic modulus. The regularizer comprises a convolutional neural network (CNN) based denoiser that captures the learned prior structure of the underlying tissues. Preliminary simulation results demonstrate the robustness and effectiveness of the proposed approach with limited training datasets and noisy displacement measurements.
△ Less
Submitted 25 March, 2021;
originally announced March 2021.
-
Monte Carlo-based estimation of patient absorbed dose in 99mTc-DMSA, -MAG3, and -DTPA SPECT imaging using the University of Florida (UF) phantoms
Authors:
Zeynab Khoshyari-morad,
Reza Jahangir,
Hashem Miri-Hakimabad,
Najmeh Mohammadi,
Hossein Arabi
Abstract:
SPECT imaging is one of the common modalities used to examine kidney disease. The radiopharmaceuticals such as 99mTc-MAG3, 99mTc-DTPA, and 99mTc-DMSA are commonly employed for pediatric patients. It is generally accepted that children organs are more sensitive to radiation than adults, due to their growth rate. Therefore, evaluating the absorbed dose in children to avoid irrecoverable damage is hi…
▽ More
SPECT imaging is one of the common modalities used to examine kidney disease. The radiopharmaceuticals such as 99mTc-MAG3, 99mTc-DTPA, and 99mTc-DMSA are commonly employed for pediatric patients. It is generally accepted that children organs are more sensitive to radiation than adults, due to their growth rate. Therefore, evaluating the absorbed dose in children to avoid irrecoverable damage is highly crucial. In this work, absorbed dose by different organs of children within the SPECT imaging for the above-mentioned radiopharmaceuticals were estimated through the use of Monte Carlo simulation for patients at the ages of 4, 8, 11, and 14-years old. The patients absorbed dose was estimated based on the specific radiopharmaceutical uptake patterns and the age-related human body models. To this end, we used the University of Florida (UF) voxel-wise baby phantoms and the Monte Carlo simulation for the pediatric patients at 4, 8, 11, and 14 years of age. The accuracy of the dosimetric outcomes was evaluated versus the ICRP 128 data. The highest and lowest doses absorbed by the kidneys were 0.48 mGy-MBq and 0.0042 mGy-MBq obtained for 4-year-old and 14-year-old children using 99mTc-DMSA and 99mTc-MAG3 radiopharmaceuticals, respectively. Moreover, in these cases, the relative errors of simulation results compared to the reference ICRP data were 12.1% and 0.95%, respectively. The simulation results were in good agreement with the ICRP 128 data. The results showed that the highest absorbed dose was by kidneys and when 99mTc-DMSA was used. The highest and lowest absorbed dose in the organs occurs when 99mTc-DMSA and 99mTc-MAG3 (in normal renal function) are used, respectively. On the other hand, the results indicated that the dose received by the organs decreases with age.
△ Less
Submitted 28 February, 2021;
originally announced March 2021.
-
Cloud Broker: A Systematic Map** Study
Authors:
Hoda Taheri,
Faeze Ramezani,
Neda Mohammadi,
Parisa Khoshdel,
Bahareh Taghavi,
Neda Khorasani,
Saeid Abrishami,
Abbas Rasoolzadegan
Abstract:
In a cloud environment, a cloud broker is an important entity that works as an independent middleware between cloud customers and providers to address issues and conduct negotiations related to satisfying both customer preferences and service provider profits. In recent years, researchers have published many articles which directly or indirectly address this research area. A systematic method is v…
▽ More
In a cloud environment, a cloud broker is an important entity that works as an independent middleware between cloud customers and providers to address issues and conduct negotiations related to satisfying both customer preferences and service provider profits. In recent years, researchers have published many articles which directly or indirectly address this research area. A systematic method is vital for extracting all search spaces (journals, conferences, and workshops) and primary studies (articles) conducted in the cloud broker field and then selecting some of the highest quality studies. The proposed systematic review includes a comprehensive three-tier search strategy (manual search, backward snowballing, and database search). The detailed explanation of the reviewing process is inserted in Appendix A. In the search methodology, qualitative criteria have been defined to select studies with the highest quality and the most relevance among all search spaces. In the present study, out of 1,928 extracted search spaces, 171 search spaces have been selected based on the defined quality criteria. Then, 1,298 articles have been extracted from these 171 selected search spaces. As a result, 496 high-quality papers have been selected among the mentioned papers. The chosen papers were published in prestigious journals, conferences, and workshops from 2009 through 2019. In the current Systematic Map** Study (SMS), eight research questions have been designed for the purpose of identifying information that is significant to the cloud broker field, such as the most critical and debated topics, existing trends and issues, active researchers and countries, commonly used techniques in building cloud brokers, evaluation methods, the amount of research conducted by year and the place of publication, and the most important active search spaces.
△ Less
Submitted 1 January, 2023; v1 submitted 25 February, 2021;
originally announced February 2021.
-
Making Intelligent Reflecting Surfaces More Intelligent: A Roadmap Through Reservoir Computing
Authors:
Zhou Zhou,
Kangjun Bai,
Nima Mohammadi,
Yang Yi,
Lingjia Liu
Abstract:
This article introduces a neural network-based signal processing framework for intelligent reflecting surface (IRS) aided wireless communications systems. By modeling radio-frequency (RF) impairments inside the "meta-atoms" of IRS (including nonlinearity and memory effects), we present an approach that generalizes the entire IRS-aided system as a reservoir computing (RC) system, an efficient recur…
▽ More
This article introduces a neural network-based signal processing framework for intelligent reflecting surface (IRS) aided wireless communications systems. By modeling radio-frequency (RF) impairments inside the "meta-atoms" of IRS (including nonlinearity and memory effects), we present an approach that generalizes the entire IRS-aided system as a reservoir computing (RC) system, an efficient recurrent neural network (RNN) operating in a state near the "edge of chaos". This framework enables us to take advantage of the nonlinearity of this "fabricated" wireless environment to overcome link degradation due to model mismatch. Accordingly, the randomness of the wireless channel and RF imperfections are naturally embedded into the RC framework, enabling the internal RC dynamics lying on the edge of chaos. Furthermore, several practical issues, such as channel state information acquisition, passive beamforming design, and physical layer reference signal design, are discussed.
△ Less
Submitted 6 February, 2021;
originally announced February 2021.
-
Differential Privacy Meets Federated Learning under Communication Constraints
Authors:
Nima Mohammadi,
Jianan Bai,
Qiang Fan,
Yifei Song,
Yang Yi,
Lingjia Liu
Abstract:
The performance of federated learning systems is bottlenecked by communication costs and training variance. The communication overhead problem is usually addressed by three communication-reduction techniques, namely, model compression, partial device participation, and periodic aggregation, at the cost of increased training variance. Different from traditional distributed learning systems, federat…
▽ More
The performance of federated learning systems is bottlenecked by communication costs and training variance. The communication overhead problem is usually addressed by three communication-reduction techniques, namely, model compression, partial device participation, and periodic aggregation, at the cost of increased training variance. Different from traditional distributed learning systems, federated learning suffers from data heterogeneity (since the devices sample their data from possibly different distributions), which induces additional variance among devices during training. Various variance-reduced training algorithms have been introduced to combat the effects of data heterogeneity, while they usually cost additional communication resources to deliver necessary control information. Additionally, data privacy remains a critical issue in FL, and thus there have been attempts at bringing Differential Privacy to this framework as a mediator between utility and privacy requirements. This paper investigates the trade-offs between communication costs and training variance under a resource-constrained federated system theoretically and experimentally, and how communication reduction techniques interplay in a differentially private setting. The results provide important insights into designing practical privacy-aware federated learning systems.
△ Less
Submitted 28 January, 2021;
originally announced January 2021.
-
A statistical framework for model-based inverse problems in ultrasound elastography
Authors:
Narges Mohammadi,
Marvin M. Doyley,
Mujdat Cetin
Abstract:
Model-based computational elasticity imaging of tissues can be posed as solving an inverse problem over finite elements spanning the displacement image. As most existing quasi-static elastography methods count on deterministic formulations of the forward model resulting in a constrained optimization problem, the impact of displacement observation errors has not been well addressed. To this end, we…
▽ More
Model-based computational elasticity imaging of tissues can be posed as solving an inverse problem over finite elements spanning the displacement image. As most existing quasi-static elastography methods count on deterministic formulations of the forward model resulting in a constrained optimization problem, the impact of displacement observation errors has not been well addressed. To this end, we propose a new statistical technique that leads to a unified optimization problem for elasticity imaging. Our statistical model takes the imperfect nature of the displacement measurements into account, and leads to an observation model for the Young's modulus that involves signal dependent colored noise. To solve the resulting regularized optimization problem, we propose a fixed-point algorithm that leverages proximal splitting methods. Preliminary qualitative and quantitative results demonstrate the effectiveness and robustness of the proposed methodology.
△ Less
Submitted 20 October, 2020;
originally announced October 2020.
-
Learning Lines with Ordinal Constraints
Authors:
Bohan Fan,
Diego Ihara Centurion,
Neshat Mohammadi,
Francesco Sgherzi,
Anastasios Sidiropoulos,
Mina Valizadeh
Abstract:
We study the problem of finding a map** $f$ from a set of points into the real line, under ordinal triple constraints. An ordinal constraint for a triple of points $(u,v,w)$ asserts that $|f(u)-f(v)|<|f(u)-f(w)|$. We present an approximation algorithm for the dense case of this problem. Given an instance that admits a solution that satisfies $(1-\varepsilon)$-fraction of all constraints, our alg…
▽ More
We study the problem of finding a map** $f$ from a set of points into the real line, under ordinal triple constraints. An ordinal constraint for a triple of points $(u,v,w)$ asserts that $|f(u)-f(v)|<|f(u)-f(w)|$. We present an approximation algorithm for the dense case of this problem. Given an instance that admits a solution that satisfies $(1-\varepsilon)$-fraction of all constraints, our algorithm computes a solution that satisfies $(1-O(\varepsilon^{1/8}))$-fraction of all constraints, in time $O(n^7) + (1/\varepsilon)^{O(1/\varepsilon^{1/8})} n$.
△ Less
Submitted 25 May, 2020; v1 submitted 27 April, 2020;
originally announced April 2020.
-
The Substrates of Integrated Neurocognitive Rehabilitation Platforms (INCRPs)
Authors:
Iman Ghodratitoostani,
Ali-Mohammad Kamali,
Mahshid Tahamtan,
Neda Mohammadi,
Hadi Aligholi,
Mohammad Nami
Abstract:
The integrated neurocognitive rehabilitation platforms (INCRPs) refer to infrastructures and teams integrated for set of interventions which aim to restore, or compensate for cognitive deficits. Cognitive skills may be lost or altered due to brain damage resulting from diseases or injury. The INCRP is a two-way interactive process whereby people with neurological impairments work with specialists,…
▽ More
The integrated neurocognitive rehabilitation platforms (INCRPs) refer to infrastructures and teams integrated for set of interventions which aim to restore, or compensate for cognitive deficits. Cognitive skills may be lost or altered due to brain damage resulting from diseases or injury. The INCRP is a two-way interactive process whereby people with neurological impairments work with specialists, professional staff, families, and community members to alleviate the impact of cognitive deficits. This perspective paper would highlight key elements required in INCRPs.
△ Less
Submitted 6 June, 2019;
originally announced June 2019.
-
Robust Mahalanobis Metric Learning via Geometric Approximation Algorithms
Authors:
Diego Ihara,
Neshat Mohammadi,
Francesco Sgherzi,
Anastasios Sidiropoulos
Abstract:
Learning Mahalanobis metric spaces is an important problem that has found numerous applications. Several algorithms have been designed for this problem, including Information Theoretic Metric Learning (ITML) [Davis et al. 2007] and Large Margin Nearest Neighbor (LMNN) classification [Weinberger and Saul 2009]. We study the problem of learning a Mahalanobis metric space in the presence of adversari…
▽ More
Learning Mahalanobis metric spaces is an important problem that has found numerous applications. Several algorithms have been designed for this problem, including Information Theoretic Metric Learning (ITML) [Davis et al. 2007] and Large Margin Nearest Neighbor (LMNN) classification [Weinberger and Saul 2009]. We study the problem of learning a Mahalanobis metric space in the presence of adversarial label noise. To that end, we consider a formulation of Mahalanobis metric learning as an optimization problem, where the objective is to minimize the number of violated similarity/dissimilarity constraints. We show that for any fixed ambient dimension, there exists a fully polynomial-time approximation scheme (FPTAS) with nearly-linear running time. This result is obtained using tools from the theory of linear programming in low dimensions. As a consequence, we obtain a fully-parallelizable algorithm that recovers a nearly-optimal metric space, even when a small fraction of the labels is corrupted adversarially. We also discuss improvements of the algorithm in practice, and present experimental results on real-world, synthetic, and poisoned data sets.
△ Less
Submitted 29 February, 2020; v1 submitted 23 May, 2019;
originally announced May 2019.
-
Future physics opportunities for high-density QCD at the LHC with heavy-ion and proton beams
Authors:
Z. Citron,
A. Dainese,
J. F. Grosse-Oetringhaus,
J. M. Jowett,
Y. -J. Lee,
U. A. Wiedemann,
M. Winn,
A. Andronic,
F. Bellini,
E. Bruna,
E. Chapon,
H. Dembinski,
D. d'Enterria,
I. Grabowska-Bold,
G. M. Innocenti,
C. Loizides,
S. Mohapatra,
C. A. Salgado,
M. Verweij,
M. Weber,
J. Aichelin,
A. Angerami,
L. Apolinario,
F. Arleo,
N. Armesto
, et al. (160 additional authors not shown)
Abstract:
The future opportunities for high-density QCD studies with ion and proton beams at the LHC are presented. Four major scientific goals are identified: the characterisation of the macroscopic long wavelength Quark-Gluon Plasma (QGP) properties with unprecedented precision, the investigation of the microscopic parton dynamics underlying QGP properties, the development of a unified picture of particle…
▽ More
The future opportunities for high-density QCD studies with ion and proton beams at the LHC are presented. Four major scientific goals are identified: the characterisation of the macroscopic long wavelength Quark-Gluon Plasma (QGP) properties with unprecedented precision, the investigation of the microscopic parton dynamics underlying QGP properties, the development of a unified picture of particle production and QCD dynamics from small (pp) to large (nucleus--nucleus) systems, the exploration of parton densities in nuclei in a broad ($x$, $Q^2$) kinematic range and the search for the possible onset of parton saturation. In order to address these scientific goals, high-luminosity Pb-Pb and p-Pb programmes are considered as priorities for Runs 3 and 4, complemented by high-multiplicity studies in pp collisions and a short run with oxygen ions. High-luminosity runs with intermediate-mass nuclei, for example Ar or Kr, are considered as an appealing case for extending the heavy-ion programme at the LHC beyond Run 4. The potential of the High-Energy LHC to probe QCD matter with newly-available observables, at twice larger center-of-mass energies than the LHC, is investigated.
△ Less
Submitted 25 February, 2019; v1 submitted 17 December, 2018;
originally announced December 2018.
-
Non-linear flow modes of identified particles in Pb--Pb collisions at $\sqrt{s_{\mathrm{NN}}} = 5.02$ TeV with the ALICE detector
Authors:
Naghmeh Mohammadi
Abstract:
The non-linear flow modes, $v_{4,22}$, $v_{5,32}$ and $v_{6,33}$ as a function of transverse momentum ($p_{\mathrm{T}}$) have been measured for the first time in Pb--Pb collisions at $\sqrt{s_{\rm{NN}}} = 5.02$ TeV for identified particles, i.e. charged pions, kaons and (anti-)protons. These observables probe the contribution of the second and third initial anisotropy coefficients to the higher or…
▽ More
The non-linear flow modes, $v_{4,22}$, $v_{5,32}$ and $v_{6,33}$ as a function of transverse momentum ($p_{\mathrm{T}}$) have been measured for the first time in Pb--Pb collisions at $\sqrt{s_{\rm{NN}}} = 5.02$ TeV for identified particles, i.e. charged pions, kaons and (anti-)protons. These observables probe the contribution of the second and third initial anisotropy coefficients to the higher order flow harmonics. Interestingly, all the characteristic features observed in previous $p_{\mathrm{T}}$-differential as well as $p_{\mathrm{T}}$-integrated measurements (e.g. $v_{2}$ and $v_{3}$) for various particle species are present in these measurements, i.e. increase of magnitude with increasing centrality percentile, a mass ordering in the low $p_{\mathrm{T}}$ region and a particle type grou** in the intermediate $p_{\mathrm{T}}$ region. The results cover 0--1\% (ultra-central collisions), 10--20\% (mid-central collisions) and 40--50\% (mid-peripheral collisions) centrality intervals and allow to test models that attempt to describe initial conditions and the mode-coupling of different harmonics.
△ Less
Submitted 22 November, 2018;
originally announced November 2018.
-
Algorithms for metric learning via contrastive embeddings
Authors:
Diego Ihara Centurion,
Neshat Mohammadi,
Anastasios Sidiropoulos
Abstract:
We study the problem of supervised learning a metric space under discriminative constraints. Given a universe $X$ and sets ${\cal S}, {\cal D}\subset {X \choose 2}$ of similar and dissimilar pairs, we seek to find a map** $f:X\to Y$, into some target metric space $M=(Y,ρ)$, such that similar objects are mapped to points at distance at most $u$, and dissimilar objects are mapped to points at dist…
▽ More
We study the problem of supervised learning a metric space under discriminative constraints. Given a universe $X$ and sets ${\cal S}, {\cal D}\subset {X \choose 2}$ of similar and dissimilar pairs, we seek to find a map** $f:X\to Y$, into some target metric space $M=(Y,ρ)$, such that similar objects are mapped to points at distance at most $u$, and dissimilar objects are mapped to points at distance at least $\ell$. More generally, the goal is to find a map** of maximum accuracy (that is, fraction of correctly classified pairs). We propose approximation algorithms for various versions of this problem, for the cases of Euclidean and tree metric spaces. For both of these target spaces, we obtain fully polynomial-time approximation schemes (FPTAS) for the case of perfect information. In the presence of imperfect information we present approximation algorithms that run in quasipolynomial time (QPTAS). Our algorithms use a combination of tools from metric embeddings and graph partitioning, that could be of independent interest.
△ Less
Submitted 18 March, 2019; v1 submitted 12 July, 2018;
originally announced July 2018.
-
Urban Energy Flux: Human Mobility as a Predictor for Spatial Changes
Authors:
Neda Mohammadi,
John E Taylor
Abstract:
As a key energy challenge, we urgently require a better understanding of how growing urban populations interact with municipal energy systems and the resulting impact on energy demand across city neighborhoods, which are dense hubs of both consumer population and CO2 emissions. Currently, the physical characteristics of urban infrastructure are the main determinants in predictive modeling of the d…
▽ More
As a key energy challenge, we urgently require a better understanding of how growing urban populations interact with municipal energy systems and the resulting impact on energy demand across city neighborhoods, which are dense hubs of both consumer population and CO2 emissions. Currently, the physical characteristics of urban infrastructure are the main determinants in predictive modeling of the demand side of energy in our rapidly growing urban areas; overlooking influence related to fluctuating human activities. Here, we show how applying intra-urban human mobility as an indicator for interactions of the population with local energy systems can be translated into spatial imprints to predict the spatial distribution of energy use in urban settings. Our findings establish human mobility as an important element in explaining the spatial structure underlying urban energy flux and demonstrate the utility of a human mobility driven approach for predicting future urban energy demand with implications for CO2 emission strategies.
△ Less
Submitted 5 September, 2016;
originally announced September 2016.
-
Higher harmonic anisotropic flow of identified particles in Pb-Pb collisions with the ALICE detector
Authors:
Naghmeh Mohammadi
Abstract:
Anisotropic flow plays a crucial role in establishing the equation of state of the Quark Gluon Plasma. The results at RHIC and LHC have demonstrated that the matter created in heavy-ion collisions behaves as a nearly perfect fluid reflected in the low value of the shear viscosity over entropy density ratio ($η/s$). The higher flow harmonics are particularly sensitive to the value of $η/s$ in hydro…
▽ More
Anisotropic flow plays a crucial role in establishing the equation of state of the Quark Gluon Plasma. The results at RHIC and LHC have demonstrated that the matter created in heavy-ion collisions behaves as a nearly perfect fluid reflected in the low value of the shear viscosity over entropy density ratio ($η/s$). The higher flow harmonics are particularly sensitive to the value of $η/s$ in hydrodynamic calculations. In this analysis, we present the first ALICE results on the $p_{\mathrm{T}}$ differential $v_{2}$, $v_{3}$ and $v_{4}$ for $π^{\pm}$, $\mathrm{K}^{\pm}$, p($\bar p$) from the high statistics 2011 heavy-ion run. We investigate how these $v_{n}$ coefficients evolve with particle mass and centrality for the 0--1\% and 20--30\% centrality ranges. These new measurements aim at differentiating between models that use different initial conditions, constraining further the value of $η/s$ and allowing to decouple the influence of the late hadronic stage from the hydrodynamic evolution of the system.
△ Less
Submitted 19 August, 2016;
originally announced August 2016.
-
First-principles study of Carbz-PAHTDDT dye sensitizer and two Carbz-derived dyes for dye sensitized solar cells
Authors:
Narges Mohammadi,
Feng Wang
Abstract:
Two new carbazole-based organic dye sensitizers are designed and investigated in silico. These dyes are designed through chemical modifications of the conjugated bridge of a reference organic sensitizer known as Carbz-PAHTDDT (S9) dye. The aim of designing these dyes was to reduce the energy gap between their highest occupied molecular orbital (HOMO) and lowest unoccupied molecular orbital (LUMO)…
▽ More
Two new carbazole-based organic dye sensitizers are designed and investigated in silico. These dyes are designed through chemical modifications of the conjugated bridge of a reference organic sensitizer known as Carbz-PAHTDDT (S9) dye. The aim of designing these dyes was to reduce the energy gap between their highest occupied molecular orbital (HOMO) and lowest unoccupied molecular orbital (LUMO) and to red-shift their absorption response compared to those of the reference S9 dye sensitizer. This reference dye has a reported promising efficiency when coupled with ferrocene-based electrolyte composition. To investigate geometric and electronic structure, density functional theory (DFT) and time-dependent DFT (TD-DFT) calculations were conducted on the new dyes as well as the reference dye. The present study indicated that the long-range correction to the theoretical model in the TD-DFT simulation is important to produce accurate absorption wavelengths.The theoretical studies have shown a reduced HOMO-LUMO gap and red-shifted absorption spectra for both of the new candidate dyes. Such findings suggest that the new dyes are promising and suitable for optoelectronic applications.
△ Less
Submitted 11 February, 2014;
originally announced February 2014.
-
From building blocks of proteins to drugs: A quantum chemical study on structure-property relationships of phenylalanine, tyrosine and dopa
Authors:
Aravindhan Ganesan,
Narges Mohammadi,
Feng Wang
Abstract:
Density functional theory and ab initio methods have been employed to address the impacts of hydroxyl (OH) group substitutions on the physico-chemical properties of levodopa (or L-dopa) against the natural amino acids, phenylalanine and tyrosine. L-dopa, which is an important therapeutic drug for Parkinson's disease, shares structural homology with the amino acids, whose structures differ only by…
▽ More
Density functional theory and ab initio methods have been employed to address the impacts of hydroxyl (OH) group substitutions on the physico-chemical properties of levodopa (or L-dopa) against the natural amino acids, phenylalanine and tyrosine. L-dopa, which is an important therapeutic drug for Parkinson's disease, shares structural homology with the amino acids, whose structures differ only by OH substitutions in their phenyl side chains. It is revealed that the backbone geometries of the aromatic molecules do not show apparent OH-dependent differences; however, their other molecular-level properties, such as molecular dipole moment, electronic properties and aromaticity, change significantly. The core binding energy spectra indicate that the atom sites that undergo modifications exhibit large energy shifts, so as to accommodate the changes in the intra-molecular chemical environment of the molecules. The binding energies of the modified C 1s sites in the molecules shift as much as 1.8 eV, whereas the electronic changes in their O 1s spectra happen in the higher energy region (ca. 536 eV). The valence spectra provide enhanced insights on the reactivity and chemical properties of the aromatic molecules. The impacts of OH moieties on the valence spectra are predominantly focussed in the energy band<16 eV, where the frontier molecular orbitals display much reorganization and energy shifts from the amino acids to L-dopa. Of the three molecules, L-dopa also has the least HOMO-LUMO energy gap, which can readily explain its proactivity as a drug compound. Furthermore, the nuclear independent chemical shift calculations suggest that L-dopa also has more aromaticity features than those of the amino acids. The OH groups, therefore, play a more prominent role in sha** the physico-chemical properties of L-dopa, which significantly improve its drug potency.
△ Less
Submitted 7 January, 2014;
originally announced January 2014.
-
Improving the electronic and optical properties of Carbz-PAHTDDT-based dyes through chemical modifications
Authors:
Narges Mohammadi,
Feng Wang
Abstract:
To investigate geometric and electronic structure, a theoretical study is performed on the Carbz-PAHTDDT (S9) organic dye sensitizer. This dye has a reported promising efficiency when coupled with ferrocene-based electrolyte composition. The present study indicated that the long-range correction to the theoretical model in the time-dependent density functional theory is important to produce accura…
▽ More
To investigate geometric and electronic structure, a theoretical study is performed on the Carbz-PAHTDDT (S9) organic dye sensitizer. This dye has a reported promising efficiency when coupled with ferrocene-based electrolyte composition. The present study indicated that the long-range correction to the theoretical model in the time-dependent density functional theory is important to produce accurate absorption wavelengths. In the present study, the chemical structure of the original Carbz-PAHTDDT dye on the π-conjugated bridge is also rationally changed to produce new dyes aiming at enhancing the spectral response as a desirable property of organic dyes in DSSC application. The theoretical studies on the new dyes have shown a significant red-shifting and broadening of their absorption spectra.
△ Less
Submitted 18 July, 2013;
originally announced July 2013.
-
Dominance of eclipsed ferrocene conformer in solutions revealed by the IR fingerprint spectral splitting
Authors:
Narges Mohammadi,
Feng Wang,
Stephen Best,
Dominique Appadoo,
Christopher T. Chantler
Abstract:
A combined high-resolution Fourier transform infrared (FTIR) spectra of ferrocene (Fc) and density functional theory (DFT) based quantum mechanical calculations confirmed the dominance of the eclipsed Fc conformer in the fingerprint region of 400-500 cm-1. The IR spectra of Fc were measured in solutions with a number of non-polar solvents such as acetonitrile, dichloromethane, tetrahydrofuran and…
▽ More
A combined high-resolution Fourier transform infrared (FTIR) spectra of ferrocene (Fc) and density functional theory (DFT) based quantum mechanical calculations confirmed the dominance of the eclipsed Fc conformer in the fingerprint region of 400-500 cm-1. The IR spectra of Fc were measured in solutions with a number of non-polar solvents such as acetonitrile, dichloromethane, tetrahydrofuran and dioxane. The measurements agree well with the earlier IR spectra of Lippincott and Nelson (1958) as well as the most recent IR spectral measurement in dichloromethane solution of Duhovic and Diaconescu (2013). All experimental measurements in the solutions unambiguously exhibit an IR spectral splitting of ca. 15 cm-1 in the 480-500 cm-1 region. The DFT based B3LYP/m6-31G(d) quantum mechanical calculations using implicit solvent models in this study indicates that only the ground electronic state of the eclipsed (D5h) Fc splits in the IR fingerprint region of ca. 500 cm-1. The IR spectral splitting characterises the centre Fe metal related vibrations of the eclipsed Fc, in agreement with our previous finding in gas phase [Mohammadi et al, 2012]. The present study further suggests that the effects of solvents on the IR spectra of Fc in this region are small and the solvent model effects are also small but the solute molecular density (SMD) model seems to produce the most accurate IR spectrum in the region of 400-600 cm-1 of Fc without scaling the calculated results.
△ Less
Submitted 3 June, 2013;
originally announced June 2013.