Showing 1–41 of 41 results for author: Ghanem, R

Robust Trajectory and Resource Optimization for Communication-assisted UAV SAR Sensing

Authors: Mohamed-Amine Lahmeri, Walid R. Ghanem, Christina Bonfert, Robert Schober

Abstract: In this paper, we investigate joint 3-dimensional (3D) trajectory planning and resource allocation for rotary-wing unmanned aerial vehicle (UAV) synthetic aperture radar (SAR) sensing. To support emerging real-time SAR applications and enable live mission control, we incorporate real-time communication with a ground station (GS). The UAV's main mission is the map** of large areas of interest (Ao… ▽ More In this paper, we investigate joint 3-dimensional (3D) trajectory planning and resource allocation for rotary-wing unmanned aerial vehicle (UAV) synthetic aperture radar (SAR) sensing. To support emerging real-time SAR applications and enable live mission control, we incorporate real-time communication with a ground station (GS). The UAV's main mission is the map** of large areas of interest (AoIs) using an onboard SAR system and transferring the unprocessed raw radar data to the ground in real time. We propose a robust trajectory and resource allocation design that takes into account random UAV trajectory deviations. To this end, we model the UAV trajectory deviations and study their effect on the radar coverage. Then, we formulate a robust non-convex mixed-integer non-linear program (MINLP) such that the UAV 3D trajectory and resources are jointly optimized for maximization of the radar ground coverage. A low-complexity sub-optimal solution for the formulated problem is presented. Furthermore, to assess the performance of the sub-optimal algorithm, we derive an upper bound on the optimal solution based on monotonic optimization theory. Simulation results show that the proposed sub-optimal algorithm achieves close-to-optimal performance and not only outperforms several benchmark schemes but is also robust with respect to UAV trajectory deviations. △ Less

Submitted 1 April, 2024; originally announced April 2024.

Multifidelity uncertainty quantification with models based on dissimilar parameters

Authors: Xiaoshu Zeng, Gianluca Geraci, Michael S. Eldred, John D. Jakeman, Alex A. Gorodetsky, Roger Ghanem

Abstract: Multifidelity uncertainty quantification (MF UQ) sampling approaches have been shown to significantly reduce the variance of statistical estimators while preserving the bias of the highest-fidelity model, provided that the low-fidelity models are well correlated. However, maintaining a high level of correlation can be challenging, especially when models depend on different input uncertain paramete… ▽ More Multifidelity uncertainty quantification (MF UQ) sampling approaches have been shown to significantly reduce the variance of statistical estimators while preserving the bias of the highest-fidelity model, provided that the low-fidelity models are well correlated. However, maintaining a high level of correlation can be challenging, especially when models depend on different input uncertain parameters, which drastically reduces the correlation. Existing MF UQ approaches do not adequately address this issue. In this work, we propose a new sampling strategy that exploits a shared space to improve the correlation among models with dissimilar parametrization. We achieve this by transforming the original coordinates onto an auxiliary manifold using the adaptive basis (AB) method~\cite{Tipireddy2014}. The AB method has two main benefits: (1) it provides an effective tool to identify the low-dimensional manifold on which each model can be represented, and (2) it enables easy transformation of polynomial chaos representations from high- to low-dimensional spaces. This latter feature is used to identify a shared manifold among models without requiring additional evaluations. We present two algorithmic flavors of the new estimator to cover different analysis scenarios, including those with legacy and non-legacy high-fidelity data. We provide numerical results for analytical examples, a direct field acoustic test, and a finite element model of a nuclear fuel assembly. For all examples, we compare the proposed strategy against both single-fidelity and MF estimators based on the original model parametrization. △ Less

Submitted 17 April, 2023; originally announced April 2023.

Projection pursuit adaptation on polynomial chaos expansions

Authors: Xiaoshu Zeng, Roger Ghanem

Abstract: The present work addresses the issue of accurate stochastic approximations in high-dimensional parametric space using tools from uncertainty quantification (UQ). The basis adaptation method and its accelerated algorithm in polynomial chaos expansions (PCE) were recently proposed to construct low-dimensional approximations adapted to specific quantities of interest (QoI). The present paper addresse… ▽ More The present work addresses the issue of accurate stochastic approximations in high-dimensional parametric space using tools from uncertainty quantification (UQ). The basis adaptation method and its accelerated algorithm in polynomial chaos expansions (PCE) were recently proposed to construct low-dimensional approximations adapted to specific quantities of interest (QoI). The present paper addresses one difficulty with these adaptations, namely their reliance on quadrature point sampling, which limits the reusability of potentially expensive samples. Projection pursuit (PP) is a statistical tool to find the ``interesting'' projections in high-dimensional data and thus bypass the curse-of-dimensionality. In the present work, we combine the fundamental ideas of basis adaptation and projection pursuit regression (PPR) to propose a novel method to simultaneously learn the optimal low-dimensional spaces and PCE representation from given data. While this projection pursuit adaptation (PPA) can be entirely data-driven, the constructed approximation exhibits mean-square convergence to the solution of an underlying governing equation and is thus subject to the same physics constraints. The proposed approach is demonstrated on a borehole problem and a structural dynamics problem, demonstrating the versatility of the method and its ability to discover low-dimensional manifolds with high accuracy with limited data. In addition, the method can learn surrogate models for different quantities of interest while reusing the same data set. △ Less

Submitted 24 November, 2022; originally announced November 2022.

Journal ref: Comput. Methods Appl. Mech. Engrg. 405 (2023) 115845

Codebook Based Two-Time Scale Resource Allocation Design for IRS-Assisted eMBB-URLLC Systems

Authors: Walid R. Ghanem, Vahid Jamali, Malte Schellmann, Hanwen Cao, Joseph Eichinger, Robert Schober

Abstract: This paper investigates the resource allocation algorithm design for wireless systems assisted by large intelligent reflecting surfaces (IRSs) with coexisting enhanced mobile broadband (eMBB) and ultra reliable low-latency communication (URLLC) users. We consider a two-time scale resource allocation scheme, whereby the base station's precoders are optimized in each mini-slot to adapt to newly arri… ▽ More This paper investigates the resource allocation algorithm design for wireless systems assisted by large intelligent reflecting surfaces (IRSs) with coexisting enhanced mobile broadband (eMBB) and ultra reliable low-latency communication (URLLC) users. We consider a two-time scale resource allocation scheme, whereby the base station's precoders are optimized in each mini-slot to adapt to newly arriving URLLC traffic, whereas the IRS phase shifts are reconfigured only in each time slot to avoid excessive base station-IRS signaling. To facilitate efficient resource allocation design for large IRSs, we employ a codebook-based optimization framework, where the IRS is divided into several tiles and the phase-shift elements of each tile are selected from a pre-defined codebook. The resource allocation algorithm design is formulated as an optimization problem for the maximization of the average sum data rate of the eMBB users over a time slot while guaranteeing the quality-of-service (QoS) of each URLLC user in each mini-slot. An iterative algorithm based on alternating optimization (AO) is proposed to find a high-quality suboptimal solution. As a case study, the proposed algorithm is applied in an industrial indoor environment modelled via the Quadriga channel simulator. Our simulation results show that the proposed algorithm design enables the coexistence of eMBB and URLLC users and yields large performance gains compared to three baseline schemes. Furthermore, our simulation results reveal that the proposed two-time scale resource allocation design incurs only a small performance loss compared to the case when the IRSs are optimized in each mini-slot. △ Less

Submitted 7 August, 2022; originally announced August 2022.

Comments: 6 pages, 3 figures, 1 Table, and submitted for an IEEE conference publication

Optimization-based Phase-shift Codebook Design for Large IRSs

Authors: Walid R. Ghanem, Vahid Jamali, Malte Schellmann, Hanwen Cao, Joseph Eichinger, Robert Schober

Abstract: In this paper, we focus on large intelligent reflecting surfaces (IRSs) and propose a new codebook construction method to obtain a set of pre-designed phase-shift configurations for the IRS unit cells. Since the complexity of online optimization and the overhead for channel estimation scale with the size of the phase-shift codebook, the design of small codebooks is of high importance. We consider… ▽ More In this paper, we focus on large intelligent reflecting surfaces (IRSs) and propose a new codebook construction method to obtain a set of pre-designed phase-shift configurations for the IRS unit cells. Since the complexity of online optimization and the overhead for channel estimation scale with the size of the phase-shift codebook, the design of small codebooks is of high importance. We consider both continuous and discrete phase-shift designs and formulate the codebook construction as optimization problems. To solve the optimization problems, we propose an optimal algorithm for the discrete phase-shift design and a low-complexity sub-optimal solution for the continuous design. Simulation results show that the proposed algorithms facilitate the construction of codebooks of different sizes and with different beamwidths. Moreover, the performance of the discrete phaseshift design with 2-bit quantization is shown to approach that of the continuous phase-shift design. Finally, our simulation results show that the proposed designs enable large transmit power savings compared to the existing linear and quadratic codebook designs [1], [2]. △ Less

Submitted 8 August, 2022; v1 submitted 3 March, 2022; originally announced March 2022.

Comments: 13 pages, 4 figures

Probabilistic Learning on Manifolds (PLoM) with Partition

Authors: Christian Soize, Roger Ghanem

Abstract: The probabilistic learning on manifolds (PLoM) introduced in 2016 has solved difficult supervised problems for the ``small data'' limit where the number N of points in the training set is small. Many extensions have since been proposed, making it possible to deal with increasingly complex cases. However, the performance limit has been observed and explained for applications for which $N$ is very s… ▽ More The probabilistic learning on manifolds (PLoM) introduced in 2016 has solved difficult supervised problems for the ``small data'' limit where the number N of points in the training set is small. Many extensions have since been proposed, making it possible to deal with increasingly complex cases. However, the performance limit has been observed and explained for applications for which $N$ is very small (50 for example) and for which the dimension of the diffusion-map basis is close to $N$. For these cases, we propose a novel extension based on the introduction of a partition in independent random vectors. We take advantage of this novel development to present improvements of the PLoM such as a simplified algorithm for constructing the diffusion-map basis and a new mathematical result for quantifying the concentration of the probability measure in terms of a probability upper bound. The analysis of the efficiency of this novel extension is presented through two applications. △ Less

Submitted 22 February, 2021; originally announced February 2021.

Comments: 20 pages, 13 figures, preprint

MSC Class: 68Q32; 60E05; 62H10; 65C20; 62P35

Multi-market Oligopoly of Equal Capacity

Authors: Ruda Zhang, Roger Ghanem

Abstract: We consider a variant of Cournot competition, where multiple firms allocate the same amount of resource across multiple markets. We prove that the game has a unique pure-strategy Nash equilibrium (NE), which is symmetric and is characterized by the maximal point of a "potential function". The NE is globally asymptotically stable under the gradient adjustment process, and is not socially optimal in… ▽ More We consider a variant of Cournot competition, where multiple firms allocate the same amount of resource across multiple markets. We prove that the game has a unique pure-strategy Nash equilibrium (NE), which is symmetric and is characterized by the maximal point of a "potential function". The NE is globally asymptotically stable under the gradient adjustment process, and is not socially optimal in general. An application is in transportation, where drivers allocate time over a street network. △ Less

Submitted 12 December, 2020; originally announced December 2020.

Comments: arXiv admin note: text overlap with arXiv:2008.10775

Data-based Discovery of Governing Equations

Authors: Waad Subber, Piyush Pandita, Sayan Ghosh, Genghis Khan, Li** Wang, Roger Ghanem

Abstract: Most common mechanistic models are traditionally presented in mathematical forms to explain a given physical phenomenon. Machine learning algorithms, on the other hand, provide a mechanism to map the input data to output without explicitly describing the underlying physical process that generated the data. We propose a Data-based Physics Discovery (DPD) framework for automatic discovery of governi… ▽ More Most common mechanistic models are traditionally presented in mathematical forms to explain a given physical phenomenon. Machine learning algorithms, on the other hand, provide a mechanism to map the input data to output without explicitly describing the underlying physical process that generated the data. We propose a Data-based Physics Discovery (DPD) framework for automatic discovery of governing equations from observed data. Without a prior definition of the model structure, first a free-form of the equation is discovered, and then calibrated and validated against the available data. In addition to the observed data, the DPD framework can utilize available prior physical models, and domain expert feedback. When prior models are available, the DPD framework can discover an additive or multiplicative correction term represented symbolically. The correction term can be a function of the existing input variable to the prior model, or a newly introduced variable. In case a prior model is not available, the DPD framework discovers a new data-based standalone model governing the observations. We demonstrate the performance of the proposed framework on a real-world application in the aerospace industry. △ Less

Submitted 21 December, 2020; v1 submitted 5 December, 2020; originally announced December 2020.

Probabilistic learning on manifolds constrained by nonlinear partial differential equations for small datasets

Authors: Christian Soize, Roger Ghanem

Abstract: A novel extension of the Probabilistic Learning on Manifolds (PLoM) is presented. It makes it possible to synthesize solutions to a wide range of nonlinear stochastic boundary value problems described by partial differential equations (PDEs) for which a stochastic computational model (SCM) is available and depends on a vector-valued random control parameter. The cost of a single numerical evaluati… ▽ More A novel extension of the Probabilistic Learning on Manifolds (PLoM) is presented. It makes it possible to synthesize solutions to a wide range of nonlinear stochastic boundary value problems described by partial differential equations (PDEs) for which a stochastic computational model (SCM) is available and depends on a vector-valued random control parameter. The cost of a single numerical evaluation of this SCM is assumed to be such that only a limited number of points can be computed for constructing the training dataset (small data). Each point of the training dataset is made up realizations from a vector-valued stochastic process (the stochastic solution) and the associated random control parameter on which it depends. The presented PLoM constrained by PDE allows for generating a large number of learned realizations of the stochastic process and its corresponding random control parameter. These learned realizations are generated so as to minimize the vector-valued random residual of the PDE in the mean-square sense. Appropriate novel methods are developed to solve this challenging problem. Three applications are presented. The first one is a simple uncertain nonlinear dynamical system with a nonstationary stochastic excitation. The second one concerns the 2D nonlinear unsteady Navier-Stokes equations for incompressible flows in which the Reynolds number is the random control parameter. The last one deals with the nonlinear dynamics of a 3D elastic structure with uncertainties. The results obtained make it possible to validate the PLoM constrained by stochastic PDE but also provide further validation of the PLoM without constraint. △ Less

Submitted 27 October, 2020; originally announced October 2020.

Joint Beamforming and Phase Shift Optimization for Multicell IRS-aided OFDMA-URLLC Systems

Authors: Walid R. Ghanem, Vahid Jamali, Robert Schober

Abstract: This paper investigates the resource allocation algorithm design for intelligent reflecting surface (IRS) aided multiple-input single-output (MISO) orthogonal frequency division multiple access (OFDMA) multicell networks, where a set of base stations cooperate to serve a set of ultra-reliable low-latency communication (URLLC) users. The IRS is deployed to enhance the communication channel and incr… ▽ More This paper investigates the resource allocation algorithm design for intelligent reflecting surface (IRS) aided multiple-input single-output (MISO) orthogonal frequency division multiple access (OFDMA) multicell networks, where a set of base stations cooperate to serve a set of ultra-reliable low-latency communication (URLLC) users. The IRS is deployed to enhance the communication channel and increase reliability by creating a virtual line of sight for URLLC users with unfavorable propagation conditions. This is the first study on IRS-enhanced OFDMA-URLLC systems. The resource allocation algorithm design is formulated as an optimization problem for the maximization of the weighted system sum throughput while guaranteeing the quality of service of the URLLC users. The optimization problem is non-convex and finding the globally optimal solution entails a high computational complexity which is not desirable for real-time applications. Therefore, a suboptimal iterative algorithm is proposed which \textit{jointly} optimizes all optimization variables in each iteration using a new iterative rank minimization approach. The algorithm is guaranteed to converge to a locally optimal solution of the formulated optimization problem. Our simulation results show that the proposed IRS design facilitates URLLC and yields large performance gains compared to two baseline schemes. △ Less

Submitted 14 October, 2020; originally announced October 2020.

Comments: 9 pages, 5 figures, submitted for an IEEE conference publication. arXiv admin note: text overlap with arXiv:1910.06127

Optimal Resource Allocation for Multi-user OFDMA-URLLC MEC Systems

Authors: Walid R. Ghanem, Vahid Jamali, Robert Schober

Abstract: In this paper, we study resource allocation algorithm design for multi-user orthogonal frequency division multiple access (OFDMA) ultra-reliable low latency communication (URLLC) in mobile edge computing (MEC) systems. To meet the stringent end-to-end delay and reliability requirements of URLLC MEC systems, we propose joint uplink-downlink resource allocation and finite blocklength transmission. F… ▽ More In this paper, we study resource allocation algorithm design for multi-user orthogonal frequency division multiple access (OFDMA) ultra-reliable low latency communication (URLLC) in mobile edge computing (MEC) systems. To meet the stringent end-to-end delay and reliability requirements of URLLC MEC systems, we propose joint uplink-downlink resource allocation and finite blocklength transmission. Furthermore, we employ a partial time overlap between the uplink and downlink frames to minimize the end-to-end delay, which introduces a new time causality constraint. The proposed resource allocation algorithm is formulated as an optimization problem for minimization of the total weighted power consumption of the network under a constraint on the number of URLLC user bits computed within the maximum allowable computation time, i.e., the end-to-end delay of a computation task. Despite the non-convexity of the formulated optimization problem, we develop a globally optimal solution using a branch-and-bound approach based on discrete monotonic optimization theory. The branch-and-bound algorithm minimizes an upper bound on the total power consumption until convergence to the globally optimal value. Furthermore, to strike a balance between computational complexity and performance, we propose two efficient suboptimal algorithms based on successive convex approximation and second-order cone techniques. Our simulation results reveal that the proposed resource allocation algorithm design facilitates URLLC in MEC systems, and yields significant power savings compared to three baseline schemes. Moreover, our simulation results show that the proposed suboptimal algorithms offer different trade-offs between performance and complexity and attain a close-to-optimal performance at comparatively low complexity. △ Less

Submitted 22 September, 2020; originally announced September 2020.

Comments: 32 pages, 9 figures, submitted for an IEEE journal. arXiv admin note: substantial text overlap with arXiv:2005.04707

Drivers learn city-scale dynamic equilibrium

Authors: Ruda Zhang, Roger Ghanem

Abstract: Understanding driver behavior in on-demand mobility services is crucial for designing efficient and sustainable transport models. Drivers' delivery strategy is well understood, but their search strategy and learning process still lack an empirically validated model. Here we provide a game-theoretic model of driver search strategy and learning dynamics, interpret the collective outcome in a thermod… ▽ More Understanding driver behavior in on-demand mobility services is crucial for designing efficient and sustainable transport models. Drivers' delivery strategy is well understood, but their search strategy and learning process still lack an empirically validated model. Here we provide a game-theoretic model of driver search strategy and learning dynamics, interpret the collective outcome in a thermodynamic framework, and verify its various implications empirically. We capture driver search strategies in a multi-market oligopoly model, which has a unique Nash equilibrium and is globally asymptotically stable. The equilibrium can therefore be obtained via heuristic learning rules where drivers pursue the incentive gradient or simply imitate others. To help understand city-scale phenomena, we offer a macroscopic view with the laws of thermodynamics. With 870 million trips of over 50k drivers in New York City, we show that the equilibrium well explains the spatiotemporal patterns of driver search behavior, and estimate an empirical constitutive relation. We find that new drivers learn the equilibrium within a year, and those who stay longer learn better. The collective response to new competition is also as predicted. Among empirical studies of driver strategy in on-demand services, our work examines the longest period, the most trips, and is the largest for taxi industry. △ Less

Submitted 19 July, 2021; v1 submitted 24 August, 2020; originally announced August 2020.

Comments: 10 pages, 1 table, 5 figures

Normal-bundle Bootstrap

Authors: Ruda Zhang, Roger Ghanem

Abstract: Probabilistic models of data sets often exhibit salient geometric structure. Such a phenomenon is summed up in the manifold distribution hypothesis, and can be exploited in probabilistic learning. Here we present normal-bundle bootstrap (NBB), a method that generates new data which preserve the geometric structure of a given data set. Inspired by algorithms for manifold learning and concepts in di… ▽ More Probabilistic models of data sets often exhibit salient geometric structure. Such a phenomenon is summed up in the manifold distribution hypothesis, and can be exploited in probabilistic learning. Here we present normal-bundle bootstrap (NBB), a method that generates new data which preserve the geometric structure of a given data set. Inspired by algorithms for manifold learning and concepts in differential geometry, our method decomposes the underlying probability measure into a marginalized measure on a learned data manifold and conditional measures on the normal spaces. The algorithm estimates the data manifold as a density ridge, and constructs new data by bootstrap** projection vectors and adding them to the ridge. We apply our method to the inference of density ridge and related statistics, and data augmentation to reduce overfitting. △ Less

Submitted 27 July, 2020; originally announced July 2020.

MSC Class: 37M22; 53-08; 53A07; 62F40; 62G09

Joint Uplink-Downlink Resource Allocation for OFDMA-URLLC MEC Systems

Authors: Walid R. Ghanem, Vahid Jamali, Qiuyu Zhang, Robert Schober

Abstract: In this paper, we study resource allocation algorithm design for multiuser orthogonal frequency division multiple access (OFDMA) ultra-reliable low latency communication (URLLC) in mobile edge computing (MEC) systems. To achieve the stringent end-to-end delay and reliability requirements of URLLC MEC systems, we propose joint uplink-downlink resource allocation and finite blocklength transmission.… ▽ More In this paper, we study resource allocation algorithm design for multiuser orthogonal frequency division multiple access (OFDMA) ultra-reliable low latency communication (URLLC) in mobile edge computing (MEC) systems. To achieve the stringent end-to-end delay and reliability requirements of URLLC MEC systems, we propose joint uplink-downlink resource allocation and finite blocklength transmission. Furthermore, we propose a partial time overlap between the uplink and downlink frames to minimize the end-to-end delay, which introduces new time causality constraints. Then, the proposed resource allocation algorithm is formulated as an optimization problem for minimization of the total weighted transmit power of the network under constraints on the minimum quality-of-service regarding the number of computed URLLC user bits within the maximum allowable computing time, i.e., the end-to-end delay of a computation task. Due to the non-convexity of the optimization problem, finding the globally optimal solution entails a high computational complexity which is not tolerable for real-time applications. Therefore, a low-complexity algorithm based on successive convex approximation is proposed to find a high-quality sub-optimal solution. Our simulation results show that the proposed resource allocation algorithm design facilitates the application of URLLC in MEC systems, and yields significant power savings compared to a benchmark scheme. △ Less

Submitted 10 May, 2020; originally announced May 2020.

Comments: 8 pages, 4 figures, submitted to IEEE for possible publication

Environmental Economics and Uncertainty: Review and a Machine Learning Outlook

Authors: Ruda Zhang, Patrick Wingo, Rodrigo Duran, Kelly Rose, Jennifer Bauer, Roger Ghanem

Abstract: Economic assessment in environmental science concerns the measurement or valuation of environmental impacts, adaptation, and vulnerability. Integrated assessment modeling is a unifying framework of environmental economics, which attempts to combine key elements of physical, ecological, and socioeconomic systems. Uncertainty characterization in integrated assessment varies by component models: unce… ▽ More Economic assessment in environmental science concerns the measurement or valuation of environmental impacts, adaptation, and vulnerability. Integrated assessment modeling is a unifying framework of environmental economics, which attempts to combine key elements of physical, ecological, and socioeconomic systems. Uncertainty characterization in integrated assessment varies by component models: uncertainties associated with mechanistic physical models are often assessed with an ensemble of simulations or Monte Carlo sampling, while uncertainties associated with impact models are evaluated by conjecture or econometric analysis. Manifold sampling is a machine learning technique that constructs a joint probability model of all relevant variables which may be concentrated on a low-dimensional geometric structure. Compared with traditional density estimation methods, manifold sampling is more efficient especially when the data is generated by a few latent variables. The manifold-constrained joint probability model helps answer policy-making questions from prediction, to response, and prevention. Manifold sampling is applied to assess risk of offshore drilling in the Gulf of Mexico. △ Less

Submitted 24 April, 2020; originally announced April 2020.

Comments: 24 pages, 7 figures, 1 table. In Oxford Research Encyclopedia of Environmental Science. Oxford University Press

MSC Class: 58J65; 62H05

Resource Allocation for Secure Multi-User Downlink MISO-URLLC Systems

Authors: Walid R. Ghanem, Vahid Jamali, Robert Schober

Abstract: In this paper, we study resource allocation algorithm design for secure multi-user downlink ultra-reliable low latency communication (URLLC). To enhance physical layer security (PLS), the base station (BS) is equipped with multiple antennas and artificial noise (AN) is injected by the BS to impair the eavesdroppers' channels. To meet the stringent delay requirements in secure URLLC systems, short… ▽ More In this paper, we study resource allocation algorithm design for secure multi-user downlink ultra-reliable low latency communication (URLLC). To enhance physical layer security (PLS), the base station (BS) is equipped with multiple antennas and artificial noise (AN) is injected by the BS to impair the eavesdroppers' channels. To meet the stringent delay requirements in secure URLLC systems, short packet transmission (SPT) is adopted and taken into consideration for resource allocation design. The resource allocation algorithm design is formulated as an optimization problem for minimization of the total transmit power, while guaranteeing quality-of-service (QoS) constraints regarding the URLLC users' number of transmitted bits, packet error probability, information leakage, and delay. Due to the non-convexity of the optimization problem, finding a global solution entails a high computational complexity. Thus, we propose a low-complexity algorithm based successive convex approximation (SCA) to find a sub-optimal solution. Our simulation results show that the proposed resource allocation algorithm design ensures the secrecy of the URLLC users' transmissions, and yields significant power savings compared to a baseline scheme. △ Less

Submitted 26 February, 2020; originally announced February 2020.

Comments: 8 pages, 4 figures, accepted by IEEE International Conference on Communications (ICC), Dublin, Ireland, 2020. arXiv admin note: text overlap with arXiv:1910.06127

Probabilistic Learning on Manifolds

Authors: Christian Soize, Roger Ghanem

Abstract: This paper presents mathematical results in support of the methodology of the probabilistic learning on manifolds (PLoM) recently introduced by the authors, which has been used with success for analyzing complex engineering systems. The PLoM considers a given initial dataset constituted of a small number of points given in an Euclidean space, which are interpreted as independent realizations of a… ▽ More This paper presents mathematical results in support of the methodology of the probabilistic learning on manifolds (PLoM) recently introduced by the authors, which has been used with success for analyzing complex engineering systems. The PLoM considers a given initial dataset constituted of a small number of points given in an Euclidean space, which are interpreted as independent realizations of a vector-valued random variable for which its non-Gaussian probability measure is unknown but is, \textit{a priori}, concentrated in an unknown subset of the Euclidean space. The objective is to construct a learned dataset constituted of additional realizations that allow the evaluation of converged statistics. A transport of the probability measure estimated with the initial dataset is done through a linear transformation constructed using a reduced-order diffusion-maps basis. In this paper, it is proven that this transported measure is a marginal distribution of the invariant measure of a reduced-order Itô stochastic differential equation that corresponds to a dissipative Hamiltonian dynamical system. This construction allows for preserving the concentration of the probability measure. This property is shown by analyzing a distance between the random matrix constructed with the PLoM and the matrix representing the initial dataset, as a function of the dimension of the basis. It is further proven that this distance has a minimum for a dimension of the reduced-order diffusion-maps basis that is strictly smaller than the number of points in the initial dataset. Finally, a brief numerical application illustrates the mathematical results. △ Less

Submitted 28 February, 2020; originally announced February 2020.

Comments: 41 pages, 4 figures

MSC Class: 68Q32; 68T05; 62D05; 62G07; 62G09; 62H12

Sampling of Bayesian posteriors with a non-Gaussian probabilistic learning on manifolds from a small dataset

Authors: Christian Soize, Roger Ghanem

Abstract: This paper tackles the challenge presented by small-data to the task of Bayesian inference. A novel methodology, based on manifold learning and manifold sampling, is proposed for solving this computational statistics problem under the following assumptions: 1) neither the prior model nor the likelihood function are Gaussian and neither can be approximated by a Gaussian measure; 2) the number of fu… ▽ More This paper tackles the challenge presented by small-data to the task of Bayesian inference. A novel methodology, based on manifold learning and manifold sampling, is proposed for solving this computational statistics problem under the following assumptions: 1) neither the prior model nor the likelihood function are Gaussian and neither can be approximated by a Gaussian measure; 2) the number of functional input (system parameters) and functional output (quantity of interest) can be large; 3) the number of available realizations of the prior model is small, leading to the small-data challenge typically associated with expensive numerical simulations; the number of experimental realizations is also small; 4) the number of the posterior realizations required for decision is much larger than the available initial dataset. The method and its mathematical aspects are detailed. Three applications are presented for validation: The first two involve mathematical constructions aimed to develop intuition around the method and to explore its performance. The third example aims to demonstrate the operational value of the method using a more complex application related to the statistical inverse identification of the non-Gaussian matrix-valued random elasticity field of a damaged biological tissue (osteoporosis in a cortical bone) using ultrasonic waves. △ Less

Submitted 28 October, 2019; originally announced October 2019.

MSC Class: 60J20; 62F15; 68F15

Resource Allocation for Multi-User Downlink MISO OFDMA-URLLC Systems

Authors: Walid R. Ghanem, Vahid Jamali, Yan Sun, Robert Schober

Abstract: This paper considers the resource allocation algorithm design for downlink multiple-input single-output (MISO) orthogonal frequency division multiple access (OFDMA) ultra-reliable low latency communication (URLLC) systems. To meet the stringent delay requirements of URLLC, short packet transmission is adopted and taken into account for resource allocation algorithm design. The resource allocation… ▽ More This paper considers the resource allocation algorithm design for downlink multiple-input single-output (MISO) orthogonal frequency division multiple access (OFDMA) ultra-reliable low latency communication (URLLC) systems. To meet the stringent delay requirements of URLLC, short packet transmission is adopted and taken into account for resource allocation algorithm design. The resource allocation is optimized for maximization of the weighted system sum throughput subject to quality-of-service (QoS) constraints regarding the URLLC users' number of transmitted bits, packet error probability, and delay. Despite the non-convexity of the resulting optimization problem, the optimal solution is found via monotonic optimization. The corresponding optimal resource allocation policy can serve as a performance upper bound for sub-optimal low-complexity solutions. We develop such a low-complexity resource allocation algorithm to strike a balance between performance and complexity. Our simulation results reveal the importance of using multiple antennas for reducing the latency and improving the reliability of URLLC systems. Moreover, the proposed sub-optimal algorithm is shown to closely approach the performance of the proposed optimal algorithm and outperforms two baseline schemes by a considerable margin, especially when the users have heterogeneous delay requirements. Finally, conventional resource allocation designs based on Shannon's capacity formula are shown to be not applicable in MISO OFDMA-URLLC systems as they may violate the users' delay constraints. △ Less

Submitted 14 October, 2019; originally announced October 2019.

Comments: 30 pages, 9 figures, 1 Table, submitted for possible journal publication

Data-driven discovery of free-form governing differential equations

Authors: Steven Atkinson, Waad Subber, Li** Wang, Genghis Khan, Philippe Hawi, Roger Ghanem

Abstract: We present a method of discovering governing differential equations from data without the need to specify a priori the terms to appear in the equation. The input to our method is a dataset (or ensemble of datasets) corresponding to a particular solution (or ensemble of particular solutions) of a differential equation. The output is a human-readable differential equation with parameters calibrated… ▽ More We present a method of discovering governing differential equations from data without the need to specify a priori the terms to appear in the equation. The input to our method is a dataset (or ensemble of datasets) corresponding to a particular solution (or ensemble of particular solutions) of a differential equation. The output is a human-readable differential equation with parameters calibrated to the individual particular solutions provided. The key to our method is to learn differentiable models of the data that subsequently serve as inputs to a genetic programming algorithm in which graphs specify computation over arbitrary compositions of functions, parameters, and (potentially differential) operators on functions. Differential operators are composed and evaluated using recursive application of automatic differentiation, allowing our algorithm to explore arbitrary compositions of operators without the need for human intervention. We also demonstrate an active learning process to identify and remedy deficiencies in the proposed governing equations. △ Less

Submitted 11 November, 2019; v1 submitted 26 September, 2019; originally announced October 2019.

Comments: Approved for public release; distribution is unlimited

Demand, Supply, and Performance of Street-Hail Taxi

Authors: Ruda Zhang, Roger Ghanem

Abstract: Travel decisions are fundamental to understanding human mobility, urban economy, and sustainability, but measuring it is challenging and controversial. Previous studies of taxis are limited to taxi stands or hail markets at aggregate spatial units. Here we estimate the dynamic demand and supply of taxis in New York City (NYC) at street segment level, using in-vehicle Global Positioning System (GPS… ▽ More Travel decisions are fundamental to understanding human mobility, urban economy, and sustainability, but measuring it is challenging and controversial. Previous studies of taxis are limited to taxi stands or hail markets at aggregate spatial units. Here we estimate the dynamic demand and supply of taxis in New York City (NYC) at street segment level, using in-vehicle Global Positioning System (GPS) data which preserve individual privacy. To this end, we model taxi demand and supply as non-stationary Poisson random fields on the road network, and pickups result from income-maximizing drivers searching for impatient passengers. With 868 million trip records of all 13,237 licensed taxis in NYC in 2009 - 2013, we show that while taxi demand are almost the same in 2011 and 2012, it declined about 2% in spring 2013, possibly caused by transportation network companies (TNCs) and fare raise. Contrary to common impression, street-hail taxis out-perform TNCs such as Uber in high-demand locations, suggesting a taxi/TNC regulation change to reduce congestion and pollution. We show that our demand estimates are stable at different supply levels and across years, a property not observed in existing matching functions. We also validate that taxi pickups can be modeled as Poisson processes. Our method is thus simple, feasible, and reliable in estimating street-hail taxi activities at a high spatial resolution; it helps quantify the ongoing discussion on congestion charges to taxis and TNCs. △ Less

Submitted 27 September, 2019; originally announced September 2019.

Comments: 10 pages, 5 figures, 2 tables

MSC Class: 60K20; 60K30; 90B06; 90B40; 91B68 ACM Class: G.3; J.2

Journal ref: IEEE Transactions on Intelligent Transportation Systems. 2019

Solvers and precondtioners based on Gauss-Seidel and Jacobi algorithms for non-symmetric stochastic Galerkin system of equations

Authors: Ramakrishna Tipireddy, Eric T. Phipps, Roger G. Ghanem

Abstract: In this work, solvers and preconditioners based on Gauss-Seidel and Jacobi algorithms are explored for stochastic Galerkin discretization of partial differential equations (PDEs) with random input data. Gauss-Seidel and Jacobi algorithms are formulated such that the existing software is leveraged in the computational effort. These algorithms are also used as preconditioners to Krylov iterative met… ▽ More In this work, solvers and preconditioners based on Gauss-Seidel and Jacobi algorithms are explored for stochastic Galerkin discretization of partial differential equations (PDEs) with random input data. Gauss-Seidel and Jacobi algorithms are formulated such that the existing software is leveraged in the computational effort. These algorithms are also used as preconditioners to Krylov iterative methods. The solvers and preconditiners are compared with Krylov based iterative methods with the traditional mean-based preconditioner [13] and Kronecker-product preconditioner [17] by solving a steady state state advection-diffusion equation, which upon discretization, results in a non-symmetric positive definite matrix on left-hand-side. Numerical results show that an approximate version of Gauss-Seidel algorithm is a good preconditioner for GMRES to solve non-symmetric Galerkin system of equations. △ Less

Submitted 13 April, 2019; originally announced April 2019.

Particle Swarm Optimization Approaches for Primary User Emulation Attack Detection and Localization in Cognitive Radio Networks

Authors: Walid R. Ghanem, Reem E. Mohamed, Mona Shokair, Moawad I. Dessouky

Abstract: The primary user emulation attack (PUEA) is one of the common threats in cognitive radio networks (CRNs), in this problem, an attacker mimics the Primary User (PU) signal to deceive other secondary users (SUs) to make them leave the white spaces (free spaces) in the spectrum assigned by the PU. In this paper, the PUEA is detected and localized using the Time-Difference-Of-Arrival (TDOA) localizati… ▽ More The primary user emulation attack (PUEA) is one of the common threats in cognitive radio networks (CRNs), in this problem, an attacker mimics the Primary User (PU) signal to deceive other secondary users (SUs) to make them leave the white spaces (free spaces) in the spectrum assigned by the PU. In this paper, the PUEA is detected and localized using the Time-Difference-Of-Arrival (TDOA) localization technique. Particle Swarm Optimization (PSO) algorithms are proposed to solve the cost function of TDOA measurements. The PSO variants are developed by changing the parameters of the standard PSO such as inertia weight and acceleration constants. These approaches are presented and compared with the standard PSO in terms of convergence speed and processing time. This paper presents the first study of designing a PSO algorithm suitable for the localization problem and will be considered as a good guidance for applying the optimization algorithms in wireless positioning techniques. Mean square error (MSE) and cumulative distribution function (CDF) are used as the evaluation metrics to measure the accuracy of the proposed algorithms. Simulation results show that the proposed PSO approaches provide higher accuracy and faster convergence than the standard PSO and the Taylor series estimation (TSE). △ Less

Submitted 22 January, 2019; originally announced February 2019.

Comments: 16 pages

Resource Allocation for Multi-User Downlink URLLC-OFDMA Systems

Authors: Walid R. Ghanem, Vahid Jamali, Yan Sun, Robert Schober

Abstract: In this paper, we study resource allocation for downlink orthogonal frequency division multiple access (OFDMA) systems with the objective to enable ultra-reliable low latency communication (URLLC). To meet the stringent delay requirements of URLLC, the impact of short packet communication is taken into account for resource allocation algorithm design. In particular, the resource allocation design… ▽ More In this paper, we study resource allocation for downlink orthogonal frequency division multiple access (OFDMA) systems with the objective to enable ultra-reliable low latency communication (URLLC). To meet the stringent delay requirements of URLLC, the impact of short packet communication is taken into account for resource allocation algorithm design. In particular, the resource allocation design is formulated as a weighted system sum throughput maximization problem with quality-of-service (QoS) constraints for the URLLC users. The formulated problem is non-convex, and hence, finding the global optimum solution entails a high computational complexity. Thus, an algorithm based on successive convex optimization is proposed to find a sub-optimal solution with polynomial time complexity. Simulation results confirm that the proposed algorithm facilities URLLC and significantly improves the system sum throughput compared to two benchmark schemes. △ Less

Submitted 17 January, 2019; originally announced January 2019.

Comments: 6 pages

Entropy-based closure for probabilistic learning on manifolds

Authors: C. Soizea, R. Ghanem, C. Safta, X. Huan, Z. P. Vane, J. Oefelein, G. Lacaz, H. N. Najm, Q. Tang, X. Chen

Abstract: In a recent paper, the authors proposed a general methodology for probabilistic learning on manifolds. The method was used to generate numerical samples that are statistically consistent with an existing dataset construed as a realization from a non-Gaussian random vector. The manifold structure is learned using diffusion manifolds and the statistical sample generation is accomplished using a proj… ▽ More In a recent paper, the authors proposed a general methodology for probabilistic learning on manifolds. The method was used to generate numerical samples that are statistically consistent with an existing dataset construed as a realization from a non-Gaussian random vector. The manifold structure is learned using diffusion manifolds and the statistical sample generation is accomplished using a projected Ito stochastic differential equation. This probabilistic learning approach has been extended to polynomial chaos representation of databases on manifolds and to probabilistic nonconvex constrained optimization with a fixed budget of function evaluations. The methodology introduces an isotropic-diffusion kernel with hyperparameter ε. Currently, ε is more or less arbitrarily chosen. In this paper, we propose a selection criterion for identifying an optimal value of ε, based on a maximum entropy argument. The result is a comprehensive, closed, probabilistic model for characterizing data sets with hidden constraints. This entropy argument ensures that out of all possible models, this is the one that is the most uncertain beyond any specified constraints, which is selected. Applications are presented for several databases. △ Less

Submitted 28 March, 2018; v1 submitted 21 March, 2018; originally announced March 2018.

Comments: Co author is not happy with the paper would like to withdraw submission and improve the paper

Compressive sensing adaptation for polynomial chaos expansions

Authors: Panagiotis Tsilifis, Xun Huan, Cosmin Safta, Khachik Sargsyan, Guilhem Lacaze, Joseph C. Oefelein, Habib N. Najm, Roger G. Ghanem

Abstract: Basis adaptation in Homogeneous Chaos spaces rely on a suitable rotation of the underlying Gaussian germ. Several rotations have been proposed in the literature resulting in adaptations with different convergence properties. In this paper we present a new adaptation mechanism that builds on compressive sensing algorithms, resulting in a reduced polynomial chaos approximation with optimal sparsity.… ▽ More Basis adaptation in Homogeneous Chaos spaces rely on a suitable rotation of the underlying Gaussian germ. Several rotations have been proposed in the literature resulting in adaptations with different convergence properties. In this paper we present a new adaptation mechanism that builds on compressive sensing algorithms, resulting in a reduced polynomial chaos approximation with optimal sparsity. The developed adaptation algorithm consists of a two-step optimization procedure that computes the optimal coefficients and the input projection matrix of a low dimensional chaos expansion with respect to an optimally rotated basis. We demonstrate the attractive features of our algorithm through several numerical examples including the application on Large-Eddy Simulation (LES) calculations of turbulent combustion in a HIFiRE scramjet engine. △ Less

Submitted 27 November, 2018; v1 submitted 5 January, 2018; originally announced January 2018.

Comments: Submitted to Journal of Computational Physics

Journal ref: Journal of Computational Physics 380 (2019) 29-47

A Random Matrix Approach for Quantifying Model-Form Uncertainties in Turbulence Modeling

Authors: Heng Xiao, Jian-Xun Wang, Roger G. Ghanem

Abstract: With the ever-increasing use of Reynolds-Averaged Navier--Stokes (RANS) simulations in mission-critical applications, the quantification of model-form uncertainty in RANS models has attracted attention in the turbulence modeling community. Recently, a physics-based, nonparametric approach for quantifying model-form uncertainty in RANS simulations has been proposed, where Reynolds stresses are proj… ▽ More With the ever-increasing use of Reynolds-Averaged Navier--Stokes (RANS) simulations in mission-critical applications, the quantification of model-form uncertainty in RANS models has attracted attention in the turbulence modeling community. Recently, a physics-based, nonparametric approach for quantifying model-form uncertainty in RANS simulations has been proposed, where Reynolds stresses are projected to physically meaningful dimensions and perturbations are introduced only in the physically realizable limits. However, a challenge associated with this approach is to assess the amount of information introduced in the prior distribution and to avoid imposing unwarranted constraints. In this work we propose a random matrix approach for quantifying model-form uncertainties in RANS simulations with the realizability of the Reynolds stress guaranteed. Furthermore, the maximum entropy principle is used to identify the probability distribution that satisfies the constraints from available information but without introducing artificial constraints. We demonstrate that the proposed approach is able to ensure the realizability of the Reynolds stress, albeit in a different manner from the physics-based approach. Monte Carlo sampling of the obtained probability distribution is achieved by using polynomial chaos expansion to map independent Gaussian random fields to the Reynolds stress random field with the marginal distributions and correlation structures as specified. Numerical simulations on a typical flow with separation have shown physically reasonable results, which verifies the proposed approach. Therefore, the proposed method is a promising alternative to the physics-based approach for model-form uncertainty quantification of RANS simulations. The method explored in this work is general and can be extended to other complex physical systems in applied mechanics and engineering. △ Less

Submitted 31 March, 2016; originally announced March 2016.

Comments: 42 pages, 10 figures

Journal ref: Computer Methods in Applied Mechanics and Engineering,313, 941-965, 2017

Reduced Wiener Chaos representation of random fields via basis adaptation and projection

Authors: Panagiotis Tsilifis, Roger Ghanem

Abstract: A new characterization of random fields appearing in physical models is presented that is based on their well-known Homogeneous Chaos expansions. We take advantage of the adaptation capabilities of these expansions where the core idea is to rotate the basis of the underlying Gaussian Hilbert space, in order to achieve reduced functional representations that concentrate the induced probability meas… ▽ More A new characterization of random fields appearing in physical models is presented that is based on their well-known Homogeneous Chaos expansions. We take advantage of the adaptation capabilities of these expansions where the core idea is to rotate the basis of the underlying Gaussian Hilbert space, in order to achieve reduced functional representations that concentrate the induced probability measure in a lower dimensional subspace. For a smooth family of rotations along the domain of interest, the uncorrelated Gaussian inputs are transformed into a Gaussian process, thus introducing a mesoscale that captures intermediate characteristics of the quantity of interest. △ Less

Submitted 21 March, 2016; v1 submitted 15 March, 2016; originally announced March 2016.

Comments: Submitted to the Journal of Computational Physics

Data-driven probability concentration and sampling on manifold

Authors: Christian Soize, Roger Ghanem

Abstract: A new methodology is proposed for generating realizations of a random vector with values in a finite-dimensional Euclidean space that are statistically consistent with a data set of observations of this vector. The probability distribution of this random vector, while a-priori not known, is presumed to be concentrated on an unknown subset of the Euclidean space. A random matrix is introduced whose… ▽ More A new methodology is proposed for generating realizations of a random vector with values in a finite-dimensional Euclidean space that are statistically consistent with a data set of observations of this vector. The probability distribution of this random vector, while a-priori not known, is presumed to be concentrated on an unknown subset of the Euclidean space. A random matrix is introduced whose columns are independent copies of the random vector and for which the number of columns is the number of data points in the data set. The approach is based on the use of (i) the multidimensional kernel-density estimation method for estimating the probability distribution of the random matrix, (ii) a MCMC method for generating realizations for the random matrix, (iii) the diffusion-maps approach for discovering and characterizing the geometry and the structure of the data set, and (iv) a reduced-order representation of the random matrix, which is constructed using the diffusion-maps vectors associated with the first eigenvalues of the transition matrix relative to the given data set. The convergence aspects of the proposed methodology are analyzed and a numerical validation is explored through three applications of increasing complexity. The proposed method is found to be robust to noise levels and data complexity as well as to the intrinsic dimension of data and the size of experimental data sets. Both the methodology and the underlying mathematical framework presented in this paper contribute new capabilities and perspectives at the interface of uncertainty quantification, statistical data analysis, stochastic modeling and associated statistical inverse problems. △ Less

Submitted 8 March, 2016; originally announced March 2016.

Comments: Submitted to Journal of Computational Physics on September 27, 2015

Bilateral obstacle optimal control Problem

Authors: Radouen Ghanem, Billel Zireg

Abstract: In this work we consider the numerical resolution of the bilateral obstacle optimal control problem given in Bergounioux et al. Where the main feature of this problem is that the control and the obstacle are the same. In this work we consider the numerical resolution of the bilateral obstacle optimal control problem given in Bergounioux et al. Where the main feature of this problem is that the control and the obstacle are the same. △ Less

Submitted 21 December, 2015; originally announced December 2015.

Efficient Bayesian experimentation using an expected information gain lower bound

Authors: Panagiotis Tsilifis, Roger G. Ghanem, Paris Hajali

Abstract: Experimental design is crucial for inference where limitations in the data collection procedure are present due to cost or other restrictions. Optimal experimental designs determine parameters that in some appropriate sense make the data the most informative possible. In a Bayesian setting this is translated to updating to the best possible posterior. Information theoretic arguments have led to th… ▽ More Experimental design is crucial for inference where limitations in the data collection procedure are present due to cost or other restrictions. Optimal experimental designs determine parameters that in some appropriate sense make the data the most informative possible. In a Bayesian setting this is translated to updating to the best possible posterior. Information theoretic arguments have led to the formation of the expected information gain as a design criterion. This can be evaluated mainly by Monte Carlo sampling and maximized by using stochastic approximation methods, both known for being computationally expensive tasks. We propose a framework where a lower bound of the expected information gain is used as an alternative design criterion. In addition to alleviating the computational burden, this also addresses issues concerning estimation bias. The problem of permeability inference in a large contaminated area is used to demonstrate the validity of our approach where we employ the massively parallel version of the multiphase multicomponent simulator TOUGH2 to simulate contaminant transport and a Polynomial Chaos approximation of the forward model that further accelerates the objective function evaluations. The proposed methodology is demonstrated to a setting where field measurements are available. △ Less

Submitted 10 March, 2016; v1 submitted 29 May, 2015; originally announced June 2015.

Truncated hierarchical preconditioning for the stochastic Galerkin FEM

Authors: Bedřich Sousedík, Roger G. Ghanem

Abstract: Stochastic Galerkin finite element discretizations of partial differential equations with coefficients characterized by arbitrary distributions lead, in general, to fully block dense linear systems. We propose two novel strategies for constructing preconditioners for these systems to be used with Krylov subspace iterative solvers. In particular, we present a variation on of the hierarchical Schur… ▽ More Stochastic Galerkin finite element discretizations of partial differential equations with coefficients characterized by arbitrary distributions lead, in general, to fully block dense linear systems. We propose two novel strategies for constructing preconditioners for these systems to be used with Krylov subspace iterative solvers. In particular, we present a variation on of the hierarchical Schur complement preconditioner, developed recently by the authors, and an adaptation of the symmetric block Gauss-Seidel method. Both preconditioners take advantage of the hierarchical structure of global stochastic Galerkin matrices, and also, when applicable, of the decay of the norms of the stiffness matrices obtained from the polynomial chaos expansion of the coefficients. This decay allows to truncate the matrix-vector multiplications in the action of the preconditioners. Also, throughout the global matrix hierarchy, we approximate solves with certain submatrices by the associated diagonal block solves. The preconditioners thus require only a limited number of stiffness matrices obtained from the polynomial chaos expansion of the coefficients, and a preconditioner for the diagonal blocks of the global matrix. The performance is illustrated by numerical experiments. △ Less

Submitted 3 September, 2013; originally announced September 2013.

Comments: 17 pages, 4 figures, 6 tables

MSC Class: 65F08; 65F50 ACM Class: G.1.3; G.3

Journal ref: International Journal for Uncertainty Quantification 4(4), 333-348, 2014

Reduced chaos expansions with random coefficients in reduced-dimensional stochastic modeling of coupled problems

Authors: Maarten Arnst, Roger Ghanem, Eric Phipps, John Red-Horse

Abstract: Coupled problems with various combinations of multiple physics, scales, and domains can be found in numerous areas of science and engineering. A key challenge in the formulation and implementation of corresponding coupled models is to facilitate communication of information across physics, scale, and domain interfaces, as well as between iterations of solvers used for response computations. In a p… ▽ More Coupled problems with various combinations of multiple physics, scales, and domains can be found in numerous areas of science and engineering. A key challenge in the formulation and implementation of corresponding coupled models is to facilitate communication of information across physics, scale, and domain interfaces, as well as between iterations of solvers used for response computations. In a probabilistic context, any information that is to be communicated between subproblems or iterations should be characterized by an appropriate probabilistic representation. In this work, we consider stochastic coupled problems whose subproblems involve only uncertainties that are statistically independent of one another; for these problems, we present a characterization of the exchanged information by using a reduced chaos expansion with random coefficients. This expansion provides a reduced-dimensional representation of the exchanged information, while maintaining segregation between sources of uncertainty that stem from different subproblems. Further, we present a measure transformation that allows stochastic expansion methods to exploit this dimension reduction to obtain an efficient solution of subproblems in a reduced-dimensional space. We show that owing to the uncertainty source segregation, requisite orthonormal polynomials and quadrature rules can be readily obtained by tensorization. Finally, the proposed methodology is demonstrated by applying it to a multiphysics problem in nuclear engineering. △ Less

Submitted 4 July, 2012; originally announced July 2012.

Comments: arXiv admin note: text overlap with arXiv:1112.4772, arXiv:1112.4761

Hierarchical Schur complement preconditioner for the stochastic Galerkin finite element methods

Authors: Bedřich Sousedík, Roger G. Ghanem, Eric T. Phipps

Abstract: Use of the stochastic Galerkin finite element methods leads to large systems of linear equations obtained by the discretization of tensor product solution spaces along their spatial and stochastic dimensions. These systems are typically solved iteratively by a Krylov subspace method. We propose a preconditioner which takes an advantage of the recursive hierarchy in the structure of the global matr… ▽ More Use of the stochastic Galerkin finite element methods leads to large systems of linear equations obtained by the discretization of tensor product solution spaces along their spatial and stochastic dimensions. These systems are typically solved iteratively by a Krylov subspace method. We propose a preconditioner which takes an advantage of the recursive hierarchy in the structure of the global matrices. In particular, the matrices posses a recursive hierarchical two-by-two structure, with one of the submatrices block diagonal. Each one of the diagonal blocks in this submatrix is closely related to the deterministic mean-value problem, and the action of its inverse is in the implementation approximated by inner loops of Krylov iterations. Thus our hierarchical Schur complement preconditioner combines, on each level in the approximation of the hierarchical structure of the global matrix, the idea of Schur complement with loops for a number of mutually independent inner Krylov iterations, and several matrix-vector multiplications for the off-diagonal blocks. Neither the global matrix, nor the matrix of the preconditioner need to be formed explicitly. The ingredients include only the number of stiffness matrices from the truncated Karhunen-Loève expansion and a good preconditioned for the mean-value deterministic problem. We provide a condition number bound for a model elliptic problem and the performance of the method is illustrated by numerical experiments. △ Less

Submitted 15 January, 2013; v1 submitted 8 May, 2012; originally announced May 2012.

Comments: 15 pages, 2 figures, 9 tables, (updated numerical experiments)

MSC Class: 65F08; 65F50 ACM Class: G.1.3; G.3

Journal ref: Numerical Linear Algebra with Applications 21(1), 136-151, 2014

Measure transformation and efficient quadrature in reduced-dimensional stochastic modeling of coupled problems

Authors: Maarten Arnst, Roger Ghanem, Eric Phipps, John Red-Horse

Abstract: Coupled problems with various combinations of multiple physics, scales, and domains are found in numerous areas of science and engineering. A key challenge in the formulation and implementation of corresponding coupled numerical models is to facilitate the communication of information across physics, scale, and domain interfaces, as well as between the iterations of solvers used for response compu… ▽ More Coupled problems with various combinations of multiple physics, scales, and domains are found in numerous areas of science and engineering. A key challenge in the formulation and implementation of corresponding coupled numerical models is to facilitate the communication of information across physics, scale, and domain interfaces, as well as between the iterations of solvers used for response computations. In a probabilistic context, any information that is to be communicated between subproblems or iterations should be characterized by an appropriate probabilistic representation. Although the number of sources of uncertainty can be expected to be large in most coupled problems, our contention is that exchanged probabilistic information often resides in a considerably lower dimensional space than the sources themselves. In this work, we thus use a dimension-reduction technique for obtaining the representation of the exchanged information. The main subject of this work is the investigation of a measure-transformation technique that allows implementations to exploit this dimension reduction to achieve computational gains. The effectiveness of the proposed dimension-reduction and measure-transformation methodology is demonstrated through a multiphysics problem relevant to nuclear engineering. △ Less

Submitted 14 April, 2012; v1 submitted 20 December, 2011; originally announced December 2011.

Dimension reduction in stochastic modeling of coupled problems

Authors: Maarten Arnst, Roger Ghanem, Eric Phipps, John Red-Horse

Abstract: Coupled problems with various combinations of multiple physics, scales, and domains are found in numerous areas of science and engineering. A key challenge in the formulation and implementation of corresponding coupled numerical models is to facilitate the communication of information across physics, scale, and domain interfaces, as well as between the iterations of solvers used for response compu… ▽ More Coupled problems with various combinations of multiple physics, scales, and domains are found in numerous areas of science and engineering. A key challenge in the formulation and implementation of corresponding coupled numerical models is to facilitate the communication of information across physics, scale, and domain interfaces, as well as between the iterations of solvers used for response computations. In a probabilistic context, any information that is to be communicated between subproblems or iterations should be characterized by an appropriate probabilistic representation. Although the number of sources of uncertainty can be expected to be large in most coupled problems, our contention is that exchanged probabilistic information often resides in a considerably lower dimensional space than the sources themselves. This work thus presents an investigation into the characterization of the exchanged information by a reduced-dimensional representation and, in particular, by an adaptation of the Karhunen-Loeve decomposition. The effectiveness of the proposed dimension-reduction methodology is analyzed and demonstrated through a multiphysics problem relevant to nuclear engineering. △ Less

Submitted 14 April, 2012; v1 submitted 20 December, 2011; originally announced December 2011.

Large Deviation Theory for a Homogenized and "Corrected" Elliptic ODE

Authors: Guillaume Bal, Roger Ghanem, Ian Langmore

Abstract: We study a one-dimensional elliptic problem with highly oscillatory random diffusion coefficient. We derive a homogenized solution and a so-called Gaussian corrector. We also prove a "pointwise" large deviation principle (LDP) for the full solution and approximate this LDP with a more tractable form. These results allow one to access the limits of Gaussian correctors. In general, the corrector doe… ▽ More We study a one-dimensional elliptic problem with highly oscillatory random diffusion coefficient. We derive a homogenized solution and a so-called Gaussian corrector. We also prove a "pointwise" large deviation principle (LDP) for the full solution and approximate this LDP with a more tractable form. These results allow one to access the limits of Gaussian correctors. In general, the corrector does not capture the large deviation behavior. Applications to uncertainty quantification are considered. △ Less

Submitted 6 December, 2010; v1 submitted 3 December, 2010; originally announced December 2010.

MSC Class: 60H30

Optimal control of unilateral obstacle problem with a source term

Authors: Radouen Ghanem

Abstract: We consider an optimal control problem for the obstacle problem with an elliptic variational inequality. The obstacle function which is the control function is assumed in $H^{2}$. We use an approximate technique to introduce a family of problems governed by variational equations. We prove optimal solutions existence and give necessary optimality conditions. We consider an optimal control problem for the obstacle problem with an elliptic variational inequality. The obstacle function which is the control function is assumed in $H^{2}$. We use an approximate technique to introduce a family of problems governed by variational equations. We prove optimal solutions existence and give necessary optimality conditions. △ Less

Submitted 13 March, 2008; originally announced March 2008.

MSC Class: 35R35; 49J40; 49J20.

Equation-Free Particle-Based Computations: Coarse Projective Integration and Coarse Dynamic Renormalization in 2D

Authors: Yu Zou, Ioannis G. Kevrekidis, Roger G. Ghanem

Abstract: Equation-free approaches have been proposed in recent years for the computational study of multiscale phenomena in engineering problems where evolution equations for the coarse-grained, system-level behavior are not explicitly available. In this paper we study the dynamics of a diffusive particle system in a laminar shear flow, described by a two-dimensional Brownian motion; in particular, we… ▽ More Equation-free approaches have been proposed in recent years for the computational study of multiscale phenomena in engineering problems where evolution equations for the coarse-grained, system-level behavior are not explicitly available. In this paper we study the dynamics of a diffusive particle system in a laminar shear flow, described by a two-dimensional Brownian motion; in particular, we perform coarse projective integration and demonstrate the particle-based computation of coarse self-similar and asymptotically self-similar solutions for this problem. We use marginal and conditional Inverse Cumulative Distribution Functions (ICDFs) as the macroscopic observables of the evolving particle distribution. △ Less

Submitted 21 November, 2005; originally announced November 2005.

Comments: 14 pages, 12 figures. Submitted to a special volume of Industrial and Engineering Chemistry Research

MSC Class: 37F25

Coarse-graining the dynamics of coupled oscillators

Authors: Sung Joon Moon, R. Ghanem, I. G. Kevrekidis

Abstract: We present an equation-free computational approach to the study of the coarse-grained dynamics of {\it finite} assemblies of {\it non-identical} coupled oscillators at and near full synchronization. We use coarse-grained observables which account for the (rapidly develo**) correlations between phase angles and oscillator natural frequencies. Exploiting short bursts of appropriately initialized… ▽ More We present an equation-free computational approach to the study of the coarse-grained dynamics of {\it finite} assemblies of {\it non-identical} coupled oscillators at and near full synchronization. We use coarse-grained observables which account for the (rapidly develo**) correlations between phase angles and oscillator natural frequencies. Exploiting short bursts of appropriately initialized detailed simulations, we circumvent the derivation of closures for the long-term dynamics of the assembly statistics. △ Less

Submitted 24 February, 2006; v1 submitted 9 September, 2005; originally announced September 2005.

Comments: accepted for publication in Phys. Rev. Lett

Journal ref: Phys. Rev. Lett. 96, 144101 (2006)

Equation-Free Dynamic Renormalization: Self-Similarity in Multidimensional Particle System Dynamics

Authors: Yu Zou, Ioannis Kevrekidis, Roger Ghanem

Abstract: We present an equation-free dynamic renormalization approach to the computational study of coarse-grained, self-similar dynamic behavior in multidimensional particle systems. The approach is aimed at problems for which evolution equations for coarse-scale observables (e.g. particle density) are not explicitly available. Our illustrative example involves Brownian particles in a 2D Couette flow; m… ▽ More We present an equation-free dynamic renormalization approach to the computational study of coarse-grained, self-similar dynamic behavior in multidimensional particle systems. The approach is aimed at problems for which evolution equations for coarse-scale observables (e.g. particle density) are not explicitly available. Our illustrative example involves Brownian particles in a 2D Couette flow; marginal and conditional Inverse Cumulative Distribution Functions (ICDFs) constitute the macroscopic observables of the evolving particle distributions. △ Less

Submitted 17 May, 2005; originally announced May 2005.

Comments: 7 pages, 5 figures

MSC Class: 37F25