Showing 1–7 of 7 results for author: Geelen, R

Learning physics-based reduced-order models from data using nonlinear manifolds

Authors: Rudy Geelen, Laura Balzano, Stephen Wright, Karen Willcox

Abstract: We present a novel method for learning reduced-order models of dynamical systems using nonlinear manifolds. First, we learn the manifold by identifying nonlinear structure in the data through a general representation learning problem. The proposed approach is driven by embeddings of low-order polynomial form. A projection onto the nonlinear manifold reveals the algebraic structure of the reduced-s… ▽ More We present a novel method for learning reduced-order models of dynamical systems using nonlinear manifolds. First, we learn the manifold by identifying nonlinear structure in the data through a general representation learning problem. The proposed approach is driven by embeddings of low-order polynomial form. A projection onto the nonlinear manifold reveals the algebraic structure of the reduced-space system that governs the problem of interest. The matrix operators of the reduced-order model are then inferred from the data using operator inference. Numerical experiments on a number of nonlinear problems demonstrate the generalizability of the methodology and the increase in accuracy that can be obtained over reduced-order modeling methods that employ a linear subspace approximation. △ Less

Submitted 19 February, 2024; v1 submitted 5 August, 2023; originally announced August 2023.

Learning latent representations in high-dimensional state spaces using polynomial manifold constructions

Authors: Rudy Geelen, Laura Balzano, Karen Willcox

Abstract: We present a novel framework for learning cost-efficient latent representations in problems with high-dimensional state spaces through nonlinear dimension reduction. By enriching linear state approximations with low-order polynomial terms we account for key nonlinear interactions existing in the data thereby reducing the problem's intrinsic dimensionality. Two methods are introduced for learning t… ▽ More We present a novel framework for learning cost-efficient latent representations in problems with high-dimensional state spaces through nonlinear dimension reduction. By enriching linear state approximations with low-order polynomial terms we account for key nonlinear interactions existing in the data thereby reducing the problem's intrinsic dimensionality. Two methods are introduced for learning the representation of such low-dimensional, polynomial manifolds for embedding the data. The manifold parametrization coefficients can be obtained by regression via either a proper orthogonal decomposition or an alternating minimization based approach. Our numerical results focus on the one-dimensional Korteweg-de Vries equation where accounting for nonlinear correlations in the data was found to lower the representation error by up to two orders of magnitude compared to linear dimension reduction techniques. △ Less

Submitted 23 June, 2023; originally announced June 2023.

Symplectic model reduction of Hamiltonian systems using data-driven quadratic manifolds

Authors: Harsh Sharma, Hongliang Mu, Patrick Buchfink, Rudy Geelen, Silke Glas, Boris Kramer

Abstract: This work presents two novel approaches for the symplectic model reduction of high-dimensional Hamiltonian systems using data-driven quadratic manifolds. Classical symplectic model reduction approaches employ linear symplectic subspaces for representing the high-dimensional system states in a reduced-dimensional coordinate system. While these approximations respect the symplectic nature of Hamilto… ▽ More This work presents two novel approaches for the symplectic model reduction of high-dimensional Hamiltonian systems using data-driven quadratic manifolds. Classical symplectic model reduction approaches employ linear symplectic subspaces for representing the high-dimensional system states in a reduced-dimensional coordinate system. While these approximations respect the symplectic nature of Hamiltonian systems, linear basis approximations can suffer from slowly decaying Kolmogorov $N$-width, especially in wave-type problems, which then requires a large basis size. We propose two different model reduction methods based on recently developed quadratic manifolds, each presenting its own advantages and limitations. The addition of quadratic terms to the state approximation, which sits at the heart of the proposed methodologies, enables us to better represent intrinsic low-dimensionality in the problem at hand. Both approaches are effective for issuing predictions in settings well outside the range of their training data while providing more accurate solutions than the linear symplectic reduced-order models. △ Less

Submitted 24 August, 2023; v1 submitted 24 May, 2023; originally announced May 2023.

BASALISC: Programmable Hardware Accelerator for BGV Fully Homomorphic Encryption

Authors: Robin Geelen, Michiel Van Beirendonck, Hilder V. L. Pereira, Brian Huffman, Tynan McAuley, Ben Selfridge, Daniel Wagner, Georgios Dimou, Ingrid Verbauwhede, Frederik Vercauteren, David W. Archer

Abstract: Fully Homomorphic Encryption (FHE) allows for secure computation on encrypted data. Unfortunately, huge memory size, computational cost and bandwidth requirements limit its practicality. We present BASALISC, an architecture family of hardware accelerators that aims to substantially accelerate FHE computations in the cloud. BASALISC is the first to implement the BGV scheme with fully-packed bootstr… ▽ More Fully Homomorphic Encryption (FHE) allows for secure computation on encrypted data. Unfortunately, huge memory size, computational cost and bandwidth requirements limit its practicality. We present BASALISC, an architecture family of hardware accelerators that aims to substantially accelerate FHE computations in the cloud. BASALISC is the first to implement the BGV scheme with fully-packed bootstrap** -- the noise removal capability necessary for arbitrary-depth computation. It supports a customized version of bootstrap** that can be instantiated with hardware multipliers optimized for area and power. BASALISC is a three-abstraction-layer RISC architecture, designed for a 1 GHz ASIC implementation and underway toward 150mm2 die tape-out in a 12nm GF process. BASALISC's four-layer memory hierarchy includes a two-dimensional conflict-free inner memory layer that enables 32 Tb/s radix-256 NTT computations without pipeline stalls. Its conflict-resolution permutation hardware is generalized and re-used to compute BGV automorphisms without throughput penalty. BASALISC also has a custom multiply-accumulate unit to accelerate BGV key switching. The BASALISC toolchain comprises a custom compiler and a joint performance and correctness simulator. To evaluate BASALISC, we study its physical realizability, emulate and formally verify its core functional units, and we study its performance on a set of benchmarks. Simulation results show a speedup of more than 5,000 times over HElib -- a popular software FHE library. △ Less

Submitted 25 July, 2023; v1 submitted 27 May, 2022; originally announced May 2022.

Operator inference for non-intrusive model reduction with quadratic manifolds

Authors: Rudy Geelen, Stephen Wright, Karen Willcox

Abstract: This paper proposes a novel approach for learning a data-driven quadratic manifold from high-dimensional data, then employing this quadratic manifold to derive efficient physics-based reduced-order models. The key ingredient of the approach is a polynomial map** between high-dimensional states and a low-dimensional embedding. This map** consists of two parts: a representation in a linear subsp… ▽ More This paper proposes a novel approach for learning a data-driven quadratic manifold from high-dimensional data, then employing this quadratic manifold to derive efficient physics-based reduced-order models. The key ingredient of the approach is a polynomial map** between high-dimensional states and a low-dimensional embedding. This map** consists of two parts: a representation in a linear subspace (computed in this work using the proper orthogonal decomposition) and a quadratic component. The approach can be viewed as a form of data-driven closure modeling, since the quadratic component introduces directions into the approximation that lie in the orthogonal complement of the linear subspace, but without introducing any additional degrees of freedom to the low-dimensional representation. Combining the quadratic manifold approximation with the operator inference method for projection-based model reduction leads to a scalable non-intrusive approach for learning reduced-order models of dynamical systems. Applying the new approach to transport-dominated systems of partial differential equations illustrates the gains in efficiency that can be achieved over approximation in a linear subspace. △ Less

Submitted 26 December, 2022; v1 submitted 4 May, 2022; originally announced May 2022.

A Data-driven Approach to X-ray Spectral Fitting: Quasi-Deconvolution

Authors: Carter Lee Rhea, Julie Hlavacek-Larrondo, Ralph Kraft, Akos Bogdan, Rudy Geelen

Abstract: X-ray spectral fitting of astronomical sources requires convolving the intrinsic spectrum or model with the instrumental response. Standard forward modeling techniques have proven success in recovering the underlying physical parameters in moderate to high signal-to-noise regimes; however, they struggle to achieve the same level of accuracy in low signal-to-noise regimes. Additionally, the use of… ▽ More X-ray spectral fitting of astronomical sources requires convolving the intrinsic spectrum or model with the instrumental response. Standard forward modeling techniques have proven success in recovering the underlying physical parameters in moderate to high signal-to-noise regimes; however, they struggle to achieve the same level of accuracy in low signal-to-noise regimes. Additionally, the use of machine learning techniques on X-ray spectra requires access to the intrinsic spectrum. Therefore, the measured spectrum must be effectively deconvolved from the instrumental response. In this note, we explore numerical methods for inverting the matrix equation describing X-ray spectral convolution. We demonstrate that traditional methods are insufficient to recover the intrinsic X-ray spectrum and argue that a novel approach is required. △ Less

Submitted 13 May, 2021; originally announced May 2021.

Comments: 3 pages, Accepted in RNAAS

A phase-field formulation for dynamic cohesive fracture

Authors: Rudy J. M. Geelen, Yingjie Liu, Tianchen Hu, Michael R. Tupek, John E. Dolbow

Abstract: We extend a phase-field/gradient damage formulation for cohesive fracture to the dynamic case. The model is characterized by a regularized fracture energy that is linear in the damage field, as well as non-polynomial degradation functions. Two categories of degradation functions are examined, and a process to derive a given degradation function based on a local stress-strain response in the cohesi… ▽ More We extend a phase-field/gradient damage formulation for cohesive fracture to the dynamic case. The model is characterized by a regularized fracture energy that is linear in the damage field, as well as non-polynomial degradation functions. Two categories of degradation functions are examined, and a process to derive a given degradation function based on a local stress-strain response in the cohesive zone is presented. The resulting model is characterized by a linear elastic regime prior to the onset of damage, and controlled strain-softening thereafter. The governing equations are derived according to macro- and microforce balance theories, naturally accounting for the irreversible nature of the fracture process by introducing suitable constraints for the kinetics of the underlying microstructural changes. The model is complemented by an efficient staggered solution scheme based on an augmented Lagrangian method. Numerical examples demonstrate that the proposed model is a robust and effective method for simulating cohesive crack propagation, with particular emphasis on dynamic fracture. △ Less

Submitted 1 August, 2018; originally announced September 2018.