-
Shadowheart SGD: Distributed Asynchronous SGD with Optimal Time Complexity Under Arbitrary Computation and Communication Heterogeneity
Authors:
Alexander Tyurin,
Marta Pozzi,
Ivan Ilin,
Peter Richtárik
Abstract:
We consider nonconvex stochastic optimization problems in the asynchronous centralized distributed setup where the communication times from workers to a server can not be ignored, and the computation and communication times are potentially different for all workers. Using an unbiassed compression technique, we develop a new method-Shadowheart SGD-that provably improves the time complexities of all…
▽ More
We consider nonconvex stochastic optimization problems in the asynchronous centralized distributed setup where the communication times from workers to a server can not be ignored, and the computation and communication times are potentially different for all workers. Using an unbiassed compression technique, we develop a new method-Shadowheart SGD-that provably improves the time complexities of all previous centralized methods. Moreover, we show that the time complexity of Shadowheart SGD is optimal in the family of centralized methods with compressed communication. We also consider the bidirectional setup, where broadcasting from the server to the workers is non-negligible, and develop a corresponding method.
△ Less
Submitted 7 February, 2024;
originally announced February 2024.
-
Monitoring-Supported Value Generation for Managing Structures and Infrastructure Systems
Authors:
Antonios Kamariotis,
Eleni Chatzi,
Daniel Straub,
Nikolaos Dervilis,
Kai Goebel,
Aidan J. Hughes,
Geert Lombaert,
Costas Papadimitriou,
Konstantinos G. Papakonstantinou,
Matteo Pozzi,
Michael Todd,
Keith Worden
Abstract:
To maximize its value, the design, development and implementation of Structural Health Monitoring (SHM) should focus on its role in facilitating decision support. In this position paper, we offer perspectives on the synergy between SHM and decision-making. We propose a classification of SHM use cases aligning with various dimensions that are closely linked to the respective decision contexts. The…
▽ More
To maximize its value, the design, development and implementation of Structural Health Monitoring (SHM) should focus on its role in facilitating decision support. In this position paper, we offer perspectives on the synergy between SHM and decision-making. We propose a classification of SHM use cases aligning with various dimensions that are closely linked to the respective decision contexts. The types of decisions that have to be supported by the SHM system within these settings are discussed along with the corresponding challenges. We provide an overview of different classes of models that are required for integrating SHM in the decision-making process to support management and operation and maintenance of structures and infrastructure systems. Fundamental decision-theoretic principles and state-of-the-art methods for optimizing maintenance and operational decision-making under uncertainty are briefly discussed. Finally, we offer a viewpoint on the appropriate course of action for quantifying, validating and maximizing the added value generated by SHM. This work aspires to synthesize the different perspectives of the SHM, Prognostic Health Management (PHM), and reliability communities, and deliver a roadmap towards monitoring-based decision support.
△ Less
Submitted 4 January, 2024;
originally announced February 2024.
-
Hessian-informed Hamiltonian Monte Carlo for high-dimensional problems
Authors:
Mina Karimi,
Kaushik Dayal,
Matteo Pozzi
Abstract:
We investigate the effect of using local and non-local second derivative information on the performance of Hamiltonian Monte Carlo (HMC) sampling methods, for high-dimension non-Gaussian distributions, with application to Bayesian inference and nonlinear inverse problems. The Riemannian Manifold Hamiltonian Monte Carlo (RMHMC) method uses second and third derivative information to improve the perf…
▽ More
We investigate the effect of using local and non-local second derivative information on the performance of Hamiltonian Monte Carlo (HMC) sampling methods, for high-dimension non-Gaussian distributions, with application to Bayesian inference and nonlinear inverse problems. The Riemannian Manifold Hamiltonian Monte Carlo (RMHMC) method uses second and third derivative information to improve the performance of the HMC approach. We propose using the local Hessian information at the start of each iteration, instead of re-calculating the higher order derivatives in all sub-steps of the leapfrog updating algorithm. We compare the result of Hessian-informed HMC method using the local and nonlocal Hessian information, in a test bed of a high-dimensional log-normal distribution, related to a problem of inferring soil properties.
△ Less
Submitted 28 March, 2023;
originally announced May 2023.
-
High-dimensional Nonlinear Bayesian Inference of Poroelastic Fields from Pressure Data
Authors:
Mina Karimi,
Mehrdad Massoudi,
Kaushik Dayal,
Matteo Pozzi
Abstract:
We investigate solution methods for large-scale inverse problems governed by partial differential equations (PDEs) via Bayesian inference. The Bayesian framework provides a statistical setting to infer uncertain parameters from noisy measurements. To quantify posterior uncertainty, we adopt Markov Chain Monte Carlo (MCMC) approaches for generating samples. To increase the efficiency of these appro…
▽ More
We investigate solution methods for large-scale inverse problems governed by partial differential equations (PDEs) via Bayesian inference. The Bayesian framework provides a statistical setting to infer uncertain parameters from noisy measurements. To quantify posterior uncertainty, we adopt Markov Chain Monte Carlo (MCMC) approaches for generating samples. To increase the efficiency of these approaches in high-dimension, we make use of local information about gradient and Hessian of the target potential, also via Hamiltonian Monte Carlo (HMC). Our target application is inferring the field of soil permeability processing observations of pore pressure, using a nonlinear PDE poromechanics model for predicting pressure from permeability. We compare the performance of different sampling approaches in this and other settings. We also investigate the effect of dimensionality and non-gaussianity of distributions on the performance of different sampling methods.
△ Less
Submitted 6 February, 2023;
originally announced February 2023.
-
Learning Skills from Demonstrations: A Trend from Motion Primitives to Experience Abstraction
Authors:
Mehrdad Tavassoli,
Sunny Katyara,
Maria Pozzi,
Nikhil Deshpande,
Darwin G. Caldwell,
Domenico Prattichizzo
Abstract:
The uses of robots are changing from static environments in factories to encompass novel concepts such as Human-Robot Collaboration in unstructured settings. Pre-programming all the functionalities for robots becomes impractical, and hence, robots need to learn how to react to new events autonomously, just like humans. However, humans, unlike machines, are naturally skilled in responding to unexpe…
▽ More
The uses of robots are changing from static environments in factories to encompass novel concepts such as Human-Robot Collaboration in unstructured settings. Pre-programming all the functionalities for robots becomes impractical, and hence, robots need to learn how to react to new events autonomously, just like humans. However, humans, unlike machines, are naturally skilled in responding to unexpected circumstances based on either experiences or observations. Hence, embedding such anthropoid behaviours into robots entails the development of neuro-cognitive models that emulate motor skills under a robot learning paradigm. Effective encoding of these skills is bound to the proper choice of tools and techniques. This paper studies different motion and behaviour learning methods ranging from Movement Primitives (MP) to Experience Abstraction (EA), applied to different robotic tasks. These methods are scrutinized and then experimentally benchmarked by reconstructing a standard pick-n-place task. Apart from providing a standard guideline for the selection of strategies and algorithms, this paper aims to draw a perspectives on their possible extensions and improvements
△ Less
Submitted 14 October, 2022;
originally announced October 2022.
-
Energetic Formulation of Large-Deformation Poroelasticity
Authors:
Mina Karimi,
Mehrdad Massoudi,
Noel Walkington,
Matteo Pozzi,
Kaushik Dayal
Abstract:
The modeling of coupled fluid transport and deformation in a porous medium is essential to predict the various geomechanical process such as CO2 sequestration, hydraulic fracturing, and so on. Current applications of interest, for instance, that include fracturing or damage of the solid phase, require a nonlinear description of the large deformations that can occur. This paper presents a variation…
▽ More
The modeling of coupled fluid transport and deformation in a porous medium is essential to predict the various geomechanical process such as CO2 sequestration, hydraulic fracturing, and so on. Current applications of interest, for instance, that include fracturing or damage of the solid phase, require a nonlinear description of the large deformations that can occur. This paper presents a variational energy-based continuum mechanics framework to model large-deformation poroelasticity. The approach begins from the total free energy density that is additively composed of the free energy of the components. A variational procedure then provides the balance of momentum, fluid transport balance, and pressure relations. A numerical approach based on finite elements is applied to analyze the behavior of saturated and unsaturated porous media using a nonlinear constitutive model for the solid skeleton. Examples studied include the Terzaghi and Mandel problems; a gas-liquid phase-changing fluid; multiple immiscible gases; and unsaturated systems where we model injection of fluid into soil. The proposed variational approach can potentially have advantages for numerical methods as well as for combining with data-driven models in a Bayesian framework.
△ Less
Submitted 30 December, 2021;
originally announced December 2021.
-
Optimal Inspection of Network Systems via Value of Information Analysis
Authors:
Chaochao Lin,
Junho Song,
Matteo Pozzi
Abstract:
This paper develops computable metrics to assign priorities for information collection on network systems made up by binary components. Components are worth inspecting because their condition state is uncertain and the system functioning depends on it. The Value of Information (VoI) allows assessing the impact of information in decision making under uncertainty, including the precision of the obse…
▽ More
This paper develops computable metrics to assign priorities for information collection on network systems made up by binary components. Components are worth inspecting because their condition state is uncertain and the system functioning depends on it. The Value of Information (VoI) allows assessing the impact of information in decision making under uncertainty, including the precision of the observation, the available actions and the expected economic loss. Some VoI-based metrics for system-level and component-level maintenance actions, defined as "global" and "local" metrics, respectively, are introduced, analyzed and applied to series and parallel systems. Their computationally complexity of applications to general networks is discussed and, to tame the complexity for the local metric assessment, a heuristic is presented and its performance is compared on some case studies.
△ Less
Submitted 9 June, 2021;
originally announced June 2021.
-
Information Avoidance and Overvaluation in Sequential Decision Making under Epistemic Constraints
Authors:
Shuo Li,
Matteo Pozzi
Abstract:
Decision makers involved in the management of civil assets and systems usually take actions under constraints imposed by societal regulations. Some of these constraints are related to epistemic quantities, as the probability of failure events and the corresponding risks. Sensors and inspectors can provide useful information supporting the control process (e.g. the maintenance process of an asset),…
▽ More
Decision makers involved in the management of civil assets and systems usually take actions under constraints imposed by societal regulations. Some of these constraints are related to epistemic quantities, as the probability of failure events and the corresponding risks. Sensors and inspectors can provide useful information supporting the control process (e.g. the maintenance process of an asset), and decisions about collecting this information should rely on an analysis of its cost and value. When societal regulations encode an economic perspective that is not aligned with that of the decision makers, the Value of Information (VoI) can be negative (i.e., information sometimes hurts), and almost irrelevant information can even have a significant value (either positive or negative), for agents acting under these epistemic constraints. We refer to these phenomena as Information Avoidance (IA) and Information OverValuation (IOV). In this paper, we illustrate how to assess VoI in sequential decision making under epistemic constraints (as those imposed by societal regulations), by modeling a Partially Observable Markov Decision Processes (POMDP) and evaluating non optimal policies via Finite State Controllers (FSCs). We focus on the value of collecting information at current time, and on that of collecting sequential information, we illustrate how these values are related and we discuss how IA and IOV can occur in those settings.
△ Less
Submitted 9 June, 2021;
originally announced June 2021.
-
Using Reinforcement Learning to Perform Qubit Routing in Quantum Compilers
Authors:
Matteo G. Pozzi,
Steven J. Herbert,
Akash Sengupta,
Robert D. Mullins
Abstract:
"Qubit routing" refers to the task of modifying quantum circuits so that they satisfy the connectivity constraints of a target quantum computer. This involves inserting SWAP gates into the circuit so that the logical gates only ever occur between adjacent physical qubits. The goal is to minimise the circuit depth added by the SWAP gates.
In this paper, we propose a qubit routing procedure that u…
▽ More
"Qubit routing" refers to the task of modifying quantum circuits so that they satisfy the connectivity constraints of a target quantum computer. This involves inserting SWAP gates into the circuit so that the logical gates only ever occur between adjacent physical qubits. The goal is to minimise the circuit depth added by the SWAP gates.
In this paper, we propose a qubit routing procedure that uses a modified version of the deep Q-learning paradigm. The system is able to outperform the qubit routing procedures from two of the most advanced quantum compilers currently available, on both random and realistic circuits, across near-term architecture sizes.
△ Less
Submitted 31 July, 2020;
originally announced July 2020.
-
Synchronicity and pure bending of piezoelectric bimorphs: a new approach to kinetic energy harvesting
Authors:
Michele Pozzi
Abstract:
Kinetic energy harvesting with piezoelectric bimorphs has attracted considerable research interest in recent years. Many works have been dedicated to the modelling and optimisation of the cantilevered geometry to increase power density, bandwidth, etc. The increased efficiency coming from the use of trapezoidal beams has been recognised, but little has been done to produce the same uniform strain…
▽ More
Kinetic energy harvesting with piezoelectric bimorphs has attracted considerable research interest in recent years. Many works have been dedicated to the modelling and optimisation of the cantilevered geometry to increase power density, bandwidth, etc. The increased efficiency coming from the use of trapezoidal beams has been recognised, but little has been done to produce the same uniform strain within the most commonly available rectangular beams. This work proposes a new approach via a smart compliant structure which permits to deform a set of bimorphs in pure bending. Furthermore, since the deflections are synchronous, the power signals produced are in phase and power conditioning is simplified and made more efficient. The kinematic requirements for uniform strain are discussed, the novel structure is proposed and modelled with finite elements, a prototype is presented and characterised to support the modelling. The proposed structure induces almost perfectly uniform strain in the piezoelectric beams for all useful rotation angles, demonstrating that, compared to a traditional cantilever, twice as many charges can be produced when the same maximum strain is applied to the material. Synchronicity is also experimentally verified for the prototype, as power signals resulting from impact excitation are observed to be in phase. The principle of synchronous pure bending via helper structures can be applied in general to increase the performance of piezoelectric energy harvesters.
△ Less
Submitted 18 December, 2017;
originally announced February 2018.
-
Analytical Modelling of a Plucked Piezoelectric Bimorph for Energy Harvesting
Authors:
Michele Pozzi
Abstract:
Energy harvesting (EH) is a multidisciplinary research area, involving physics, materials science and engineering, with the objective of providing renewable sources of sufficient power to operate targeted low-power applications. Piezoelectric transducers are often used for vibrational, inertial and direct movement EH. One problem is that, due to the stiffness of the most common material (PZT) and…
▽ More
Energy harvesting (EH) is a multidisciplinary research area, involving physics, materials science and engineering, with the objective of providing renewable sources of sufficient power to operate targeted low-power applications. Piezoelectric transducers are often used for vibrational, inertial and direct movement EH. One problem is that, due to the stiffness of the most common material (PZT) and typically useful sizes, intrinsic resonant frequencies are normally high, whereas the available power is often concentrated at low frequencies. The aim of the plucking technique of frequency up-conversion, also known as "pizzicato" excitation, is to bridge this frequency gap. In this paper, the technique is modelled analytically. The analytical model is developed starting from the Euler-Bernoulli beam equations modified for piezoelectric coupling. A system of differential equations and associated initial conditions are derived which describe the free vibration of a piezoelectric bimorph in the last part of the plucking excitation, i.e. after release. The system permits the calculation of the mechanical response and the time evolution of the power generated and represents a ready-to-use modelling tool which will be specially useful for optimisation work.
△ Less
Submitted 31 March, 2012;
originally announced April 2012.
