-
Multiobjective Optimization of Non-Smooth PDE-Constrained Problems
Authors:
Marco Bernreuther,
Michael Dellnitz,
Bennet Gebken,
Georg Müller,
Sebastian Peitz,
Konstantin Sonntag,
Stefan Volkwein
Abstract:
Multiobjective optimization plays an increasingly important role in modern applications, where several criteria are often of equal importance. The task in multiobjective optimization and multiobjective optimal control is therefore to compute the set of optimal compromises (the Pareto set) between the conflicting objectives. The advances in algorithms and the increasing interest in Pareto-optimal s…
▽ More
Multiobjective optimization plays an increasingly important role in modern applications, where several criteria are often of equal importance. The task in multiobjective optimization and multiobjective optimal control is therefore to compute the set of optimal compromises (the Pareto set) between the conflicting objectives. The advances in algorithms and the increasing interest in Pareto-optimal solutions have led to a wide range of new applications related to optimal and feedback control - potentially with non-smoothness both on the level of the objectives or in the system dynamics. This results in new challenges such as dealing with expensive models (e.g., governed by partial differential equations (PDEs)) and develo** dedicated algorithms handling the non-smoothness. Since in contrast to single-objective optimization, the Pareto set generally consists of an infinite number of solutions, the computational effort can quickly become challenging, which is particularly problematic when the objectives are costly to evaluate or when a solution has to be presented very quickly. This article gives an overview of recent developments in the field of multiobjective optimization of non-smooth PDE-constrained problems. In particular we report on the advances achieved within Project 2 "Multiobjective Optimization of Non-Smooth PDE-Constrained Problems - Switches, State Constraints and Model Order Reduction" of the DFG Priority Programm 1962 "Non-smooth and Complementarity-based Distributed Parameter Systems: Simulation and Hierarchical Optimization".
△ Less
Submitted 2 August, 2023;
originally announced August 2023.
-
On the Dynamical Hierarchy in Gathering Protocols with Circulant Topologies
Authors:
Raphael Gerlach,
Sören von der Gracht,
Michael Dellnitz
Abstract:
In this article we investigate the convergence behavior of gathering protocols with fixed circulant topologies using tools form dynamical systems. Given a fixed number of mobile entities moving in the Euclidean plane, we model a (linear) gathering protocol as a system of (linear) ordinary differential equations whose equilibria are exactly all possible gathering points. Then, for a circulant topol…
▽ More
In this article we investigate the convergence behavior of gathering protocols with fixed circulant topologies using tools form dynamical systems. Given a fixed number of mobile entities moving in the Euclidean plane, we model a (linear) gathering protocol as a system of (linear) ordinary differential equations whose equilibria are exactly all possible gathering points. Then, for a circulant topology we derive a decomposition of the state space into stable invariant subspaces with different convergence rates by utilizing tools form dynamical systems theory. It turns out, that decomposition is identical for every (linear) circulant gathering protocol, whereas only the convergence rates depend on the weights in interaction graph itself. We end this article with a brief outlook on robots with limited viewing range.
△ Less
Submitted 28 May, 2024; v1 submitted 11 May, 2023;
originally announced May 2023.
-
Efficient time step** for numerical integration using reinforcement learning
Authors:
Michael Dellnitz,
Eyke Hüllermeier,
Marvin Lücke,
Sina Ober-Blöbaum,
Christian Offen,
Sebastian Peitz,
Karlson Pfannschmidt
Abstract:
Many problems in science and engineering require an efficient numerical approximation of integrals or solutions to differential equations. For systems with rapidly changing dynamics, an equidistant discretization is often inadvisable as it either results in prohibitively large errors or computational effort. To this end, adaptive schemes, such as solvers based on Runge--Kutta pairs, have been deve…
▽ More
Many problems in science and engineering require an efficient numerical approximation of integrals or solutions to differential equations. For systems with rapidly changing dynamics, an equidistant discretization is often inadvisable as it either results in prohibitively large errors or computational effort. To this end, adaptive schemes, such as solvers based on Runge--Kutta pairs, have been developed which adapt the step size based on local error estimations at each step. While the classical schemes apply very generally and are highly efficient on regular systems, they can behave sub-optimal when an inefficient step rejection mechanism is triggered by structurally complex systems such as chaotic systems. To overcome these issues, we propose a method to tailor numerical schemes to the problem class at hand. This is achieved by combining simple, classical quadrature rules or ODE solvers with data-driven time-step** controllers. Compared with learning solution operators to ODEs directly, it generalises better to unseen initial data as our approach employs classical numerical schemes as base methods. At the same time it can make use of identified structures of a problem class and, therefore, outperforms state-of-the-art adaptive schemes. Several examples demonstrate superior efficiency. Source code is available at https://github.com/lueckem/quadrature-ML.
△ Less
Submitted 3 March, 2022; v1 submitted 8 April, 2021;
originally announced April 2021.
-
ROM-based multiobjective optimization of elliptic PDEs via numerical continuation
Authors:
Stefan Banholzer,
Bennet Gebken,
Michael Dellnitz,
Sebastian Peitz,
Stefan Volkwein
Abstract:
Multiobjective optimization plays an increasingly important role in modern applications, where several objectives are often of equal importance. The task in multiobjective optimization and multiobjective optimal control is therefore to compute the set of optimal compromises (the Pareto set) between the conflicting objectives. Since the Pareto set generally consists of an infinite number of solutio…
▽ More
Multiobjective optimization plays an increasingly important role in modern applications, where several objectives are often of equal importance. The task in multiobjective optimization and multiobjective optimal control is therefore to compute the set of optimal compromises (the Pareto set) between the conflicting objectives. Since the Pareto set generally consists of an infinite number of solutions, the computational effort can quickly become challenging which is particularly problematic when the objectives are costly to evaluate as is the case for models governed by partial differential equations (PDEs). To decrease the numerical effort to an affordable amount, surrogate models can be used to replace the expensive PDE evaluations. Existing multiobjective optimization methods using model reduction are limited either to low parameter dimensions or to few (ideally two) objectives. In this article, we present a combination of the reduced basis model reduction method with a continuation approach using inexact gradients. The resulting approach can handle an arbitrary number of objectives while yielding a significant reduction in computing time.
△ Less
Submitted 21 June, 2019;
originally announced June 2019.
-
Deep Model Predictive Control with Online Learning for Complex Physical Systems
Authors:
Katharina Bieker,
Sebastian Peitz,
Steven L. Brunton,
J. Nathan Kutz,
Michael Dellnitz
Abstract:
The control of complex systems is of critical importance in many branches of science, engineering, and industry. Controlling an unsteady fluid flow is particularly important, as flow control is a key enabler for technologies in energy (e.g., wind, tidal, and combustion), transportation (e.g., planes, trains, and automobiles), security (e.g., tracking airborne contamination), and health (e.g., arti…
▽ More
The control of complex systems is of critical importance in many branches of science, engineering, and industry. Controlling an unsteady fluid flow is particularly important, as flow control is a key enabler for technologies in energy (e.g., wind, tidal, and combustion), transportation (e.g., planes, trains, and automobiles), security (e.g., tracking airborne contamination), and health (e.g., artificial hearts and artificial respiration). However, the high-dimensional, nonlinear, and multi-scale dynamics make real-time feedback control infeasible. Fortunately, these high-dimensional systems exhibit dominant, low-dimensional patterns of activity that can be exploited for effective control in the sense that knowledge of the entire state of a system is not required. Advances in machine learning have the potential to revolutionize flow control given its ability to extract principled, low-rank feature spaces characterizing such complex systems. We present a novel deep learning model predictive control (DeepMPC) framework that exploits low-rank features of the flow in order to achieve considerable improvements to control performance. Instead of predicting the entire fluid state, we use a recurrent neural network (RNN) to accurately predict the control relevant quantities of the system. The RNN is then embedded into a MPC framework to construct a feedback loop, and incoming sensor data is used to perform online updates to improve prediction accuracy. The results are validated using varying fluid flow examples of increasing complexity.
△ Less
Submitted 24 May, 2019;
originally announced May 2019.
-
Revealing the intrinsic geometry of finite dimensional invariant sets of infinite dimensional dynamical systems
Authors:
Raphael Gerlach,
Péter Koltai,
Michael Dellnitz
Abstract:
Embedding techniques allow the approximations of finite dimensional attractors and manifolds of infinite dimensional dynamical systems via subdivision and continuation methods. These approximations give a topological one-to-one image of the original set. In order to additionally reveal their geometry we use diffusion mapst o find intrinsic coordinates. We illustrate our results on the unstable man…
▽ More
Embedding techniques allow the approximations of finite dimensional attractors and manifolds of infinite dimensional dynamical systems via subdivision and continuation methods. These approximations give a topological one-to-one image of the original set. In order to additionally reveal their geometry we use diffusion mapst o find intrinsic coordinates. We illustrate our results on the unstable manifold of the one-dimensional Kuramoto--Sivashinsky equation, as well as for the attractor of the Mackey-Glass delay differential equation.
△ Less
Submitted 23 February, 2019;
originally announced February 2019.
-
On the Equivariance Properties of Self-adjoint Matrices
Authors:
Michael Dellnitz,
Bennet Gebken,
Raphael Gerlach,
Stefan Klus
Abstract:
We investigate self-adjoint matrices $A\in\mathbb{R}^{n,n}$ with respect to their equivariance properties. We show in particular that a matrix is self-adjoint if and only if it is equivariant with respect to the action of a group $Γ_2(A)\subset \mathbf{O}(n)$ which is isomorphic to $\otimes_{k=1}^n\mathbf{Z}_2$. If the self-adjoint matrix possesses multiple eigenvalues -- this may, for instance, b…
▽ More
We investigate self-adjoint matrices $A\in\mathbb{R}^{n,n}$ with respect to their equivariance properties. We show in particular that a matrix is self-adjoint if and only if it is equivariant with respect to the action of a group $Γ_2(A)\subset \mathbf{O}(n)$ which is isomorphic to $\otimes_{k=1}^n\mathbf{Z}_2$. If the self-adjoint matrix possesses multiple eigenvalues -- this may, for instance, be induced by symmetry properties of an underlying dynamical system -- then $A$ is even equivariant with respect to the action of a group $Γ(A) \simeq \prod_{i = 1}^k \mathbf{O}(m_i)$ where $m_1,\ldots,m_k$ are the multiplicities of the eigenvalues $λ_1,\ldots,λ_k$ of $A$. We discuss implications of this result for equivariant bifurcation problems, and we briefly address further applications for the Procrustes problem, graph symmetries and Taylor expansions.
△ Less
Submitted 23 September, 2019; v1 submitted 22 February, 2019;
originally announced February 2019.
-
A set-oriented path following method for the approximation of parameter dependent attractors
Authors:
R. Gerlach,
A. Ziessler,
B. Eckhardt,
M. Dellnitz
Abstract:
In this work we present a set-oriented path following method for the computation of relative global attractors of parameter-dependent dynamical systems. We start with an initial approximation of the relative global attractor for a fixed parameter $λ_0$ computed by a set-oriented subdivision method. By using previously obtained approximations of the parameter-dependent relative global attractor we…
▽ More
In this work we present a set-oriented path following method for the computation of relative global attractors of parameter-dependent dynamical systems. We start with an initial approximation of the relative global attractor for a fixed parameter $λ_0$ computed by a set-oriented subdivision method. By using previously obtained approximations of the parameter-dependent relative global attractor we can track it with respect to a one-dimensional parameter $λ> λ_0$ without restarting the whole subdivision procedure. We illustrate the feasibility of the set-oriented path following method by exploring the dynamics in models for shear flows during the transition to turbulence.
△ Less
Submitted 21 February, 2019;
originally announced February 2019.
-
The numerical computation of unstable manifolds for infinite dimensional dynamical systems by embedding techniques
Authors:
Adrian Ziessler,
Michael Dellnitz,
Raphael Gerlach
Abstract:
In this work we extend the novel framework developed by Dellnitz, Hessel-von Molo and Ziessler to the computation of finite dimensional unstable manifolds of infinite dimensional dynamical systems. To this end, we adapt a set-oriented continuation technique developed by Dellnitz and Hohmann for the computation of such objects of finite dimensional systems with the results obtained in the work of D…
▽ More
In this work we extend the novel framework developed by Dellnitz, Hessel-von Molo and Ziessler to the computation of finite dimensional unstable manifolds of infinite dimensional dynamical systems. To this end, we adapt a set-oriented continuation technique developed by Dellnitz and Hohmann for the computation of such objects of finite dimensional systems with the results obtained in the work of Dellnitz, Hessel-von Molo and Ziessler. We show how to implement this approach for the analysis of partial differential equations and illustrate its feasibility by computing unstable manifolds of the one-dimensional Kuramoto-Sivashinsky equation as well as for the Mackey-Glass delay differential equation.
△ Less
Submitted 28 August, 2018; v1 submitted 27 August, 2018;
originally announced August 2018.
-
Koopman Operator-Based Finite-Control-Set Model Predictive Control for Electrical Drives
Authors:
Sören Hanke,
Sebastian Peitz,
Oliver Wallscheid,
Stefan Klus,
Joachim Böcker,
Michael Dellnitz
Abstract:
Predictive control of power electronic systems always requires a suitable model of the plant. Using typical physics-based white box models, a trade-off between model complexity (i.e. accuracy) and computational burden has to be made. This is a challenging task with a lot of constraints, since the model order is directly linked to the number of system states. Even though white-box models show suita…
▽ More
Predictive control of power electronic systems always requires a suitable model of the plant. Using typical physics-based white box models, a trade-off between model complexity (i.e. accuracy) and computational burden has to be made. This is a challenging task with a lot of constraints, since the model order is directly linked to the number of system states. Even though white-box models show suitable performance in most cases, parasitic real-world effects often cannot be modeled satisfactorily with an expedient computational load. Hence, a Koopman operator-based model reduction technique is presented which directly links the control action to the system's outputs in a black-box fashion. The Koopman operator is a linear but infinite-dimensional operator describing the dynamics of observables of nonlinear autonomous dynamical systems which can be nicely applied to the switching principle of power electronic devices. Following this data-driven approach, the model order and the number of system states are decoupled which allows us to consider more complex systems. Extensive experimental tests with an automotive-type permanent magnet synchronous motor fed by an IGBT 2-level inverter prove the feasibility of the proposed modeling technique in a finite-set model predictive control application.
△ Less
Submitted 27 September, 2019; v1 submitted 3 April, 2018;
originally announced April 2018.
-
On the hierarchical structure of Pareto critical sets
Authors:
Bennet Gebken,
Sebastian Peitz,
Michael Dellnitz
Abstract:
In this article we show that the boundary of the Pareto critical set of an unconstrained multiobjective optimization problem (MOP) consists of Pareto critical points of subproblems considering subsets of the objective functions. If the Pareto critical set is completely described by its boundary (e.g. if we have more objective functions than dimensions in the parameter space), this can be used to s…
▽ More
In this article we show that the boundary of the Pareto critical set of an unconstrained multiobjective optimization problem (MOP) consists of Pareto critical points of subproblems considering subsets of the objective functions. If the Pareto critical set is completely described by its boundary (e.g. if we have more objective functions than dimensions in the parameter space), this can be used to solve the MOP by solving a number of MOPs with fewer objective functions. If this is not the case, the results can still give insight into the structure of the Pareto critical set. This technique is especially useful for efficiently solving many-objective optimization problems by breaking them down into MOPs with a reduced number of objective functions.
△ Less
Submitted 19 March, 2018;
originally announced March 2018.
-
A Descent Method for Equality and Inequality Constrained Multiobjective Optimization Problems
Authors:
Bennet Gebken,
Sebastian Peitz,
Michael Dellnitz
Abstract:
In this article we propose a descent method for equality and inequality constrained multiobjective optimization problems (MOPs) which generalizes the steepest descent method for unconstrained MOPs by Fliege and Svaiter to constrained problems by using two active set strategies. Under some regularity assumptions on the problem, we show that accumulation points of our descent method satisfy a necess…
▽ More
In this article we propose a descent method for equality and inequality constrained multiobjective optimization problems (MOPs) which generalizes the steepest descent method for unconstrained MOPs by Fliege and Svaiter to constrained problems by using two active set strategies. Under some regularity assumptions on the problem, we show that accumulation points of our descent method satisfy a necessary condition for local Pareto optimality. Finally, we show the typical behavior of our method in a numerical example.
△ Less
Submitted 11 December, 2017; v1 submitted 8 December, 2017;
originally announced December 2017.
-
Transition manifolds of complex metastable systems: Theory and data-driven computation of effective dynamics
Authors:
Andreas Bittracher,
Péter Koltai,
Stefan Klus,
Ralf Banisch,
Michael Dellnitz,
Christof Schütte
Abstract:
We consider complex dynamical systems showing metastable behavior but no local separation of fast and slow time scales. The article raises the question of whether such systems exhibit a low-dimensional manifold supporting its effective dynamics. For answering this question, we aim at finding nonlinear coordinates, called reaction coordinates, such that the projection of the dynamics onto these coo…
▽ More
We consider complex dynamical systems showing metastable behavior but no local separation of fast and slow time scales. The article raises the question of whether such systems exhibit a low-dimensional manifold supporting its effective dynamics. For answering this question, we aim at finding nonlinear coordinates, called reaction coordinates, such that the projection of the dynamics onto these coordinates preserves the dominant time scales of the dynamics. We show that, based on a specific reducibility property, the existence of good low-dimensional reaction coordinates preserving the dominant time scales is guaranteed. Based on this theoretical framework, we develop and test a novel numerical approach for computing good reaction coordinates. The proposed algorithmic approach is fully local and thus not prone to the curse of dimension with respect to the state space of the dynamics. Hence, it is a promising method for data-based model reduction of complex dynamical systems such as molecular dynamics.
△ Less
Submitted 18 September, 2017; v1 submitted 28 April, 2017;
originally announced April 2017.
-
Continuous Relaxations for the Traveling Salesman Problem
Authors:
Tuhin Sahai,
Adrian Ziessler,
Stefan Klus,
Michael Dellnitz
Abstract:
In this work, we aim to explore connections between dynamical systems techniques and combinatorial optimization problems. In particular, we construct heuristic approaches for the traveling salesman problem (TSP) based on embedding the relaxed discrete optimization problem into appropriate manifolds. We explore multiple embedding techniques -- namely, the construction of new dynamical systems on th…
▽ More
In this work, we aim to explore connections between dynamical systems techniques and combinatorial optimization problems. In particular, we construct heuristic approaches for the traveling salesman problem (TSP) based on embedding the relaxed discrete optimization problem into appropriate manifolds. We explore multiple embedding techniques -- namely, the construction of new dynamical systems on the manifold of orthogonal matrices and associated Procrustes approximations of the TSP cost function. Using these dynamical systems, we analyze the local neighborhood around the optimal TSP solutions (which are equilibria) using computations to approximate the associated \emph{stable manifolds}. We find that these flows frequently converge to undesirable equilibria. However, the solutions of the dynamical systems and the associated Procrustes approximation provide an interesting biasing approach for the popular Lin--Kernighan heuristic which yields fast convergence. The Lin--Kernighan heuristic is typically based on the computation of edges that have a `high probability' of being in the shortest tour, thereby effectively pruning the search space. Our new approach, instead, relies on a natural relaxation of the combinatorial optimization problem to the manifold of orthogonal matrices and the subsequent use of this solution to bias the Lin--Kernighan heuristic. Although the initial cost of computing these edges using the Procrustes solution is higher than existing methods, we find that the Procrustes solution, when coupled with a homotopy computation, contains valuable information regarding the optimal edges. We explore the Procrustes based approach on several TSP instances and find that our approach often requires fewer $k$-opt moves than existing approaches. Broadly, we hope that this work initiates more work in the intersection of dynamical systems theory and combinatorial optimization.
△ Less
Submitted 11 February, 2019; v1 submitted 17 February, 2017;
originally announced February 2017.
-
Self-adjoint Matrices are Equivariant
Authors:
Michael Dellnitz
Abstract:
In this short note we prove that a matrix $A\in\mathbb{R}^{n,n}$ is self-adjoint if and only if it is equivariant with respect to the action of a group $Γ\subset {\bf O}(n)$ which is isomorphic to $\otimes_{k=1}^n\mathbf{Z}_2$. Moreover we discuss potential applications of this result, and we use it in particular for the approximation of higher order derivatives for smooth real valued functions of…
▽ More
In this short note we prove that a matrix $A\in\mathbb{R}^{n,n}$ is self-adjoint if and only if it is equivariant with respect to the action of a group $Γ\subset {\bf O}(n)$ which is isomorphic to $\otimes_{k=1}^n\mathbf{Z}_2$. Moreover we discuss potential applications of this result, and we use it in particular for the approximation of higher order derivatives for smooth real valued functions of several variables.
△ Less
Submitted 24 January, 2017;
originally announced January 2017.
-
Gradient-Based Multiobjective Optimization with Uncertainties
Authors:
Sebastian Peitz,
Michael Dellnitz
Abstract:
In this article we develop a gradient-based algorithm for the solution of multiobjective optimization problems with uncertainties. To this end, an additional condition is derived for the descent direction in order to account for inaccuracies in the gradients and then incorporated in a subdivison algorithm for the computation of global solutions to multiobjective optimization problems. Convergence…
▽ More
In this article we develop a gradient-based algorithm for the solution of multiobjective optimization problems with uncertainties. To this end, an additional condition is derived for the descent direction in order to account for inaccuracies in the gradients and then incorporated in a subdivison algorithm for the computation of global solutions to multiobjective optimization problems. Convergence to a superset of the Pareto set is proved and an upper bound for the maximal distance to the set of substationary points is given. Besides the applicability to problems with uncertainties, the algorithm is developed with the intention to use it in combination with model order reduction techniques in order to efficiently solve PDE-constrained multiobjective optimization problems.
△ Less
Submitted 5 April, 2017; v1 submitted 12 December, 2016;
originally announced December 2016.
-
A Multiobjective MPC Approach for Autonomously Driven Electric Vehicles
Authors:
Sebastian Peitz,
Kai Schäfer,
Sina Ober-Blöbaum,
Julian Eckstein,
Ulrich Köhler,
Michael Dellnitz
Abstract:
We present a new algorithm for model predictive control of non-linear systems with respect to multiple, conflicting objectives. The idea is to provide a possibility to change the objective in real-time, e.g.~as a reaction to changes in the environment or the system state itself. The algorithm utilises elements from various well-established concepts, namely multiobjective optimal control, economic…
▽ More
We present a new algorithm for model predictive control of non-linear systems with respect to multiple, conflicting objectives. The idea is to provide a possibility to change the objective in real-time, e.g.~as a reaction to changes in the environment or the system state itself. The algorithm utilises elements from various well-established concepts, namely multiobjective optimal control, economic as well as explicit model predictive control and motion planning with motion primitives. In order to realise real-time applicability, we split the computation into an online and an offline phase and we utilise symmetries in the open-loop optimal control problem to reduce the number of multiobjective optimal control problems that need to be solved in the offline phase. The results are illustrated using the example of an electric vehicle where the longitudinal dynamics are controlled with respect to the concurrent objectives arrival time and energy consumption.
△ Less
Submitted 27 October, 2016;
originally announced October 2016.
-
A Set-Oriented Numerical Approach for Dynamical Systems with Parameter Uncertainty
Authors:
Michael Dellnitz,
Stefan Klus,
Adrian Ziessler
Abstract:
In this article, we develop a set-oriented numerical methodology which allows to perform uncertainty quantification (UQ) for dynamical systems from a global point of view. That is, for systems with uncertain parameters we approximate the corresponding global attractors and invariant measures in the related stochastic setting. Our methods do not rely on generalized polynomial chaos techniques. Rath…
▽ More
In this article, we develop a set-oriented numerical methodology which allows to perform uncertainty quantification (UQ) for dynamical systems from a global point of view. That is, for systems with uncertain parameters we approximate the corresponding global attractors and invariant measures in the related stochastic setting. Our methods do not rely on generalized polynomial chaos techniques. Rather, we extend classical set-oriented methods designed for deterministic dynamical systems to the UQ-context, and this allows us to analyze the long-term uncertainty propagation. The algorithms have been integrated into the software package GAIO, and we illustrate the use and efficiency of these techniques by a couple of numerical examples.
△ Less
Submitted 25 April, 2016;
originally announced April 2016.
-
Multiobjective Optimal Control Methods for Fluid Flow Using Reduced Order Modeling
Authors:
Sebastian Peitz,
Sina Ober-Blöbaum,
Michael Dellnitz
Abstract:
In a wide range of applications it is desirable to optimally control a dynamical system with respect to concurrent, potentially competing goals. This gives rise to a multiobjective optimal control problem where, instead of computing a single optimal solution, the set of optimal compromises, the so-called Pareto set, has to be approximated. When the problem under consideration is described by a par…
▽ More
In a wide range of applications it is desirable to optimally control a dynamical system with respect to concurrent, potentially competing goals. This gives rise to a multiobjective optimal control problem where, instead of computing a single optimal solution, the set of optimal compromises, the so-called Pareto set, has to be approximated. When the problem under consideration is described by a partial differential equation (PDE), as is the case for fluid flow, the computational cost rapidly increases and makes its direct treatment infeasible. Reduced order modeling is a very popular method to reduce the computational cost, in particular in a multi query context such as uncertainty quantification, parameter estimation or optimization. In this article, we show how to combine reduced order modeling and multiobjective optimal control techniques in order to efficiently solve multiobjective optimal control problems constrained by PDEs. We consider a global, derivative free optimization method as well as a local, gradient based approach for which the optimality system is derived in two different ways. The methods are compared with regard to the solution quality as well as the computational effort and they are illustrated using the example of the two-dimensional incompressible flow around a cylinder.
△ Less
Submitted 15 September, 2016; v1 submitted 20 October, 2015;
originally announced October 2015.
-
On the computation of attractors for delay differential equations
Authors:
Michael Dellnitz,
Mirko Hessel-von Molo,
Adrian Ziessler
Abstract:
In this work we present a novel framework for the computation of finite dimensional invariant sets of infinite dimensional dynamical systems. It extends a classical subdivision technique [Dellnitz/Hohmann 1997] for the computation of such objects of finite dimensional systems to the infinite dimensional case by utilizing results on embedding techniques for infinite dimensional systems. We show how…
▽ More
In this work we present a novel framework for the computation of finite dimensional invariant sets of infinite dimensional dynamical systems. It extends a classical subdivision technique [Dellnitz/Hohmann 1997] for the computation of such objects of finite dimensional systems to the infinite dimensional case by utilizing results on embedding techniques for infinite dimensional systems. We show how to implement this approach for the analysis of delay differential equations and illustrate the feasibility of our implementation by computing invariant sets for three different delay differential equations.
△ Less
Submitted 28 August, 2015;
originally announced August 2015.
-
Sensing and Control in Symmetric Networks
Authors:
Michael Dellnitz,
Stefan Klus
Abstract:
In engineering applications, one of the major challenges today is to develop reliable and robust control algorithms for complex networked systems. Controllability and observability of such systems play a crucial role in the design process. The underlying network structure may contain symmetries -- caused for example by the coupling of identical building blocks -- and these symmetries lead to repea…
▽ More
In engineering applications, one of the major challenges today is to develop reliable and robust control algorithms for complex networked systems. Controllability and observability of such systems play a crucial role in the design process. The underlying network structure may contain symmetries -- caused for example by the coupling of identical building blocks -- and these symmetries lead to repeated eigenvalues in a generic way. This complicates the design of controllers since repeated eigenvalues might decrease the controllability of the system. In this paper, we will analyze the relationship between the controllability and observability of complex networked systems and graph symmetries using results from representation theory. Furthermore, we will propose an algorithm to compute sparse input and output matrices based on projections onto the isotypic components. We will illustrate our results with the aid of two guiding examples, a network with $ D_4 $ symmetry and the Petersen graph.
△ Less
Submitted 29 July, 2015;
originally announced July 2015.
-
A Traveling Salesman Learns Bayesian Networks
Authors:
Tuhin Sahai,
Stefan Klus,
Michael Dellnitz
Abstract:
Structure learning of Bayesian networks is an important problem that arises in numerous machine learning applications. In this work, we present a novel approach for learning the structure of Bayesian networks using the solution of an appropriately constructed traveling salesman problem. In our approach, one computes an optimal ordering (partially ordered set) of random variables using methods for…
▽ More
Structure learning of Bayesian networks is an important problem that arises in numerous machine learning applications. In this work, we present a novel approach for learning the structure of Bayesian networks using the solution of an appropriately constructed traveling salesman problem. In our approach, one computes an optimal ordering (partially ordered set) of random variables using methods for the traveling salesman problem. This ordering significantly reduces the search space for the subsequent greedy optimization that computes the final structure of the Bayesian network. We demonstrate our approach of learning Bayesian networks on real world census and weather datasets. In both cases, we demonstrate that the approach very accurately captures dependencies between random variables. We check the accuracy of the predictions based on independent studies in both application domains.
△ Less
Submitted 20 November, 2012;
originally announced November 2012.
-
An efficient algorithm for the parallel solution of high-dimensional differential equations
Authors:
Stefan Klus,
Tuhin Sahai,
Cong Liu,
Michael Dellnitz
Abstract:
The study of high-dimensional differential equations is challenging and difficult due to the analytical and computational intractability. Here, we improve the speed of waveform relaxation (WR), a method to simulate high-dimensional differential-algebraic equations. This new method termed adaptive waveform relaxation (AWR) is tested on a communication network example. Further we propose different h…
▽ More
The study of high-dimensional differential equations is challenging and difficult due to the analytical and computational intractability. Here, we improve the speed of waveform relaxation (WR), a method to simulate high-dimensional differential-algebraic equations. This new method termed adaptive waveform relaxation (AWR) is tested on a communication network example. Further we propose different heuristics for computing graph partitions tailored to adaptive waveform relaxation. We find that AWR coupled with appropriate graph partitioning methods provides a speedup by a factor between 3 and 16.
△ Less
Submitted 26 October, 2010; v1 submitted 26 March, 2010;
originally announced March 2010.
