-
In-situ Controller Autotuning by Bayesian Optimization for Closed-loop Feedback Control of Laser Powder Bed Fusion Process
Authors:
Baris Kavas,
Efe C. Balta,
Michael R. Tucker,
Raamadaas Krishnadas,
Alisa Rupenyan,
John Lygeros,
Markus Bambach
Abstract:
Open-loop control of laser powder bed fusion (LPBF) additive manufacturing (AM) has enabled the production of complex, high-criticality parts for various industries. This method relies on static parameter sets from extensive experimentation and simulations, ho** they remain stable and defect-free in production. Closed-loop control of LPBF can further enhance process stability and reduce defects…
▽ More
Open-loop control of laser powder bed fusion (LPBF) additive manufacturing (AM) has enabled the production of complex, high-criticality parts for various industries. This method relies on static parameter sets from extensive experimentation and simulations, ho** they remain stable and defect-free in production. Closed-loop control of LPBF can further enhance process stability and reduce defects despite complex thermal histories, process noise, hardware drift, and unexpected perturbations. Controller performance depends on parameter tuning, traditionally a manual, expertise-driven process with no guarantee of optimal performance and limited transferability between systems. This study proposes Bayesian Optimization (BO) to automate in-layer controller tuning by leveraging LPBF's layer-to-layer repetitive nature. Two approaches are introduced: online tuning, adjusting parameters iteratively during the process, and offline tuning, conducted in a setup such as laser exposures on a bare metal plate. These methods are experimentally implemented on an in-layer PI controller, and the performance is investigated on two wedge geometries prone to overheating. Results show that BO effectively tunes controllers using either method, significantly reducing overheating in controlled wedge specimens compared to uncontrolled ones. This study presents the first printed parts controlled by an in-layer controller subjected to microstructural analysis. Findings reveal partial presence of lack-of-fusion porosities due to insufficient laser power assigned by the controller, highlighting a significant challenge for utilizing laser power controllers. In summary, BO presents a promising method for automatic in-layer controller tuning in LPBF, enhancing control precision and mitigating overheating in production parts.
△ Less
Submitted 27 June, 2024;
originally announced June 2024.
-
Adaptive Bayesian Optimization for High-Precision Motion Systems
Authors:
Christopher König,
Raamadaas Krishnadas,
Efe C. Balta,
Alisa Rupenyan
Abstract:
Controller tuning and parameter optimization are crucial in system design to improve closed-loop system performance. Bayesian optimization has been established as an efficient model-free controller tuning and adaptation method. However, Bayesian optimization methods are computationally expensive and therefore difficult to use in real-time critical scenarios. In this work, we propose a real-time pu…
▽ More
Controller tuning and parameter optimization are crucial in system design to improve closed-loop system performance. Bayesian optimization has been established as an efficient model-free controller tuning and adaptation method. However, Bayesian optimization methods are computationally expensive and therefore difficult to use in real-time critical scenarios. In this work, we propose a real-time purely data-driven, model-free approach for adaptive control, by online tuning low-level controller parameters. We base our algorithm on GoOSE, an algorithm for safe and sample-efficient Bayesian optimization, for handling performance and stability criteria. We introduce multiple computational and algorithmic modifications for computational efficiency and parallelization of optimization steps. We further evaluate the algorithm's performance on a real precision-motion system utilized in semiconductor industry applications by modifying the payload and reference stepsize and comparing it to an interpolated constrained optimization-based baseline approach.
△ Less
Submitted 22 April, 2024;
originally announced April 2024.
-
MPC of Uncertain Nonlinear Systems with Meta-Learning for Fast Adaptation of Neural Predictive Models
Authors:
Jiaqi Yan,
Ankush Chakrabarty,
Alisa Rupenyan,
John Lygeros
Abstract:
In this paper, we consider the problem of reference tracking in uncertain nonlinear systems. A neural State-Space Model (NSSM) is used to approximate the nonlinear system, where a deep encoder network learns the nonlinearity from data, and a state-space component captures the temporal relationship. This transforms the nonlinear system into a linear system in a latent space, enabling the applicatio…
▽ More
In this paper, we consider the problem of reference tracking in uncertain nonlinear systems. A neural State-Space Model (NSSM) is used to approximate the nonlinear system, where a deep encoder network learns the nonlinearity from data, and a state-space component captures the temporal relationship. This transforms the nonlinear system into a linear system in a latent space, enabling the application of model predictive control (MPC) to determine effective control actions. Our objective is to design the optimal controller using limited data from the \textit{target system} (the system of interest). To this end, we employ an implicit model-agnostic meta-learning (iMAML) framework that leverages information from \textit{source systems} (systems that share similarities with the target system) to expedite training in the target system and enhance its control performance. The framework consists of two phases: the (offine) meta-training phase learns a aggregated NSSM using data from source systems, and the (online) meta-inference phase quickly adapts this aggregated model to the target system using only a few data points and few online training iterations, based on local loss function gradients. The iMAML algorithm exploits the implicit function theorem to exactly compute the gradient during training, without relying on the entire optimization path. By focusing solely on the optimal solution, rather than the path, we can meta-train with less storage complexity and fewer approximations than other contemporary meta-learning algorithms. We demonstrate through numerical examples that our proposed method can yield accurate predictive models by adaptation, resulting in a downstream MPC that outperforms several baselines.
△ Less
Submitted 18 April, 2024;
originally announced April 2024.
-
Guided Bayesian Optimization: Data-Efficient Controller Tuning with Digital Twin
Authors:
Mahdi Nobar,
Jürg Keller,
Alisa Rupenyan,
Mohammad Khosravi,
John Lygeros
Abstract:
This article presents the guided Bayesian optimization algorithm as an efficient data-driven method for iteratively tuning closed-loop controller parameters using an event-triggered digital twin of the system based on available closed-loop data. We define a controller tuning framework independent of the controller or the plant structure. Our proposed methodology is model-free, making it suitable f…
▽ More
This article presents the guided Bayesian optimization algorithm as an efficient data-driven method for iteratively tuning closed-loop controller parameters using an event-triggered digital twin of the system based on available closed-loop data. We define a controller tuning framework independent of the controller or the plant structure. Our proposed methodology is model-free, making it suitable for nonlinear and unmodelled plants with measurement noise. The objective function consists of performance metrics modeled by Gaussian processes. We utilize the available information in the closed-loop system to identify and progressively maintain a digital twin that guides the optimizer, improving the data efficiency of our method. Switching the digital twin on and off is triggered by data-driven criteria related to the digital twin's uncertainty estimations in the BO tuning framework. Effectively, it replaces much of the exploration of the real system with exploration performed on the digital twin. We analyze the properties of our method in simulation and demonstrate its performance on two real closed-loop systems with different plant and controller structures. The experimental results show that our method requires fewer experiments on the physical plant than Bayesian optimization to find the optimal controller parameters.
△ Less
Submitted 25 March, 2024;
originally announced March 2024.
-
Force Controlled Printing for Material Extrusion Additive Manufacturing
Authors:
Xavier Guidetti,
Nathan Mingard,
Raul Cruz-Oliver,
Yannick Nagel,
Marvin Rueppel,
Alisa Rupenyan,
Efe C. Balta,
John Lygeros
Abstract:
In material extrusion additive manufacturing, the extrusion process is commonly controlled in a feed-forward fashion. The amount of material to be extruded at each printing location is pre-computed by a planning software. This approach is inherently unable to adapt the extrusion to external and unexpected disturbances, and the quality of the results strongly depends on a number of modeling and tun…
▽ More
In material extrusion additive manufacturing, the extrusion process is commonly controlled in a feed-forward fashion. The amount of material to be extruded at each printing location is pre-computed by a planning software. This approach is inherently unable to adapt the extrusion to external and unexpected disturbances, and the quality of the results strongly depends on a number of modeling and tuning parameters. To overcome these limitations, we propose the first framework for Force Controlled Printing for material extrusion additive manufacturing. We utilize a custom-built extruder to measure the extrusion force in real time, and use this quantity as feedback to continuously control the material flow in closed-loop. We demonstrate the existence of a strong correlation between extrusion force and line width, which we exploit to deposit lines of desired width in a width range of 33 % up to 233 % of the nozzle diameter. We also show how Force Controlled Printing outperforms conventional feed-forward extrusion in print quality and disturbance rejection, while requiring little tuning and automatically adapting to changes in the hardware settings. With no adaptation, Force Controlled Printing can deposit lines of desired width under severe disturbances in bed leveling, such as at layer heights ranging between 20 % and 200 % of the nominal height.
△ Less
Submitted 24 March, 2024;
originally announced March 2024.
-
Tuning of Online Feedback Optimization for setpoint tracking in centrifugal compressors
Authors:
Marta Zagorowska,
Lukas Ortmann,
Alisa Rupenyan,
Mehmet Mercangoez,
Lars Imsland
Abstract:
Online Feedback Optimization (OFO) controllers steer a system to its optimal operating point by treating optimization algorithms as auxiliary dynamic systems. Implementation of OFO controllers requires setting the parameters of the optimization algorithm that allows reaching convergence, posing a challenge because the convergence of the optimization algorithm is often decoupled from the performanc…
▽ More
Online Feedback Optimization (OFO) controllers steer a system to its optimal operating point by treating optimization algorithms as auxiliary dynamic systems. Implementation of OFO controllers requires setting the parameters of the optimization algorithm that allows reaching convergence, posing a challenge because the convergence of the optimization algorithm is often decoupled from the performance of the controlled system. OFO controllers are also typically designed to ensure steady-state tracking by fixing the sampling time to be longer than the time constants of the system. In this paper, we first quantify the impact of OFO parameters and the sampling time on the tracking error and number of oscillations of the controlled system, showing that adjusting them without waiting for steady state allows good tracking. We then propose a tuning method for the sampling time of the OFO controller together with the parameters to allow tracking fast trajectories while reducing oscillations. We validate the proposed tuning approach in a pressure controller in a centrifugal compressor, tracking trajectories faster than the time needed to reach the steady state by the compressor. The results of the validation confirm that simultaneous tuning of the sampling time and the parameters of OFO yields up to 87% times better tracking performance than manual tuning based on steady state.
△ Less
Submitted 9 March, 2024; v1 submitted 4 December, 2023;
originally announced December 2023.
-
Layer-to-Layer Melt Pool Control in Laser Power Bed Fusion
Authors:
Dominic Liao-McPherson,
Efe C. Balta,
Mohamadreza Afrasiabi,
Alisa Rupenyan,
Markus Bambach,
John Lygeros
Abstract:
Additive manufacturing processes are flexible and efficient technologies for producing complex geometries. However, ensuring reliability and repeatability is challenging due to the complex physics and various sources of uncertainty in the process. In this work, we investigate closed-loop control of the melt pool dimensions in a laser powder bed fusion (LPBF) process. We propose a trajectory optimi…
▽ More
Additive manufacturing processes are flexible and efficient technologies for producing complex geometries. However, ensuring reliability and repeatability is challenging due to the complex physics and various sources of uncertainty in the process. In this work, we investigate closed-loop control of the melt pool dimensions in a laser powder bed fusion (LPBF) process. We propose a trajectory optimization-based layer-to-layer controller that adjusts the laser power input to the next layer to track a desired melt pool depth and validate our controller by placing it in closed-loop high-fidelity multi-layer smoothed particle hydrodynamics simulator of a 2D LPBF process. Detailed numerical case studies demonstrate successful regulation of the melt pool depth on brick and overhang geometries and provide first of its kind results on the effectiveness of layer-to-layer input optimization for the LPBF process as well as detailed insight into the physics of the controlled process. Computational complexity and process performance results illustrate the method's effectiveness and provide an outlook for its implementation onto real systems.
△ Less
Submitted 16 November, 2023;
originally announced November 2023.
-
Efficient safe learning for controller tuning with experimental validation
Authors:
Marta Zagorowska,
Christopher König,
Hanlin Yu,
Efe C. Balta,
Alisa Rupenyan,
John Lygeros
Abstract:
Optimization-based controller tuning is challenging because it requires formulating optimization problems explicitly as functions of controller parameters. Safe learning algorithms overcome the challenge by creating surrogate models from measured data. To ensure safety, such data-driven algorithms often rely on exhaustive grid search, which is computationally inefficient. In this paper, we propose…
▽ More
Optimization-based controller tuning is challenging because it requires formulating optimization problems explicitly as functions of controller parameters. Safe learning algorithms overcome the challenge by creating surrogate models from measured data. To ensure safety, such data-driven algorithms often rely on exhaustive grid search, which is computationally inefficient. In this paper, we propose a novel approach to safe learning by formulating a series of optimization problems instead of a grid search. We also develop a method for initializing the optimization problems to guarantee feasibility while using numerical solvers. The performance of the new method is first validated in a simulated precision motion system, demonstrating improved computational efficiency, and illustrating the role of exploiting numerical solvers to reach the desired precision. Experimental validation on an industrial-grade precision motion system confirms that the proposed algorithm achieves 30% better tracking at sub-micrometer precision as a state-of-the-art safe learning algorithm, improves the default auto-tuning solution, and reduces the computational cost seven times compared to learning algorithms based on exhaustive search.
△ Less
Submitted 26 October, 2023;
originally announced October 2023.
-
Sequential Quadratic Programming-based Iterative Learning Control for Nonlinear Systems
Authors:
Samuel Balula,
Efe C. Balta,
Dominic Liao-McPherson,
Alisa Rupenyan,
John Lygeros
Abstract:
Learning-based control methods for industrial processes leverage the repetitive nature of the underlying process to learn optimal inputs for the system. While many works focus on linear systems, real-world problems involve nonlinear dynamics. In this work, we propose an algorithm for the nonlinear iterative learning control problem based on sequential quadratic programming, a well-studied method f…
▽ More
Learning-based control methods for industrial processes leverage the repetitive nature of the underlying process to learn optimal inputs for the system. While many works focus on linear systems, real-world problems involve nonlinear dynamics. In this work, we propose an algorithm for the nonlinear iterative learning control problem based on sequential quadratic programming, a well-studied method for nonconvex optimization. We repeatedly solve quadratic subproblems built using approximate nonlinear models and process measurements, to find an optimal input for the original system. We demonstrate our method in a trajectory optimization problem for a precision motion system. We present simulations to illustrate the performance of the proposed method for linear and nonlinear dynamics models.
△ Less
Submitted 24 July, 2023;
originally announced July 2023.
-
Safe Risk-averse Bayesian Optimization for Controller Tuning
Authors:
Christopher Koenig,
Miks Ozols,
Anastasia Makarova,
Efe C. Balta,
Andreas Krause,
Alisa Rupenyan
Abstract:
Controller tuning and parameter optimization are crucial in system design to improve both the controller and underlying system performance. Bayesian optimization has been established as an efficient model-free method for controller tuning and adaptation. Standard methods, however, are not enough for high-precision systems to be robust with respect to unknown input-dependent noise and stable under…
▽ More
Controller tuning and parameter optimization are crucial in system design to improve both the controller and underlying system performance. Bayesian optimization has been established as an efficient model-free method for controller tuning and adaptation. Standard methods, however, are not enough for high-precision systems to be robust with respect to unknown input-dependent noise and stable under safety constraints. In this work, we present a novel data-driven approach, RaGoOSE, for safe controller tuning in the presence of heteroscedastic noise, combining safe learning with risk-averse Bayesian optimization. We demonstrate the method for synthetic benchmark and compare its performance to established BO-based tuning methods. We further evaluate RaGoOSE performance on a real precision-motion system utilized in semiconductor industry applications and compare it to the built-in auto-tuning routine.
△ Less
Submitted 23 June, 2023;
originally announced June 2023.
-
Stress Flow Guided Non-Planar Print Trajectory Optimization for Additive Manufacturing of Anisotropic Polymers
Authors:
Xavier Guidetti,
Efe C. Balta,
Yannick Nagel,
Hang Yin,
Alisa Rupenyan,
John Lygeros
Abstract:
When manufacturing parts using material extrusion additive manufacturing and anisotropic polymers, the mechanical properties of a manufactured component are strongly dependent on the print trajectory orientation. We conduct non-planar slicing and optimize the print trajectories to maximize the alignment between the material deposition direction and the stress flow induced by a predefined load case…
▽ More
When manufacturing parts using material extrusion additive manufacturing and anisotropic polymers, the mechanical properties of a manufactured component are strongly dependent on the print trajectory orientation. We conduct non-planar slicing and optimize the print trajectories to maximize the alignment between the material deposition direction and the stress flow induced by a predefined load case. The trajectory optimization framework considers manufacturability constraints in the form of uniform layer height and line spacing. We demonstrate the method by manufacturing a load bearing mechanical bracket using a 5-axis 3D printer and a liquid crystal polymer material. The failure strength and stiffness of the optimized bracket are improved by a factor of 44 and 6 respectively when compared with conventional printing.
△ Less
Submitted 12 June, 2023; v1 submitted 12 January, 2023;
originally announced January 2023.
-
Drone-based Volume Estimation in Indoor Environments
Authors:
Samuel Balula,
Dominic Liao-McPherson,
Stefan Stevšić,
Alisa Rupenyan,
John Lygeros
Abstract:
Volume estimation in large indoor spaces is an important challenge in robotic inspection of industrial warehouses. We propose an approach for volume estimation for autonomous systems using visual features for indoor localization and surface reconstruction from 2D-LiDAR measurements. A Gaussian Process-based model incorporates information collected from measurements given statistical prior informat…
▽ More
Volume estimation in large indoor spaces is an important challenge in robotic inspection of industrial warehouses. We propose an approach for volume estimation for autonomous systems using visual features for indoor localization and surface reconstruction from 2D-LiDAR measurements. A Gaussian Process-based model incorporates information collected from measurements given statistical prior information about the terrain, from which the volume estimate is computed. Our algorithm finds feasible trajectories which minimize the uncertainty of the volume estimate. We show results in simulation for the surface reconstruction and volume estimate of topographic data.
△ Less
Submitted 15 November, 2022;
originally announced November 2022.
-
Data-Driven Process Optimization of Fused Filament Fabrication based on In Situ Measurements
Authors:
Xavier Guidetti,
Marino Kühne,
Yannick Nagel,
Efe C. Balta,
Alisa Rupenyan,
John Lygeros
Abstract:
The tuning of fused filament fabrication parameters is notoriously challenging. We propose an autonomous data-driven method to select parameters based on in situ measurements. We use a laser sensor to evaluate the surface roughness of a printed part. We then correlate the roughness to the mechanical properties of the part, and show how print quality affects mechanical performance. Finally, we use…
▽ More
The tuning of fused filament fabrication parameters is notoriously challenging. We propose an autonomous data-driven method to select parameters based on in situ measurements. We use a laser sensor to evaluate the surface roughness of a printed part. We then correlate the roughness to the mechanical properties of the part, and show how print quality affects mechanical performance. Finally, we use Bayesian optimization to search for optimal print parameters. We demonstrate our method by printing liquid crystal polymer samples, and successfully find parameters that produce high-performance prints and maximize the manufacturing process efficiency.
△ Less
Submitted 27 October, 2022;
originally announced October 2022.
-
Data-driven Reference Trajectory Optimization for Precision Motion Systems
Authors:
Samuel Balula,
Dominic Liao-McPherson,
Alisa Rupenyan,
John Lygeros
Abstract:
We propose a data-driven optimization-based pre-compensation method to improve the contour tracking performance of precision motion stages by modifying the reference trajectory and without modifying any built-in low-level controllers. The position of the precision motion stage is predicted with data-driven models, a linear low-fidelity model is used to optimize traversal time, by changing the path…
▽ More
We propose a data-driven optimization-based pre-compensation method to improve the contour tracking performance of precision motion stages by modifying the reference trajectory and without modifying any built-in low-level controllers. The position of the precision motion stage is predicted with data-driven models, a linear low-fidelity model is used to optimize traversal time, by changing the path velocity and acceleration profiles then a non-linear high-fidelity model is used to refine the previously found time-optimal solution. We experimentally demonstrate that the proposed method is capable of simultaneously improving the productivity and accuracy of a high precision motion stage. Given the data-based nature of the models, the proposed method can easily be adapted to a wide family of precision motion systems.
△ Less
Submitted 5 September, 2022; v1 submitted 31 May, 2022;
originally announced May 2022.
-
Controller-Aware Dynamic Network Management for Industry 4.0
Authors:
Efe C. Balta,
Mohammad H. Mamduhi,
John Lygeros,
Alisa Rupenyan
Abstract:
In this paper, we consider a cyber-physical manufacturing system (CPMS) scenario containing physical components (robots, sensors, and actuators), operating in a digitally connected, constrained environment to perform industrial tasks. The CPMS has a centralized control plane with digital twins (DTs) of the physical resources, computational resources, and a network manager that allocates network re…
▽ More
In this paper, we consider a cyber-physical manufacturing system (CPMS) scenario containing physical components (robots, sensors, and actuators), operating in a digitally connected, constrained environment to perform industrial tasks. The CPMS has a centralized control plane with digital twins (DTs) of the physical resources, computational resources, and a network manager that allocates network resources. Existing approaches for allocation of network resources are typically fixed with respect to controller-dependent run-time specifications, which may impact the performance of physical processes. We propose a dynamic network management framework, where the network resource allocation schemes are controller-aware. The information about the controllers of the physical resources is implemented at the DT level, and metrics, such as regret bounds, take the process performance measures into account. The proposed network management schemes optimize physical system performance by balancing the shared resources between the physical assets on the plant floor, and by considering their control requirements, providing a new perspective for dynamic resource allocation. A simulation study is provided to illustrate the performance of the proposed network management approaches and compare their efficiencies.
△ Less
Submitted 28 May, 2022;
originally announced May 2022.
-
Advanced Manufacturing Configuration by Sample-efficient Batch Bayesian Optimization
Authors:
Xavier Guidetti,
Alisa Rupenyan,
Lutz Fassl,
Majid Nabavi,
John Lygeros
Abstract:
We propose a framework for the configuration and operation of expensive-to-evaluate advanced manufacturing methods, based on Bayesian optimization. The framework unifies a tailored acquisition function, a parallel acquisition procedure, and the integration of process information providing context to the optimization procedure. \cmtb{The novel acquisition function is demonstrated, analyzed and comp…
▽ More
We propose a framework for the configuration and operation of expensive-to-evaluate advanced manufacturing methods, based on Bayesian optimization. The framework unifies a tailored acquisition function, a parallel acquisition procedure, and the integration of process information providing context to the optimization procedure. \cmtb{The novel acquisition function is demonstrated, analyzed and compared on state-of-the-art benchmarking problems. We apply the optimization approach to atmospheric plasma spraying and fused deposition modeling.} Our results demonstrate that the proposed framework can efficiently find input parameters that produce the desired outcome and minimize the process cost.
△ Less
Submitted 12 September, 2022; v1 submitted 24 May, 2022;
originally announced May 2022.
-
On Robustness in Optimization-Based Constrained Iterative Learning Control
Authors:
Dominic Liao-McPherson,
Efe C. Balta,
Alisa Rupenyan,
John Lygeros
Abstract:
Iterative learning control (ILC) is a control strategy for repetitive tasks wherein information from previous runs is leveraged to improve future performance. Optimization-based ILC (OB-ILC) is a powerful design framework for constrained ILC where measurements from the process are integrated into an optimization algorithm to provide robustness against noise and modelling error. This paper proposes…
▽ More
Iterative learning control (ILC) is a control strategy for repetitive tasks wherein information from previous runs is leveraged to improve future performance. Optimization-based ILC (OB-ILC) is a powerful design framework for constrained ILC where measurements from the process are integrated into an optimization algorithm to provide robustness against noise and modelling error. This paper proposes a robust ILC controller for constrained linear processes based on the forward-backward splitting algorithm. It demonstrates how structured uncertainty information can be leveraged to ensure constraint satisfaction and provides a rigorous stability analysis in the iteration domain by combining concepts from monotone operator theory and robust control. Numerical simulations of a precision motion stage support the theoretical results.
△ Less
Submitted 26 May, 2022; v1 submitted 10 March, 2022;
originally announced March 2022.
-
Learning-Based Repetitive Precision Motion Control with Mismatch Compensation
Authors:
Efe C. Balta,
Kira Barton,
Dawn M. Tilbury,
Alisa Rupenyan,
John Lygeros
Abstract:
Learning-based control methods utilize run-time data from the underlying process to improve the controller performance under model mismatch and unmodeled disturbances. This is beneficial for optimizing industrial processes, where the dynamics are difficult to model, and the repetitive nature of the process can be exploited. In this work, we develop an iterative approach for repetitive precision mo…
▽ More
Learning-based control methods utilize run-time data from the underlying process to improve the controller performance under model mismatch and unmodeled disturbances. This is beneficial for optimizing industrial processes, where the dynamics are difficult to model, and the repetitive nature of the process can be exploited. In this work, we develop an iterative approach for repetitive precision motion control problems where the objective is to follow a reference geometry with minimal tracking error. Our method utilizes a nominal model of the process and learns the mismatch using Gaussian Process Regression (GPR). The control input and the GPR data are updated after each iteration to improve the performance in a run-to-run fashion. We provide a preliminary convergence analysis, implementation details of the proposed controller for minimizing different error types, and a case study where we demonstrate improved tracking performance with simulation and experimental results.
△ Less
Submitted 19 November, 2021;
originally announced November 2021.
-
Batch Model Predictive Control for Selective Laser Melting
Authors:
Riccardo Zuliani,
Efe C. Balta,
Alisa Rupenyan,
John Lygeros
Abstract:
Selective laser melting is a promising additive manufacturing technology enabling the fabrication of highly customizable products. A major challenge in selective laser melting is ensuring the quality of produced parts, which is influenced greatly by the thermal history of printed layers. We propose a Batch-Model Predictive Control technique based on the combination of model predictive control and…
▽ More
Selective laser melting is a promising additive manufacturing technology enabling the fabrication of highly customizable products. A major challenge in selective laser melting is ensuring the quality of produced parts, which is influenced greatly by the thermal history of printed layers. We propose a Batch-Model Predictive Control technique based on the combination of model predictive control and iterative learning control. This approach succeeds in rejecting both repetitive and non-repetitive disturbances and thus achieves improved tracking performance and process quality. In a simulation study, the selective laser melting dynamics is approximated with a reduced-order control-oriented linear model to ensure reasonable computational complexity. The proposed approach provides convergence to the desired temperature field profile despite model uncertainty and disturbances.
△ Less
Submitted 8 April, 2022; v1 submitted 16 November, 2021;
originally announced November 2021.
-
In-layer Thermal Control of a Multi-layer Selective Laser Melting Process
Authors:
Dominic Liao-McPherson,
Efe C. Balta,
Ryan Wüest,
Alisa Rupenyan,
John Lygeros
Abstract:
Selective Laser Melting (SLM) is an additive manufacturing technology that builds three dimensional parts by melting layers of metal powder together with a laser that traces out a desired geometry. SLM is popular in industry, however the inherent melting and re-solidification of the metal during the process can, if left uncontrolled, cause excessive residual stress, porosity, and other defects in…
▽ More
Selective Laser Melting (SLM) is an additive manufacturing technology that builds three dimensional parts by melting layers of metal powder together with a laser that traces out a desired geometry. SLM is popular in industry, however the inherent melting and re-solidification of the metal during the process can, if left uncontrolled, cause excessive residual stress, porosity, and other defects in the final printed parts. This paper presents a control-oriented thermal model of a multi-layer SLM process and proposes a structured model reduction methodology with an associated reduced order model based in-layer controller to track temperature references. Simulation studies demonstrate that the controller is able to prevent layer-to-layer heat buildup and that good closed-loop performance is possible using relatively low-order models.
△ Less
Submitted 1 April, 2022; v1 submitted 1 November, 2021;
originally announced November 2021.
-
Performance-based Trajectory Optimization for Path Following Control Using Bayesian Optimization
Authors:
Alisa Rupenyan,
Mohammad Khosravi,
John Lygeros
Abstract:
Accurate positioning and fast traversal times determine the productivity in machining applications. This paper demonstrates a hierarchical contour control implementation for the increase of productivity in positioning systems. The high-level controller pre-optimizes the input to a low-level cascade controller, using a contouring predictive control approach. This control structure requires tuning o…
▽ More
Accurate positioning and fast traversal times determine the productivity in machining applications. This paper demonstrates a hierarchical contour control implementation for the increase of productivity in positioning systems. The high-level controller pre-optimizes the input to a low-level cascade controller, using a contouring predictive control approach. This control structure requires tuning of multiple parameters. We propose a sample-efficient tuning algorithm, where the performance metrics associated with the full geometry traversal are modelled as Gaussian processes and used to form the global cost and the constraints in a constrained Bayesian optimization algorithm. This approach enables the trade-off between fast traversal, high tracking accuracy, and suppression of vibrations in the system. The performance improvement is evaluated numerically when tuning different combinations of parameters. We demonstrate that tuning the parameters of the MPC contour-controller achieves the best performance in terms of time, tracking accuracy, and minimization of the vibrations in the system.
△ Less
Submitted 29 April, 2024; v1 submitted 29 March, 2021;
originally announced March 2021.
-
Plasma Spray Process Parameters Configuration using Sample-efficient Batch Bayesian Optimization
Authors:
Xavier Guidetti,
Alisa Rupenyan,
Lutz Fassl,
Majid Nabavi,
John Lygeros
Abstract:
Recent work has shown constrained Bayesian optimization to be a powerful technique for the optimization of industrial processes. In complex manufacturing processes, the possibility to run extensive sequences of experiments with the goal of finding good process parameters is severely limited by the time required for quality evaluation of the produced parts. To accelerate the process parameter optim…
▽ More
Recent work has shown constrained Bayesian optimization to be a powerful technique for the optimization of industrial processes. In complex manufacturing processes, the possibility to run extensive sequences of experiments with the goal of finding good process parameters is severely limited by the time required for quality evaluation of the produced parts. To accelerate the process parameter optimization, we introduce a parallel acquisition procedure tailored on the process characteristics. We further propose an algorithm that adapts to equipment status to improve run-to-run reproducibility. We validate our optimization method numerically and experimentally, and demonstrate that it can efficiently find input parameters that produce the desired outcome and minimize the process cost.
△ Less
Submitted 11 May, 2022; v1 submitted 25 March, 2021;
originally announced March 2021.
-
Safe and Efficient Model-free Adaptive Control via Bayesian Optimization
Authors:
Christopher König,
Matteo Turchetta,
John Lygeros,
Alisa Rupenyan,
Andreas Krause
Abstract:
Adaptive control approaches yield high-performance controllers when a precise system model or suitable parametrizations of the controller are available. Existing data-driven approaches for adaptive control mostly augment standard model-based methods with additional information about uncertainties in the dynamics or about disturbances. In this work, we propose a purely data-driven, model-free appro…
▽ More
Adaptive control approaches yield high-performance controllers when a precise system model or suitable parametrizations of the controller are available. Existing data-driven approaches for adaptive control mostly augment standard model-based methods with additional information about uncertainties in the dynamics or about disturbances. In this work, we propose a purely data-driven, model-free approach for adaptive control. Tuning low-level controllers based solely on system data raises concerns on the underlying algorithm safety and computational performance. Thus, our approach builds on GoOSE, an algorithm for safe and sample-efficient Bayesian optimization. We introduce several computational and algorithmic modifications in GoOSE that enable its practical use on a rotational motion system. We numerically demonstrate for several types of disturbances that our approach is sample efficient, outperforms constrained Bayesian optimization in terms of safety, and achieves the performance optima computed by grid evaluation. We further demonstrate the proposed adaptive control approach experimentally on a rotational motion system.
△ Less
Submitted 2 March, 2021; v1 submitted 19 January, 2021;
originally announced January 2021.
-
Learning from Simulation, Racing in Reality
Authors:
Eugenio Chisari,
Alexander Liniger,
Alisa Rupenyan,
Luc Van Gool,
John Lygeros
Abstract:
We present a reinforcement learning-based solution to autonomously race on a miniature race car platform. We show that a policy that is trained purely in simulation using a relatively simple vehicle model, including model randomization, can be successfully transferred to the real robotic setup. We achieve this by using novel policy output regularization approach and a lifted action space which ena…
▽ More
We present a reinforcement learning-based solution to autonomously race on a miniature race car platform. We show that a policy that is trained purely in simulation using a relatively simple vehicle model, including model randomization, can be successfully transferred to the real robotic setup. We achieve this by using novel policy output regularization approach and a lifted action space which enables smooth actions but still aggressive race car driving. We show that this regularized policy does outperform the Soft Actor Critic (SAC) baseline method, both in simulation and on the real car, but it is still outperformed by a Model Predictive Controller (MPC) state of the art method. The refinement of the policy with three hours of real-world interaction data allows the reinforcement learning policy to achieve lap times similar to the MPC controller while reducing track constraint violations by 50%.
△ Less
Submitted 7 May, 2021; v1 submitted 26 November, 2020;
originally announced November 2020.
-
Safety-Aware Cascade Controller Tuning Using Constrained Bayesian Optimization
Authors:
Christopher König,
Mohammad Khosravi,
Markus Maier,
Roy S. Smith,
Alisa Rupenyan,
John Lygeros
Abstract:
This paper presents an automated, model-free, data-driven method for the safe tuning of PID cascade controller gains based on Bayesian optimization. The optimization objective is composed of data-driven performance metrics and modeled using Gaussian processes. We further introduce a data-driven constraint that captures the stability requirements from system data. Numerical evaluation shows that th…
▽ More
This paper presents an automated, model-free, data-driven method for the safe tuning of PID cascade controller gains based on Bayesian optimization. The optimization objective is composed of data-driven performance metrics and modeled using Gaussian processes. We further introduce a data-driven constraint that captures the stability requirements from system data. Numerical evaluation shows that the proposed approach outperforms relay feedback autotuning and quickly converges to the global optimum, thanks to a tailored stop** criterion. We demonstrate the performance of the method in simulations and experiments. For experimental implementation, in addition to the introduced safety constraint, we integrate a method for automatic detection of the critical gains and extend the optimization objective with a penalty depending on the proximity of the current candidate points to the critical gains. The resulting automated tuning method optimizes system performance while ensuring stability and standardization
△ Less
Submitted 11 August, 2021; v1 submitted 28 October, 2020;
originally announced October 2020.
-
Performance-Driven Cascade Controller Tuning with Bayesian Optimization
Authors:
Mohammad Khosravi,
Varsha Behrunani,
Piotr Myszkorowski,
Roy S. Smith,
Alisa Rupenyan,
John Lygeros
Abstract:
We propose a performance-based autotuning method for cascade control systems, where the parameters of a linear axis drive motion controller from two control loops are tuned jointly. Using Bayesian optimization as all parameters are tuned simultaneously, the method is guaranteed to converge asymptotically to the global optimum of the cost. The data-efficiency and performance of the method are studi…
▽ More
We propose a performance-based autotuning method for cascade control systems, where the parameters of a linear axis drive motion controller from two control loops are tuned jointly. Using Bayesian optimization as all parameters are tuned simultaneously, the method is guaranteed to converge asymptotically to the global optimum of the cost. The data-efficiency and performance of the method are studied numerically for several training configurations and compared numerically to those achieved with classical tuning methods and to the exhaustive evaluation of the cost. On the real system, the tracking performance and robustness against disturbances are compared experimentally to nominal tuning. The numerical study and the experimental data both demonstrate that the proposed automated tuning method is efficient in terms of required tuning iterations, robust to disturbances, and results in improved tracking.
△ Less
Submitted 24 July, 2020;
originally announced July 2020.
-
Self-Optimizing Grinding Machines using Gaussian Process Models and Constrained Bayesian Optimization
Authors:
Markus Maier,
Alisa Rupenyan,
Christian Bobst,
Konrad Wegener
Abstract:
In this study, self-optimization of a grinding machine is demonstrated with respect to production costs, while fulfilling quality and safety constraints. The quality requirements of the final workpiece are defined with respect to grinding burn and surface roughness, and the safety constraints are defined with respect to the temperature at the grinding surface. Grinding temperature is measured at t…
▽ More
In this study, self-optimization of a grinding machine is demonstrated with respect to production costs, while fulfilling quality and safety constraints. The quality requirements of the final workpiece are defined with respect to grinding burn and surface roughness, and the safety constraints are defined with respect to the temperature at the grinding surface. Grinding temperature is measured at the contact zone between the grinding wheel and workpiece using a pyrometer and an optical fiber, which is embedded inside the rotating grinding wheel. Constrained Bayesian optimization combined with Gaussian process models is applied to determine the optimal feed rate and cutting speed of a cup wheel grinding machine manufacturing tungsten carbide cutting inserts. The approach results in the determination of optimal parameters for unknown workpiece and tool combinations after only a few grinding trials. It also incorporates the uncertainty of the constraints in the prediction of optimal parameters by using stochastic process models.
△ Less
Submitted 9 June, 2020;
originally announced June 2020.
-
Cascade Control: Data-Driven Tuning Approach Based on Bayesian Optimization
Authors:
Mohammad Khosravi,
Varsha Behrunani,
Roy S. Smith,
Alisa Rupenyan,
John Lygeros
Abstract:
Cascaded controller tuning is a multi-step iterative procedure that needs to be performed routinely upon maintenance and modification of mechanical systems. An automated data-driven method for cascaded controller tuning based on Bayesian optimization is proposed. The method is tested on a linear axis drive, modeled using a combination of first principles model and system identification. A custom c…
▽ More
Cascaded controller tuning is a multi-step iterative procedure that needs to be performed routinely upon maintenance and modification of mechanical systems. An automated data-driven method for cascaded controller tuning based on Bayesian optimization is proposed. The method is tested on a linear axis drive, modeled using a combination of first principles model and system identification. A custom cost function based on performance indicators derived from system data at different candidate configurations of controller parameters is modeled by a Gaussian process. It is further optimized by minimization of an acquisition function which serves as a sampling criterion to determine the subsequent candidate configuration for experimental trial and improvement of the cost model iteratively, until a minimum according to a termination criterion is found. This results in a data-efficient procedure that can be easily adapted to varying loads or mechanical modifications of the system. The method is further compared to several classical methods for auto-tuning, and demonstrates higher performance according to the defined data-driven performance indicators. The influence of the training data on a cost prior on the number of iterations required to reach optimum is studied, demonstrating the efficiency of the Bayesian optimization tuning method.
△ Less
Submitted 16 May, 2020; v1 submitted 8 May, 2020;
originally announced May 2020.
-
Optimization-Based Hierarchical Motion Planning for Autonomous Racing
Authors:
José L. Vázquez,
Marius Brühlmeier,
Alexander Liniger,
Alisa Rupenyan,
John Lygeros
Abstract:
In this paper we propose a hierarchical controller for autonomous racing where the same vehicle model is used in a two level optimization framework for motion planning. The high-level controller computes a trajectory that minimizes the lap time, and the low-level nonlinear model predictive path following controller tracks the computed trajectory online. Following a computed optimal trajectory avoi…
▽ More
In this paper we propose a hierarchical controller for autonomous racing where the same vehicle model is used in a two level optimization framework for motion planning. The high-level controller computes a trajectory that minimizes the lap time, and the low-level nonlinear model predictive path following controller tracks the computed trajectory online. Following a computed optimal trajectory avoids online planning and enables fast computational times. The efficiency is further enhanced by the coupling of the two levels through a terminal constraint, computed in the high-level controller. Including this constraint in the real-time optimization level ensures that the prediction horizon can be shortened, while safety is guaranteed. This proves crucial for the experimental validation of the approach on a full size driverless race car. The vehicle in question won two international student racing competitions using the proposed framework; moreover, our hierarchical controller achieved an improvement of 20% in the lap time compared to the state of the art result achieved using a very similar car and track.
△ Less
Submitted 11 March, 2020; v1 submitted 10 March, 2020;
originally announced March 2020.
-
Reference design for closed loop system optimization
Authors:
Samuel Balula,
Alex Liniger,
Alisa Rupenyan,
John Lygeros
Abstract:
An optimization-based method for improving the productivity of precision machine tools is proposed, where the reference path is computed in local coordinates, and information about the machine tool performance is learned from experimental data. The optimization yields a modified reference that is tracked by the existing low-level controller. The method is tested in simulation for a biaxial positio…
▽ More
An optimization-based method for improving the productivity of precision machine tools is proposed, where the reference path is computed in local coordinates, and information about the machine tool performance is learned from experimental data. The optimization yields a modified reference that is tracked by the existing low-level controller. The method is tested in simulation for a biaxial positioning system. The positioning system is modelled as double integrator, and the controller characteristic is modelled from experimental data using a least-squares fit. Simulation results show that the method is effective in designing optimal references even for challenging geometries such as sharp corners. The application of this procedure allows the retrofit of the control of existing machines with minimal overhead, by providing a modified reference file to track.
△ Less
Submitted 3 March, 2020;
originally announced March 2020.
-
Real-Time Predictive Control for Precision Machining
Authors:
Alexander Liniger,
Luca Varano,
Alisa Rupenyan,
John Lygeros
Abstract:
Precise positioning and fast traversal times are crucial in achieving high productivity and scale in machining. This paper compares two optimization-based predictive control approaches that achieve high performance. In the first approach, the contour error is defined using the global position, the position on the path is inferred through a virtual path parameter, and the cost function combines the…
▽ More
Precise positioning and fast traversal times are crucial in achieving high productivity and scale in machining. This paper compares two optimization-based predictive control approaches that achieve high performance. In the first approach, the contour error is defined using the global position, the position on the path is inferred through a virtual path parameter, and the cost function combines the corresponding states and inputs to achieve a trade-off between high speed and positioning accuracy. The second approach is based on a local definition of both the error and the progress along the path, and results in a system with a reduced number of states and inputs that enables real-time optimization. Terminal and trust region constraints are required to achieve precise tracking of geometries where a fast or instantaneous change in direction is present. The performance of both approaches using different quadratic programming solvers is evaluated in simulations for geometries that are challenging in machine tools applications.
△ Less
Submitted 29 August, 2019; v1 submitted 28 August, 2019;
originally announced August 2019.