-
Stable Inversion of Piecewise Affine Systems with Application to Feedforward and Iterative Learning Control
Authors:
Isaac A. Spiegel,
Nard Strijbosch,
Robin de Rozario,
Tom Oomen,
Kira Barton
Abstract:
Model inversion is a fundamental technique in feedforward control. Unstable inverse models present a challenge in that useful feedforward control trajectories cannot be generated by directly propagating them. Stable inversion is a process for generating useful trajectories from unstable inverses by handling their stable and unstable modes separately. Piecewise affine (PWA) systems are a popular fr…
▽ More
Model inversion is a fundamental technique in feedforward control. Unstable inverse models present a challenge in that useful feedforward control trajectories cannot be generated by directly propagating them. Stable inversion is a process for generating useful trajectories from unstable inverses by handling their stable and unstable modes separately. Piecewise affine (PWA) systems are a popular framework for modeling complicated dynamics. The primary contributions of this article are closed-form inverse formulas for a general class of PWA models, and stable inversion methods for these models. Both contributions leverage closed-form model representations to prove sufficient conditions for solution existence and uniqueness, and to develop solution computation methods. The result is implementable feedforward control synthesis from PWA models with either stable or unstable inverses. In practice, feedforward control alone may yield substantial tracking errors due to mismatch between the known system model and the unknowable complete system physics. Iterative learning control (ILC) is a technique for achieving robustness to model error in feedforward control. To demonstrate the primary contributions' validity and utility, this article also integrates PWA stable inversion with ILC in simulations based on a physical printhead positioning system.
△ Less
Submitted 15 April, 2024;
originally announced April 2024.
-
Sequential Manipulation of Deformable Linear Object Networks with Endpoint Pose Measurements using Adaptive Model Predictive Control
Authors:
Tyler Toner,
Vahidreza Molazadeh,
Miguel Saez,
Dawn M. Tilbury,
Kira Barton
Abstract:
Robotic manipulation of deformable linear objects (DLOs) is an active area of research, though emerging applications, like automotive wire harness installation, introduce constraints that have not been considered in prior work. Confined workspaces and limited visibility complicate prior assumptions of multi-robot manipulation and direct measurement of DLO configuration (state). This work focuses o…
▽ More
Robotic manipulation of deformable linear objects (DLOs) is an active area of research, though emerging applications, like automotive wire harness installation, introduce constraints that have not been considered in prior work. Confined workspaces and limited visibility complicate prior assumptions of multi-robot manipulation and direct measurement of DLO configuration (state). This work focuses on single-arm manipulation of stiff DLOs (StDLOs) connected to form a DLO network (DLON), for which the measurements (output) are the endpoint poses of the DLON, which are subject to unknown dynamics during manipulation. To demonstrate feasibility of output-based control without state estimation, direct input-output dynamics are shown to exist by training neural network models on simulated trajectories. Output dynamics are then approximated with polynomials and found to contain well-known rigid body dynamics terms. A composite model consisting of a rigid body model and an online data-driven residual is developed, which predicts output dynamics more accurately than either model alone, and without prior experience with the system. An adaptive model predictive controller is developed with the composite model for DLON manipulation, which completes DLON installation tasks, both in simulation and with a physical automotive wire harness.
△ Less
Submitted 15 February, 2024;
originally announced February 2024.
-
A Multi-objective Mixed-integer Programming Approach for Supply Chain Disruption Response with Lead-Time Awareness
Authors:
Juan-Alberto Estrada-Garcia,
Mingjie Bi,
Dawn M. Tilbury,
Kira Barton,
Siqian Shen
Abstract:
Supply chain (SC) risk management is influenced by both spatial and temporal attributes of different entities (suppliers, retailers, and customers). Each entity has given capacity and lead time for processing and transporting products to downstream entities. Under disruptive events, lead time and capacities may vary, which affects the overall SC performance. There have been many studies on SC disr…
▽ More
Supply chain (SC) risk management is influenced by both spatial and temporal attributes of different entities (suppliers, retailers, and customers). Each entity has given capacity and lead time for processing and transporting products to downstream entities. Under disruptive events, lead time and capacities may vary, which affects the overall SC performance. There have been many studies on SC disruption mitigation, but often without considering lead time and the magnitude of lateness. In this paper, we formulate a mixed-integer programming (MIP) model to optimize SC operations via a routing and scheduling approach, to model the delivery time of products at different entities as they flow throughout the SC network. We minimize a weighted sum of multiple objectives involving costs related to transportation, shortage, and delivery lateness. We also develop a discrete-event simulation framework to evaluate the performance of solutions to the MIP model under lead time uncertainty. Via extensive numerical studies, we show how the attributes of SC entities affect the performance, so that we can improve SC design and operations under various uncertainties.
△ Less
Submitted 4 August, 2023;
originally announced August 2023.
-
Opportunities and Challenges to Integrate Artificial Intelligence into Manufacturing Systems: Thoughts from a Panel Discussion
Authors:
Ilya Kovalenko,
Kira Barton,
James Moyne,
Dawn M. Tilbury
Abstract:
Rapid advances in artificial intelligence (AI) have the potential to significantly increase the productivity, quality, and profitability in future manufacturing systems. Traditional mass-production will give way to personalized production, with each item made to order, at the low cost and high-quality consumers have come to expect. Manufacturing systems will have the intelligence to be resilient t…
▽ More
Rapid advances in artificial intelligence (AI) have the potential to significantly increase the productivity, quality, and profitability in future manufacturing systems. Traditional mass-production will give way to personalized production, with each item made to order, at the low cost and high-quality consumers have come to expect. Manufacturing systems will have the intelligence to be resilient to multiple disruptions, from small-scale machine breakdowns, to large-scale natural disasters. Products will be made with higher precision and lower variability. While gains have been made towards the development of these factories of the future, many challenges remain to fully realize this vision. To consider the challenges and opportunities associated with this topic, a panel of experts from Industry, Academia, and Government was invited to participate in an active discussion at the 2022 Modeling, Estimation and Control Conference (MECC) held in Jersey City, New Jersey from October 3- 5, 2022. The panel discussion focused on the challenges and opportunities to more fully integrate AI into manufacturing systems. Three overarching themes emerged from the panel discussion. First, to be successful, AI will need to work seamlessly, and in an integrated manner with humans (and vice versa). Second, significant gaps in the infrastructure needed to enable the full potential of AI into the manufacturing ecosystem, including sufficient data availability, storage, and analysis, must be addressed. And finally, improved coordination between universities, industry, and government agencies can facilitate greater opportunities to push the field forward. This article briefly summarizes these three themes, and concludes with a discussion of promising directions.
△ Less
Submitted 20 March, 2023;
originally announced March 2023.
-
A Model-based Multi-agent Framework to Enable an Agile Response to Supply Chain Disruptions
Authors:
Mingjie Bi,
Gongyu Chen,
Dawn M. Tilbury,
Siqian Shen,
Kira Barton
Abstract:
Due to the COVID-19 pandemic, the global supply chain is disrupted at an unprecedented scale under uncertain and unknown trends of labor shortage, high material prices, and changing travel or trade regulations. To stay competitive, enterprises desire agile and dynamic response strategies to quickly react to disruptions and recover supply-chain functions. Although both centralized and multi-agent a…
▽ More
Due to the COVID-19 pandemic, the global supply chain is disrupted at an unprecedented scale under uncertain and unknown trends of labor shortage, high material prices, and changing travel or trade regulations. To stay competitive, enterprises desire agile and dynamic response strategies to quickly react to disruptions and recover supply-chain functions. Although both centralized and multi-agent approaches have been studied, their implementation requires prior knowledge of disruptions and agent-rule-based reasoning. In this paper, we introduce a model-based multi-agent framework that enables agent coordination and dynamic agent decision-making to respond to supply chain disruptions in an agile and effective manner. Through a small-scale simulated case study, we showcase the feasibility of the proposed approach under several disruption scenarios that affect a supply chain network differently, and analyze performance trade-offs between the proposed distributed and centralized methods.
△ Less
Submitted 7 July, 2022;
originally announced July 2022.
-
Merging Subject Matter Expertise and Deep Convolutional Neural Network for State-Based Online Machine-Part Interaction Classification
Authors:
Hao Wang,
Yassine Qamsane,
James Moyne,
Kira Barton
Abstract:
Machine-part interaction classification is a key capability required by Cyber-Physical Systems (CPS), a pivotal enabler of Smart Manufacturing (SM). While previous relevant studies on the subject have primarily focused on time series classification, change point detection is equally important because it provides temporal information on changes in behavior of the machine. In this work, we address p…
▽ More
Machine-part interaction classification is a key capability required by Cyber-Physical Systems (CPS), a pivotal enabler of Smart Manufacturing (SM). While previous relevant studies on the subject have primarily focused on time series classification, change point detection is equally important because it provides temporal information on changes in behavior of the machine. In this work, we address point detection and time series classification for machine-part interactions with a deep Convolutional Neural Network (CNN) based framework. The CNN in this framework utilizes a two-stage encoder-classifier structure for efficient feature representation and convenient deployment customization for CPS. Though data-driven, the design and optimization of the framework are Subject Matter Expertise (SME) guided. An SME defined Finite State Machine (FSM) is incorporated into the framework to prohibit intermittent misclassifications. In the case study, we implement the framework to perform machine-part interaction classification on a milling machine, and the performance is evaluated using a testing dataset and deployment simulations. The implementation achieved an average F1-Score of 0.946 across classes on the testing dataset and an average delay of 0.24 seconds on the deployment simulations.
△ Less
Submitted 8 December, 2021;
originally announced December 2021.
-
Learning-Based Repetitive Precision Motion Control with Mismatch Compensation
Authors:
Efe C. Balta,
Kira Barton,
Dawn M. Tilbury,
Alisa Rupenyan,
John Lygeros
Abstract:
Learning-based control methods utilize run-time data from the underlying process to improve the controller performance under model mismatch and unmodeled disturbances. This is beneficial for optimizing industrial processes, where the dynamics are difficult to model, and the repetitive nature of the process can be exploited. In this work, we develop an iterative approach for repetitive precision mo…
▽ More
Learning-based control methods utilize run-time data from the underlying process to improve the controller performance under model mismatch and unmodeled disturbances. This is beneficial for optimizing industrial processes, where the dynamics are difficult to model, and the repetitive nature of the process can be exploited. In this work, we develop an iterative approach for repetitive precision motion control problems where the objective is to follow a reference geometry with minimal tracking error. Our method utilizes a nominal model of the process and learns the mismatch using Gaussian Process Regression (GPR). The control input and the GPR data are updated after each iteration to improve the performance in a run-to-run fashion. We provide a preliminary convergence analysis, implementation details of the proposed controller for minimizing different error types, and a case study where we demonstrate improved tracking performance with simulation and experimental results.
△ Less
Submitted 19 November, 2021;
originally announced November 2021.
-
Iterative learning control with discrete-time nonlinear nonminimum phase models via stable inversion
Authors:
Isaac A Spiegel,
Nard Strijbosch,
Tom Oomen,
Kira Barton
Abstract:
Output reference tracking can be improved by iteratively learning from past data to inform the design of feedforward control inputs for subsequent tracking attempts. This process is called iterative learning control (ILC). This article develops a method to apply ILC to systems with nonlinear discrete-time dynamical models with unstable inverses (i.e. discrete-time nonlinear non-minimum phase model…
▽ More
Output reference tracking can be improved by iteratively learning from past data to inform the design of feedforward control inputs for subsequent tracking attempts. This process is called iterative learning control (ILC). This article develops a method to apply ILC to systems with nonlinear discrete-time dynamical models with unstable inverses (i.e. discrete-time nonlinear non-minimum phase models). This class of systems includes piezoactuators, electric power converters, and manipulators with flexible links, which may be found in nanopositioning stages, rolling mills, and robotic arms, respectively. As these devices may be required to execute fine transient reference tracking tasks repetitively in contexts such as manufacturing, they may benefit from ILC. Specifically, this article facilitates ILC of such systems by presenting a new ILC synthesis framework that allows combination of the principles of Newton's root finding algorithm with stable inversion, a technique for generating stable trajectories from unstable models. The new framework, called Invert-Linearize ILC (ILILC), is validated in simulation on a cart-and-pendulum system with model error, process noise, and measurement noise. Where preexisting Newton-based ILC diverges, ILILC with stable inversion converges, and does so in less than one third the number of trials necessary for the convergence of a gradient-descent-based ILC technique used as a benchmark.
△ Less
Submitted 16 August, 2021;
originally announced August 2021.
-
Receding Horizon Iterative Learning Control for Continuously Operated Systems
Authors:
Maxwell Wu,
Mitchell Cobb,
James Reed,
Kirti Mishra,
Chris Vermillion,
Kira Barton
Abstract:
This paper presents an iterative learning control (ILC) scheme for continuously operated repetitive systems for which no initial condition reset exists. To accomplish this, we develop a lifted system representation that accounts for the effect of the initial conditions on dynamics and projects the dynamics over multiple future iterations. Additionally, we develop an economic cost function and upda…
▽ More
This paper presents an iterative learning control (ILC) scheme for continuously operated repetitive systems for which no initial condition reset exists. To accomplish this, we develop a lifted system representation that accounts for the effect of the initial conditions on dynamics and projects the dynamics over multiple future iterations. Additionally, we develop an economic cost function and update law that considers the performance over multiple iterations in the future, thus allowing for the prediction horizon to be larger than just the next iteration. Convergence of the iteration varying initial condition and applied input are proven and demonstrated using a simulated servo-positioning system test case.
△ Less
Submitted 15 August, 2021;
originally announced August 2021.
-
Learning to be EXACT, Cell Detection for Asthma on Partially Annotated Whole Slide Images
Authors:
Christian Marzahl,
Christof A. Bertram,
Frauke Wilm,
Jörn Voigt,
Ann K. Barton,
Robert Klopfleisch,
Katharina Breininger,
Andreas Maier,
Marc Aubreville
Abstract:
Asthma is a chronic inflammatory disorder of the lower respiratory tract and naturally occurs in humans and animals including horses. The annotation of an asthma microscopy whole slide image (WSI) is an extremely labour-intensive task due to the hundreds of thousands of cells per WSI. To overcome the limitation of annotating WSI incompletely, we developed a training pipeline which can train a deep…
▽ More
Asthma is a chronic inflammatory disorder of the lower respiratory tract and naturally occurs in humans and animals including horses. The annotation of an asthma microscopy whole slide image (WSI) is an extremely labour-intensive task due to the hundreds of thousands of cells per WSI. To overcome the limitation of annotating WSI incompletely, we developed a training pipeline which can train a deep learning-based object detection model with partially annotated WSIs and compensate class imbalances on the fly. With this approach we can freely sample from annotated WSIs areas and are not restricted to fully annotated extracted sub-images of the WSI as with classical approaches. We evaluated our pipeline in a cross-validation setup with a fixed training set using a dataset of six equine WSIs of which four are partially annotated and used for training, and two fully annotated WSI are used for validation and testing. Our WSI-based training approach outperformed classical sub-image-based training methods by up to 15\% $mAP$ and yielded human-like performance when compared to the annotations of ten trained pathologists.
△ Less
Submitted 13 January, 2021;
originally announced January 2021.
-
Deep Learning-Based Quantification of Pulmonary Hemosiderophages in Cytology Slides
Authors:
Christian Marzahl,
Marc Aubreville,
Christof A. Bertram,
Jason Stayt,
Anne-Katherine Jasensky,
Florian Bartenschlager,
Marco Fragoso-Garcia,
Ann K. Barton,
Svenja Elsemann,
Samir Jabari,
Jens Krauth,
Prathmesh Madhu,
Jörn Voigt,
Jenny Hill,
Robert Klopfleisch,
Andreas Maier
Abstract:
Purpose: Exercise-induced pulmonary hemorrhage (EIPH) is a common syndrome in sport horses with negative impact on performance. Cytology of bronchoalveolar lavage fluid by use of a scoring system is considered the most sensitive diagnostic method. Macrophages are classified depending on the degree of cytoplasmic hemosiderin content. The current gold standard is manual grading, which is however mon…
▽ More
Purpose: Exercise-induced pulmonary hemorrhage (EIPH) is a common syndrome in sport horses with negative impact on performance. Cytology of bronchoalveolar lavage fluid by use of a scoring system is considered the most sensitive diagnostic method. Macrophages are classified depending on the degree of cytoplasmic hemosiderin content. The current gold standard is manual grading, which is however monotonous and time-consuming. Methods: We evaluated state-of-the-art deep learning-based methods for single cell macrophage classification and compared them against the performance of nine cytology experts and evaluated inter- and intra-observer variability. Additionally, we evaluated object detection methods on a novel data set of 17 completely annotated cytology whole slide images (WSI) containing 78,047 hemosiderophages. Resultsf: Our deep learning-based approach reached a concordance of 0.85, partially exceeding human expert concordance (0.68 to 0.86, $μ$=0.73, $σ$ =0.04). Intra-observer variability was high (0.68 to 0.88) and inter-observer concordance was moderate (Fleiss kappa = 0.67). Our object detection approach has a mean average precision of 0.66 over the five classes from the whole slide gigapixel image and a computation time of below two minutes. Conclusion: To mitigate the high inter- and intra-rater variability, we propose our automated object detection pipeline, enabling accurate, reproducible and quick EIPH scoring in WSI.
△ Less
Submitted 12 August, 2019;
originally announced August 2019.
