-
A Unification Between Deep-Learning Vision, Compartmental Dynamical Thermodynamics, and Robotic Manipulation for a Circular Economy
Authors:
Federico Zocco,
Wassim M. Haddad,
Andrea Corti,
Monica Malvezzi
Abstract:
The shift from a linear to a circular economy has the potential to simultaneously reduce uncertainties of material supplies and waste generation. To date, the development of robotic and, more generally, autonomous systems have been rarely integrated into circular economy implementation strategies. In this review, we merge deep-learning vision, compartmental dynamical thermodynamics, and robotic ma…
▽ More
The shift from a linear to a circular economy has the potential to simultaneously reduce uncertainties of material supplies and waste generation. To date, the development of robotic and, more generally, autonomous systems have been rarely integrated into circular economy implementation strategies. In this review, we merge deep-learning vision, compartmental dynamical thermodynamics, and robotic manipulation into a theoretically-coherent physics-based research framework to lay the foundations of circular flow designs of materials, and hence, to speed-up the transition from linearity to circularity. Then, we discuss opportunities for robotics in circular economy.
△ Less
Submitted 23 May, 2024;
originally announced May 2024.
-
Synchronized Object Detection for Autonomous Sorting, Map**, and Quantification of Medical Materials
Authors:
Federico Zocco,
Daniel Lake,
Shahin Rahimifard
Abstract:
The circular economy paradigm is gaining interest as a solution to reduce both material supply uncertainties and waste generation. One of the main challenges is monitoring materials, since in general, something that is not measured cannot be effectively managed. In this paper, we propose real-time synchronized object detection to enable, at the same time, autonomous sorting, map**, and quantific…
▽ More
The circular economy paradigm is gaining interest as a solution to reduce both material supply uncertainties and waste generation. One of the main challenges is monitoring materials, since in general, something that is not measured cannot be effectively managed. In this paper, we propose real-time synchronized object detection to enable, at the same time, autonomous sorting, map**, and quantification of end-of-life medical materials. Dataset, code, and demo videos are publicly available.
△ Less
Submitted 10 May, 2024;
originally announced May 2024.
-
Towards a Thermodynamical Deep-Learning-Vision-Based Flexible Robotic Cell for Circular Healthcare
Authors:
Federico Zocco,
Denis Sleath,
Shahin Rahimifard
Abstract:
The dependence on finite reserves of raw materials and the production of waste are two unsolved problems of the traditional linear economy. Healthcare, as a major sector of any nation, is currently facing them. Hence, in this paper, we report theoretical and practical advances of robotic reprocessing of small medical devices. Specifically, on the theory, we combine compartmental dynamical thermody…
▽ More
The dependence on finite reserves of raw materials and the production of waste are two unsolved problems of the traditional linear economy. Healthcare, as a major sector of any nation, is currently facing them. Hence, in this paper, we report theoretical and practical advances of robotic reprocessing of small medical devices. Specifically, on the theory, we combine compartmental dynamical thermodynamics with the mechanics of robots to integrate robotics into a system-level perspective, and then, propose graph-based circularity indicators by leveraging our thermodynamic framework. Our thermodynamic framework is also a step forward in defining the theoretical foundations of circular material flow designs as it improves material flow analysis (MFA) by adding dynamical energy balances to the usual mass balances. On the practice, we report on the on-going design of a flexible robotic cell enabled by deep-learning vision for resources map** and quantification, disassembly, and waste sorting of small medical devices.
△ Less
Submitted 8 February, 2024;
originally announced February 2024.
-
Visual Material Characteristics Learning for Circular Healthcare
Authors:
Federico Zocco,
Shahin Rahimifard
Abstract:
The linear take-make-dispose paradigm at the foundations of our traditional economy is proving to be unsustainable due to waste pollution and material supply uncertainties. Hence, increasing the circularity of material flows is necessary. In this paper, we make a step towards circular healthcare by develo** several vision systems targeting three main circular economy tasks: resources map** and…
▽ More
The linear take-make-dispose paradigm at the foundations of our traditional economy is proving to be unsustainable due to waste pollution and material supply uncertainties. Hence, increasing the circularity of material flows is necessary. In this paper, we make a step towards circular healthcare by develo** several vision systems targeting three main circular economy tasks: resources map** and quantification, waste sorting, and disassembly. The performance of our systems demonstrates that representation-learning vision can improve the recovery chain, where autonomous systems are key enablers due to the contamination risks. We also published two fully-annotated datasets for image segmentation and for key-point tracking in disassembly operations of inhalers and glucose meters. The datasets and source code are publicly available.
△ Less
Submitted 9 September, 2023;
originally announced September 2023.
-
Distributed Fixed-Time Consensus Control for Multiple AUV Systems with Input Saturations
Authors:
Mien Van,
Yuzhu Sun,
Stephen Mcllvanna,
Minh-Nhat Nguyen,
Federico Zocco,
Zhijie Liu,
Hsueh-Cheng Wang
Abstract:
This study proposes a new distributed control method based on an adaptive fuzzy control for multiple collaborative autonomous underwater vehicles (AUVs) to track a desired formation shape within a fixed time. First, a formation control protocol based on a fixed-time backstep** sliding mode control is designed, in which the consensus cooperative tracking errors for each AUV will be formulated. Th…
▽ More
This study proposes a new distributed control method based on an adaptive fuzzy control for multiple collaborative autonomous underwater vehicles (AUVs) to track a desired formation shape within a fixed time. First, a formation control protocol based on a fixed-time backstep** sliding mode control is designed, in which the consensus cooperative tracking errors for each AUV will be formulated. Then, to compensate for the saturated control torques, an adaptive auxiliary variable is introduced. Finally, a fixed-time adaptive fuzzy logic control (FLC) is derived to approximate the unknown dynamics, in which the adaptive laws of the FLC is derived such that the adaptive signals and errors can be convergent within a fixed time. The fixed time convergence is desired in practice because it provides an exciting property that the global convergence of the whole system is independent with the initial states of the AUVs. The computer simulation results for a consensus formation control of four AUVs show that the proposed formation control can provide high tracking performance with lower and smoother control efforts
△ Less
Submitted 27 February, 2023;
originally announced February 2023.
-
Digital Twins for Marine Operations: A Brief Review on Their Implementation
Authors:
Federico Zocco,
Hsueh-Cheng Wang,
Mien Van
Abstract:
While the concept of a digital twin to support maritime operations is gaining attention for predictive maintenance, real-time monitoring, control, and overall process optimization, clarity on its implementation is missing in the literature. Therefore, in this review we show how different authors implemented their digital twins, discuss our findings, and finally give insights on future research dir…
▽ More
While the concept of a digital twin to support maritime operations is gaining attention for predictive maintenance, real-time monitoring, control, and overall process optimization, clarity on its implementation is missing in the literature. Therefore, in this review we show how different authors implemented their digital twins, discuss our findings, and finally give insights on future research directions.
△ Less
Submitted 16 January, 2023;
originally announced January 2023.
-
Circularity of Thermodynamical Material Networks: Indicators, Examples, and Algorithms
Authors:
Federico Zocco,
Beatrice Smyth,
Pantelis Sopasakis
Abstract:
The transition towards a circular economy has gained importance over the last years since the traditional linear take-make-dispose paradigm is not sustainable in the long term. Recently, thermodynamical material networks (TMNs) [1] have been proposed as an approach to re-design material flows based on the idea that any supply chain can be seen as a set of thermodynamic compartments that can be add…
▽ More
The transition towards a circular economy has gained importance over the last years since the traditional linear take-make-dispose paradigm is not sustainable in the long term. Recently, thermodynamical material networks (TMNs) [1] have been proposed as an approach to re-design material flows based on the idea that any supply chain can be seen as a set of thermodynamic compartments that can be added, removed, modified or connected differently. In this paper, we develop several circularity indicators of TMNs using a graph-based formalism and illustrate their calculation through examples. The paper source code is publicly available.
△ Less
Submitted 13 December, 2022; v1 submitted 29 September, 2022;
originally announced September 2022.
-
Towards More Efficient EfficientDets and Low-Light Real-Time Marine Debris Detection
Authors:
Federico Zocco,
Ching-I Huang,
Hsueh-Cheng Wang,
Mohammad Omar Khyam,
Mien Van
Abstract:
Marine debris is a problem both for the health of marine environments and for the human health since tiny pieces of plastic called "microplastics" resulting from the debris decomposition over the time are entering the food chain at any levels. For marine debris detection and removal, autonomous underwater vehicles (AUVs) are a potential solution. In this letter, we focus on the efficiency of AUV v…
▽ More
Marine debris is a problem both for the health of marine environments and for the human health since tiny pieces of plastic called "microplastics" resulting from the debris decomposition over the time are entering the food chain at any levels. For marine debris detection and removal, autonomous underwater vehicles (AUVs) are a potential solution. In this letter, we focus on the efficiency of AUV vision for real-time and low-light object detection. First, we improved the efficiency of a class of state-of-the-art object detectors, namely EfficientDets, by 1.5% AP on D0, 2.6% AP on D1, 1.2% AP on D2 and 1.3% AP on D3 without increasing the GPU latency. Subsequently, we created and made publicly available a dataset for the detection of in-water plastic bags and bottles and trained our improved EfficientDets on this and another dataset for marine debris detection. Finally, we investigated how the detector performance is affected by low-light conditions and compared two low-light underwater image enhancement strategies both in terms of accuracy and latency. Source code and dataset are publicly available.
△ Less
Submitted 14 March, 2022;
originally announced March 2022.
-
Thermodynamical Material Networks for Modeling, Planning, and Control of Circular Material Flows
Authors:
Federico Zocco,
Pantelis Sopasakis,
Beatrice Smyth,
Wassim M. Haddad
Abstract:
Waste production, carbon dioxide atmospheric accumulation, and dependence on finite natural resources are expressions of the unsustainability of the current industrial networks that supply fuels, energy, and manufacturing products. In particular, circular manufacturing supply chains and carbon control networks are urgently needed. To model and design these and, in general, any material networks, w…
▽ More
Waste production, carbon dioxide atmospheric accumulation, and dependence on finite natural resources are expressions of the unsustainability of the current industrial networks that supply fuels, energy, and manufacturing products. In particular, circular manufacturing supply chains and carbon control networks are urgently needed. To model and design these and, in general, any material networks, we propose to generalize the approach used for traditional networks such as water and thermal power systems by using compartmental dynamical thermodynamics and graph theory. The key idea is that the thermodynamic compartments and their connections can be added, removed or modified as needed to achieve a circular material flow. The design methodology is explained and its application is illustrated through examples. In addition, we provide a physics-based definition of circularity and, by implementing a nonlinear compartmental control, we strengthen the connection between "Industry 4.0" and "Sustainability". The paper source code is publicly available.
△ Less
Submitted 14 November, 2022; v1 submitted 20 November, 2021;
originally announced November 2021.
-
Lazy FSCA for Unsupervised Variable Selection
Authors:
Federico Zocco,
Marco Maggipinto,
Gian Antonio Susto,
Seán McLoone
Abstract:
Various unsupervised greedy selection methods have been proposed as computationally tractable approximations to the NP-hard subset selection problem. These methods rely on sequentially selecting the variables that best improve performance with respect to a selection criterion. Theoretical results exist that provide performance bounds and enable "lazy greedy" efficient implementations for selection…
▽ More
Various unsupervised greedy selection methods have been proposed as computationally tractable approximations to the NP-hard subset selection problem. These methods rely on sequentially selecting the variables that best improve performance with respect to a selection criterion. Theoretical results exist that provide performance bounds and enable "lazy greedy" efficient implementations for selection criteria that satisfy a diminishing returns property known as submodularity. This has motivated the development of variable selection algorithms based on mutual information and frame potential. Recently, the authors introduced Forward Selection Component Analysis (FSCA) which uses variance explained as its selection criterion. While this criterion is not submodular, FSCA has been shown to be highly effective for applications such as measurement plan optimisation. In this paper a "lazy" implementation of the FSCA algorithm (L-FSCA) is proposed, which, although not equivalent to FSCA due to the absence of submodularity, has the potential to yield comparable performance while being up to an order of magnitude faster to compute. The efficacy of L-FSCA is demonstrated by performing a systematic comparison with FSCA and five other unsupervised variable selection methods from the literature using simulated and real-world case studies. Experimental results confirm that L-FSCA yields almost identical performance to FSCA while reducing computation time by between 22% and 94% for the case studies considered.
△ Less
Submitted 24 January, 2022; v1 submitted 3 March, 2021;
originally announced March 2021.
-
Material Measurement Units for a Circular Economy: Foundations through a Review
Authors:
Federico Zocco,
Seán McLoone,
Beatrice Smyth
Abstract:
Long-term availability of minerals and industrial materials is a necessary condition for sustainable development as they are the constituents of any manufacturing product. To enhance the efficiency of material management, we define a computer-vision-enabled material measurement system and provide a review of works relevant to its development with particular emphasis on the foundations. A network o…
▽ More
Long-term availability of minerals and industrial materials is a necessary condition for sustainable development as they are the constituents of any manufacturing product. To enhance the efficiency of material management, we define a computer-vision-enabled material measurement system and provide a review of works relevant to its development with particular emphasis on the foundations. A network of such systems for wide-area material stock monitoring is also covered. Finally, challenges and future research directions are discussed. As the first article bridging industrial ecology and advanced computer vision, this review is intended to support both research communities towards more sustainable manufacturing.
△ Less
Submitted 26 April, 2022; v1 submitted 2 March, 2021;
originally announced March 2021.
-
Recovery of Linear Components: Reduced Complexity Autoencoder Designs
Authors:
Federico Zocco,
Seán McLoone
Abstract:
Reducing dimensionality is a key preprocessing step in many data analysis applications to address the negative effects of the curse of dimensionality and collinearity on model performance and computational complexity, to denoise the data or to reduce storage requirements. Moreover, in many applications it is desirable to reduce the input dimensions by choosing a subset of variables that best repre…
▽ More
Reducing dimensionality is a key preprocessing step in many data analysis applications to address the negative effects of the curse of dimensionality and collinearity on model performance and computational complexity, to denoise the data or to reduce storage requirements. Moreover, in many applications it is desirable to reduce the input dimensions by choosing a subset of variables that best represents the entire set without any a priori information available. Unsupervised variable selection techniques provide a solution to this second problem. An autoencoder, if properly regularized, can solve both unsupervised dimensionality reduction and variable selection, but the training of large neural networks can be prohibitive in time sensitive applications. We present an approach called Recovery of Linear Components (RLC), which serves as a middle ground between linear and non-linear dimensionality reduction techniques, reducing autoencoder training times while enhancing performance over purely linear techniques. With the aid of synthetic and real world case studies, we show that the RLC, when compared with an autoencoder of similar complexity, shows higher accuracy, similar robustness to overfitting, and faster training times. Additionally, at the cost of a relatively small increase in computational complexity, RLC is shown to outperform the current state-of-the-art for a semiconductor manufacturing wafer measurement site optimization application.
△ Less
Submitted 14 December, 2020;
originally announced December 2020.
-
An Adaptive Memory Multi-Batch L-BFGS Algorithm for Neural Network Training
Authors:
Federico Zocco,
Seán McLoone
Abstract:
Motivated by the potential for parallel implementation of batch-based algorithms and the accelerated convergence achievable with approximated second order information a limited memory version of the BFGS algorithm has been receiving increasing attention in recent years for large neural network training problems. As the shape of the cost function is generally not quadratic and only becomes approxim…
▽ More
Motivated by the potential for parallel implementation of batch-based algorithms and the accelerated convergence achievable with approximated second order information a limited memory version of the BFGS algorithm has been receiving increasing attention in recent years for large neural network training problems. As the shape of the cost function is generally not quadratic and only becomes approximately quadratic in the vicinity of a minimum, the use of second order information by L-BFGS can be unreliable during the initial phase of training, i.e. when far from a minimum. Therefore, to control the influence of second order information as training progresses, we propose a multi-batch L-BFGS algorithm, namely MB-AM, that gradually increases its trust in the curvature information by implementing a progressive storage and use of curvature data through a development-based increase (dev-increase) scheme. Using six discriminative modelling benchmark problems we show empirically that MB-AM has slightly faster convergence and, on average, achieves better solutions than the standard multi-batch L-BFGS algorithm when training MLP and CNN models.
△ Less
Submitted 14 December, 2020;
originally announced December 2020.