-
Selecting Subsets of Source Data for Transfer Learning with Applications in Metal Additive Manufacturing
Authors:
Yifan Tang,
M. Rahmani Dehaghani,
Pouyan Sajadi,
G. Gary Wang
Abstract:
Considering data insufficiency in metal additive manufacturing (AM), transfer learning (TL) has been adopted to extract knowledge from source domains (e.g., completed printings) to improve the modeling performance in target domains (e.g., new printings). Current applications use all accessible source data directly in TL with no regard to the similarity between source and target data. This paper pr…
▽ More
Considering data insufficiency in metal additive manufacturing (AM), transfer learning (TL) has been adopted to extract knowledge from source domains (e.g., completed printings) to improve the modeling performance in target domains (e.g., new printings). Current applications use all accessible source data directly in TL with no regard to the similarity between source and target data. This paper proposes a systematic method to find appropriate subsets of source data based on similarities between the source and target datasets for a given set of limited target domain data. Such similarity is characterized by the spatial and model distance metrics. A Pareto frontier-based source data selection method is developed, where the source data located on the Pareto frontier defined by two similarity distance metrics are selected iteratively. The method is integrated into an instance-based TL method (decision tree regression model) and a model-based TL method (fine-tuned artificial neural network). Both models are then tested on several regression tasks in metal AM. Comparison results demonstrate that 1) the source data selection method is general and supports integration with various TL methods and distance metrics, 2) compared with using all source data, the proposed method can find a small subset of source data from the same domain with better TL performance in metal AM regression tasks involving different processes and machines, and 3) when multiple source domains exist, the source data selection method could find the subset from one source domain to obtain comparable or better TL performance than the model constructed using data from all source domains.
△ Less
Submitted 15 January, 2024;
originally announced January 2024.
-
Real-Time 2D Temperature Field Prediction in Metal Additive Manufacturing Using Physics-Informed Neural Networks
Authors:
Pouyan Sajadi,
Mostafa Rahmani Dehaghani,
Yifan Tang,
G. Gary Wang
Abstract:
Accurately predicting the temperature field in metal additive manufacturing (AM) processes is critical to preventing overheating, adjusting process parameters, and ensuring process stability. While physics-based computational models offer precision, they are often time-consuming and unsuitable for real-time predictions and online control in iterative design scenarios. Conversely, machine learning…
▽ More
Accurately predicting the temperature field in metal additive manufacturing (AM) processes is critical to preventing overheating, adjusting process parameters, and ensuring process stability. While physics-based computational models offer precision, they are often time-consuming and unsuitable for real-time predictions and online control in iterative design scenarios. Conversely, machine learning models rely heavily on high-quality datasets, which can be costly and challenging to obtain within the metal AM domain. Our work addresses this by introducing a physics-informed neural network framework specifically designed for temperature field prediction in metal AM. This framework incorporates a physics-informed input, physics-informed loss function, and a Convolutional Long Short-Term Memory (ConvLSTM) architecture. Utilizing real-time temperature data from the process, our model predicts 2D temperature fields for future timestamps across diverse geometries, deposition patterns, and process parameters. We validate the proposed framework in two scenarios: full-field temperature prediction for a thin wall and 2D temperature field prediction for cylinder and cubic parts, demonstrating errors below 3% and 1%, respectively. Our proposed framework exhibits the flexibility to be applied across diverse scenarios with varying process parameters, geometries, and deposition patterns.
△ Less
Submitted 4 January, 2024;
originally announced January 2024.
-
Online Two-stage Thermal History Prediction Method for Metal Additive Manufacturing of Thin Walls
Authors:
Yifan Tang,
M. Rahmani Dehaghani,
Pouyan Sajadi,
Shahriar Bakrani Balani,
Akshay Dhalpe,
Suraj Panicker,
Di Wu,
Eric Coatanea,
G. Gary Wang
Abstract:
This paper aims to propose an online two-stage thermal history prediction method, which could be integrated into a metal AM process for performance control. Based on the similarity of temperature curves (curve segments of a temperature profile of one point) between any two successive layers, the first stage of the proposed method designs a layer-to-layer prediction model to estimate the temperatur…
▽ More
This paper aims to propose an online two-stage thermal history prediction method, which could be integrated into a metal AM process for performance control. Based on the similarity of temperature curves (curve segments of a temperature profile of one point) between any two successive layers, the first stage of the proposed method designs a layer-to-layer prediction model to estimate the temperature curves of the yet-to-print layer from measured temperatures of certain points on the previously printed layer. With measured/predicted temperature profiles of several points on the same layer, the second stage proposes a reduced order model (ROM) (intra-layer prediction model) to decompose and construct the temperature profiles of all points on the same layer, which could be used to build the temperature field of the entire layer. The training of ROM is performed with an extreme learning machine (ELM) for computational efficiency. Fifteen wire arc AM experiments and nine simulations are designed for thin walls with a fixed length and unidirectional printing of each layer. The test results indicate that the proposed prediction method could construct the thermal history of a yet-to-print layer within 0.1 seconds on a low-cost desktop computer. Meanwhile, the method has acceptable generalization capability in most cases from lower layers to higher layers in the same simulation, as well as from one simulation to a new simulation on different AM process parameters. More importantly, after fine-tuning the proposed method with limited experimental data, the relative errors of all predicted temperature profiles on a new experiment are smaller than 0.09, which demonstrates the applicability and generalization of the proposed two-stage thermal history prediction method in online applications for metal AM.
△ Less
Submitted 17 November, 2023; v1 submitted 24 October, 2023;
originally announced October 2023.
-
System identification and closed-loop control of laser hot-wire directed energy deposition using the parameter-signature-property modeling scheme
Authors:
M. Rahmani Dehaghani,
Atieh Sahraeidolatkhaneh,
Morgan Nilsen,
Fredrik Sikström,
Pouyan Sajadi,
Yifan Tang,
G. Gary Wang
Abstract:
Hot-wire directed energy deposition using a laser beam (DED-LB/w) is a method of metal additive manufacturing (AM) that has benefits of high material utilization and deposition rate, but parts manufactured by DED-LB/w suffer from a substantial heat input and undesired surface finish. Hence, monitoring and controlling the process parameters and signatures during the deposition is crucial to ensure…
▽ More
Hot-wire directed energy deposition using a laser beam (DED-LB/w) is a method of metal additive manufacturing (AM) that has benefits of high material utilization and deposition rate, but parts manufactured by DED-LB/w suffer from a substantial heat input and undesired surface finish. Hence, monitoring and controlling the process parameters and signatures during the deposition is crucial to ensure the quality of final part properties and geometries. This paper explores the dynamic modeling of the DED-LB/w process and introduces a parameter-signature-property modeling and control approach to enhance the quality of modeling and control of part properties that cannot be measured in situ. The study investigates different process parameters that influence the melt pool width (signature) and bead width (property) in single and multi-layer beads. The proposed modeling approach utilizes a parameter-signature model as F_1 and a signature-property model as F_2. Linear and nonlinear modeling approaches are compared to describe a dynamic relationship between process parameters and a process signature, the melt pool width (F_1). A fully connected artificial neural network is employed to model and predict the final part property, i.e., bead width, based on melt pool signatures (F_2). Finally, the effectiveness and usefulness of the proposed parameter-signature-property modeling is tested and verified by integrating the parameter-signature (F_1) and signature-property (F_2) models in the closed-loop control of the width of the part. Compared with the control loop with only F_1, the proposed method shows clear advantages and bears potential to be applied to control other part properties that cannot be directly measured or monitored in situ.
△ Less
Submitted 18 October, 2023;
originally announced October 2023.
-
Comparison of Transfer Learning based Additive Manufacturing Models via A Case Study
Authors:
Yifan Tang,
M. Rahmani Dehaghani,
G. Gary Wang
Abstract:
Transfer learning (TL) based additive manufacturing (AM) modeling is an emerging field to reuse the data from historical products and mitigate the data insufficiency in modeling new products. Although some trials have been conducted recently, the inherent challenges of applying TL in AM modeling are seldom discussed, e.g., which source domain to use, how much target data is needed, and whether to…
▽ More
Transfer learning (TL) based additive manufacturing (AM) modeling is an emerging field to reuse the data from historical products and mitigate the data insufficiency in modeling new products. Although some trials have been conducted recently, the inherent challenges of applying TL in AM modeling are seldom discussed, e.g., which source domain to use, how much target data is needed, and whether to apply data preprocessing techniques. This paper aims to answer those questions through a case study defined based on an open-source dataset about metal AM products. In the case study, five TL methods are integrated with decision tree regression (DTR) and artificial neural network (ANN) to construct six TL-based models, whose performances are then compared with the baseline DTR and ANN in a proposed validation framework. The comparisons are used to quantify the performance of applied TL methods and are discussed from the perspective of similarity, training data size, and data preprocessing. Finally, the source AM domain with larger qualitative similarity and a certain range of target-to-source training data size ratio are recommended. Besides, the data preprocessing should be performed carefully to balance the modeling performance and the performance improvement due to TL.
△ Less
Submitted 16 May, 2023;
originally announced May 2023.
-
Exploring TeV candidates of Fermi blazars through machine learning
Authors:
J. T. Zhu,
C. Lin,
H. B. Xiao,
J. H. Fan,
D. Bastieri,
G. G. Wang
Abstract:
In this work, we make use of a supervised machine learning algorithm based on Logistic Regression (LR) to select TeV blazar candidates from the 4FGL-DR2 / 4LAC-DR2, 3FHL, 3HSP, and 2BIGB catalogs. LR constructs a hyperplane based on a selection of optimal parameters, named features, and hyper-parameters whose values control the learning process and determine the values of features that a learning…
▽ More
In this work, we make use of a supervised machine learning algorithm based on Logistic Regression (LR) to select TeV blazar candidates from the 4FGL-DR2 / 4LAC-DR2, 3FHL, 3HSP, and 2BIGB catalogs. LR constructs a hyperplane based on a selection of optimal parameters, named features, and hyper-parameters whose values control the learning process and determine the values of features that a learning algorithm ends up learning, to discriminate TeV blazars from non-TeV blazars. In addition, it gives the probability (or logistic) that a source may be considered as a TeV blazar candidate. Non-TeV blazars with logistics greater than 80% are considered high-confidence TeV candidates. Using this technique, we identify 40 high-confidence TeV candidates from the 4FGL-DR2 / 4LAC-DR2 blazars and we build the feature hyper-plane to distinguish TeV and non-TeV blazars. We also calculate the hyper-planes for the 3FHL, 3HSP, and 2BIGB. Finally, we construct the broadband spectral energy distributions (SED) for the 40 candidates, testing for their detectability with various instruments. We find that 7 of them are likely to be detected by existing or upcoming IACT observatories, while 1 could be observed with EAS particle detector arrays.
△ Less
Submitted 18 March, 2023;
originally announced March 2023.
-
A Possible 3-Year Quasi-Periodic Oscillation in γ-Ray Emission from the FSRQ S5 1044+71
Authors:
G. G. Wang,
J. T. Cai,
J. H. Fan
Abstract:
Variability is a typical observation feature of Fermi blazars, sometimes it shows quasi-periodic oscillation (QPO). In this work, we obtained 5-day binned light curves (with a time coverage of $\sim$ 12.9 yr) for S5 1044+71 based on Fermi LAT data, adopted five different methods: Date-compensated Discrete Fourier Transform (DCDFT), Jurkevich (JV), Lomb-Scargle Periodogram (LSP), a Fortran 90 progr…
▽ More
Variability is a typical observation feature of Fermi blazars, sometimes it shows quasi-periodic oscillation (QPO). In this work, we obtained 5-day binned light curves (with a time coverage of $\sim$ 12.9 yr) for S5 1044+71 based on Fermi LAT data, adopted five different methods: Date-compensated Discrete Fourier Transform (DCDFT), Jurkevich (JV), Lomb-Scargle Periodogram (LSP), a Fortran 90 program (REDFIT) and the Weighted Wavelet Z-transform (WWZ) to the $γ$-ray light curve, and found a possible QPO of 3.06 $\pm$ 0.43 yr at the significance level of $\sim3.6σ$. A binary black hole model including accretion model and dual-jets model is used to explain this quasi-periodic variability. We also estimated the Doppler factors and the apparent velocity for the two jet components. We speculate that this $γ$-ray quasi-periodic modulation suggest the presence of a binary supermassive black hole in S5 1044+71.
△ Less
Submitted 4 March, 2022;
originally announced March 2022.
