-
Functional Neural Network Control Chart
Authors:
Murat Kulahci,
Antonio Lepore,
Biagio Palumbo,
Gianluca Sposito
Abstract:
In many Industry 4.0 data analytics applications, quality characteristic data acquired from manufacturing processes are better modeled as functions, often referred to as profiles. In practice, there are situations where a scalar quality characteristic, referred to also as the response, is influenced by one or more variables in the form of functional data, referred to as functional covariates. To a…
▽ More
In many Industry 4.0 data analytics applications, quality characteristic data acquired from manufacturing processes are better modeled as functions, often referred to as profiles. In practice, there are situations where a scalar quality characteristic, referred to also as the response, is influenced by one or more variables in the form of functional data, referred to as functional covariates. To adjust the monitoring of the scalar response by the effect of this additional information, a new profile monitoring strategy is proposed on the residuals obtained from the functional neural network, which is able to learn a possibly nonlinear relationship between the scalar response and the functional covariates. An extensive Monte Carlo simulation study is performed to assess the performance of the proposed method with respect to other control charts that appeared in the literature before. Finally, a case study in the railway industry is presented with the aim of monitoring the heating, ventilation and air conditioning systems installed onboard passenger trains.
△ Less
Submitted 18 November, 2023;
originally announced November 2023.
-
Active learning for data streams: a survey
Authors:
Davide Cacciarelli,
Murat Kulahci
Abstract:
Online active learning is a paradigm in machine learning that aims to select the most informative data points to label from a data stream. The problem of minimizing the cost associated with collecting labeled observations has gained a lot of attention in recent years, particularly in real-world applications where data is only available in an unlabeled form. Annotating each observation can be time-…
▽ More
Online active learning is a paradigm in machine learning that aims to select the most informative data points to label from a data stream. The problem of minimizing the cost associated with collecting labeled observations has gained a lot of attention in recent years, particularly in real-world applications where data is only available in an unlabeled form. Annotating each observation can be time-consuming and costly, making it difficult to obtain large amounts of labeled data. To overcome this issue, many active learning strategies have been proposed in the last decades, aiming to select the most informative observations for labeling in order to improve the performance of machine learning models. These approaches can be broadly divided into two categories: static pool-based and stream-based active learning. Pool-based active learning involves selecting a subset of observations from a closed pool of unlabeled data, and it has been the focus of many surveys and literature reviews. However, the growing availability of data streams has led to an increase in the number of approaches that focus on online active learning, which involves continuously selecting and labeling observations as they arrive in a stream. This work aims to provide an overview of the most recently proposed approaches for selecting the most informative observations from data streams in real time. We review the various techniques that have been proposed and discuss their strengths and limitations, as well as the challenges and opportunities that exist in this area of research.
△ Less
Submitted 29 November, 2023; v1 submitted 17 February, 2023;
originally announced February 2023.
-
Robust online active learning
Authors:
Davide Cacciarelli,
Murat Kulahci,
John Sølve Tyssedal
Abstract:
In many industrial applications, obtaining labeled observations is not straightforward as it often requires the intervention of human experts or the use of expensive testing equipment. In these circumstances, active learning can be highly beneficial in suggesting the most informative data points to be used when fitting a model. Reducing the number of observations needed for model development allev…
▽ More
In many industrial applications, obtaining labeled observations is not straightforward as it often requires the intervention of human experts or the use of expensive testing equipment. In these circumstances, active learning can be highly beneficial in suggesting the most informative data points to be used when fitting a model. Reducing the number of observations needed for model development alleviates both the computational burden required for training and the operational expenses related to labeling. Online active learning, in particular, is useful in high-volume production processes where the decision about the acquisition of the label for a data point needs to be taken within an extremely short time frame. However, despite the recent efforts to develop online active learning strategies, the behavior of these methods in the presence of outliers has not been thoroughly examined. In this work, we investigate the performance of online active linear regression in contaminated data streams. Our study shows that the currently available query strategies are prone to sample outliers, whose inclusion in the training set eventually degrades the predictive performance of the models. To address this issue, we propose a solution that bounds the search area of a conditional D-optimal algorithm and uses a robust estimator. Our approach strikes a balance between exploring unseen regions of the input space and protecting against outliers. Through numerical simulations, we show that the proposed method is effective in improving the performance of online active learning in the presence of outliers, thus expanding the potential applications of this powerful tool.
△ Less
Submitted 18 July, 2023; v1 submitted 1 February, 2023;
originally announced February 2023.
-
Online Active Learning for Soft Sensor Development using Semi-Supervised Autoencoders
Authors:
Davide Cacciarelli,
Murat Kulahci,
John Tyssedal
Abstract:
Data-driven soft sensors are extensively used in industrial and chemical processes to predict hard-to-measure process variables whose real value is difficult to track during routine operations. The regression models used by these sensors often require a large number of labeled examples, yet obtaining the label information can be very expensive given the high time and cost required by quality inspe…
▽ More
Data-driven soft sensors are extensively used in industrial and chemical processes to predict hard-to-measure process variables whose real value is difficult to track during routine operations. The regression models used by these sensors often require a large number of labeled examples, yet obtaining the label information can be very expensive given the high time and cost required by quality inspections. In this context, active learning methods can be highly beneficial as they can suggest the most informative labels to query. However, most of the active learning strategies proposed for regression focus on the offline setting. In this work, we adapt some of these approaches to the stream-based scenario and show how they can be used to select the most informative data points. We also demonstrate how to use a semi-supervised architecture based on orthogonal autoencoders to learn salient features in a lower dimensional space. The Tennessee Eastman Process is used to compare the predictive performance of the proposed approaches.
△ Less
Submitted 9 April, 2023; v1 submitted 26 December, 2022;
originally announced December 2022.
-
Stream-based active learning with linear models
Authors:
Davide Cacciarelli,
Murat Kulahci,
John Sølve Tyssedal
Abstract:
The proliferation of automated data collection schemes and the advances in sensorics are increasing the amount of data we are able to monitor in real-time. However, given the high annotation costs and the time required by quality inspections, data is often available in an unlabeled form. This is fostering the use of active learning for the development of soft sensors and predictive models. In prod…
▽ More
The proliferation of automated data collection schemes and the advances in sensorics are increasing the amount of data we are able to monitor in real-time. However, given the high annotation costs and the time required by quality inspections, data is often available in an unlabeled form. This is fostering the use of active learning for the development of soft sensors and predictive models. In production, instead of performing random inspections to obtain product information, labels are collected by evaluating the information content of the unlabeled data. Several query strategy frameworks for regression have been proposed in the literature but most of the focus has been dedicated to the static pool-based scenario. In this work, we propose a new strategy for the stream-based scenario, where instances are sequentially offered to the learner, which must instantaneously decide whether to perform the quality check to obtain the label or discard the instance. The approach is inspired by the optimal experimental design theory and the iterative aspect of the decision-making process is tackled by setting a threshold on the informativeness of the unlabeled data points. The proposed approach is evaluated using numerical simulations and the Tennessee Eastman Process simulator. The results confirm that selecting the examples suggested by the proposed algorithm allows for a faster reduction in the prediction error.
△ Less
Submitted 13 July, 2023; v1 submitted 20 July, 2022;
originally announced July 2022.
-
Real-time Monitoring of Functional Data
Authors:
Fabio Centofanti,
Antonio Lepore,
Murat Kulahci,
Max Peter Spooner
Abstract:
With the rise of Industry 4.0, huge amounts of data are now generated that are apt to be modelled as functional data. In this setting, standard profile monitoring methods aim to assess the stability over time of a completely observed functional quality characteristic. However, in some practical situations, evaluating the process state in real-time, i.e., as the process is running, could be of grea…
▽ More
With the rise of Industry 4.0, huge amounts of data are now generated that are apt to be modelled as functional data. In this setting, standard profile monitoring methods aim to assess the stability over time of a completely observed functional quality characteristic. However, in some practical situations, evaluating the process state in real-time, i.e., as the process is running, could be of great interest to significantly improve the effectiveness of monitoring. To this aim, we propose a new method, referred to as functional real-time monitoring (FRTM), that is able to account for both phase and amplitude variation through the following steps: (i) registration; (ii) dimensionality reduction; (iii) monitoring of a partially observed functional quality characteristic. An extensive Monte Carlo simulation study is performed to quantify the performance of FRTM with respect to two competing methods. Finally, an example is presented where the proposed method is used to monitor batches from a penicillin production process in real-time.
△ Less
Submitted 12 May, 2022;
originally announced May 2022.
-
The physical approach on the surfaces of rotation in E24
Authors:
Fatma Almaz,
Mihriban Alyamaç KÜlahci
Abstract:
In this paper, some physical expressions as the specific energy and the specific angular momentum on these surfaces of rotation are investigated using conditions being geodesic on rotational surfaces with the help of Clairaut's theorem.
In this paper, some physical expressions as the specific energy and the specific angular momentum on these surfaces of rotation are investigated using conditions being geodesic on rotational surfaces with the help of Clairaut's theorem.
△ Less
Submitted 4 July, 2023; v1 submitted 13 August, 2021;
originally announced August 2021.
-
The Clairaut's theorem on rotational surfaces in pseudo Euclidean 4-space with index 2
Authors:
Fatma Almaz,
Mihriban Alyamaç Külahcı
Abstract:
In this paper, Clairaut's theorem is expressed on the surfaces of rotation in semi Euclidean 4-space. Moreover, the general equations of time-like geodesic curves are characterized according to the results of Clairaut's theorem on the hyperbolic surfaces of rotation and the elliptic surface of rotation respectively.
In this paper, Clairaut's theorem is expressed on the surfaces of rotation in semi Euclidean 4-space. Moreover, the general equations of time-like geodesic curves are characterized according to the results of Clairaut's theorem on the hyperbolic surfaces of rotation and the elliptic surface of rotation respectively.
△ Less
Submitted 4 July, 2023; v1 submitted 31 July, 2021;
originally announced August 2021.
-
The Research on Rotational Surfaces in pseudo Euclidean 4-space with index 2
Authors:
Fatma Almaz,
Mihriban Alyamaç Külahcı
Abstract:
In this study, we define a brief description of the hyperbolic and elliptic rotational surfaces using a curve and matrices in 4-dimensional semi Euclidean space. That is, we provide different types of rotational matrices, which are the subgroups of M by rotating a selected axis in E4. Hence, we choose two parameter matrices groups of rotations and we give the matrices of rotation corresponding to…
▽ More
In this study, we define a brief description of the hyperbolic and elliptic rotational surfaces using a curve and matrices in 4-dimensional semi Euclidean space. That is, we provide different types of rotational matrices, which are the subgroups of M by rotating a selected axis in E4. Hence, we choose two parameter matrices groups of rotations and we give the matrices of rotation corresponding to the appropriate subgroup in 4-dimensional semi Euclidean space and we generate rotated surfaces.
△ Less
Submitted 11 June, 2023; v1 submitted 28 July, 2021;
originally announced July 2021.
-
Model based Level Shift Detection in Autocorrelated Data Streams using a moving window
Authors:
Jacob Søgaard Larsen,
Anders Stockmarr,
Bjarne Kjær Ersbøll,
Murat Kulahci
Abstract:
Standard Control Chart techniques to detect level shift in data streams assume independence between observations. As data today is collected with high frequency, this assumption is seldom valid. To overcome this, we propose to adapt the off-line test procedure for detection of outliers based on one-step prediction errors proposed by Tsay (1988) into an on-line framework by considering a moving win…
▽ More
Standard Control Chart techniques to detect level shift in data streams assume independence between observations. As data today is collected with high frequency, this assumption is seldom valid. To overcome this, we propose to adapt the off-line test procedure for detection of outliers based on one-step prediction errors proposed by Tsay (1988) into an on-line framework by considering a moving window. Further, we present two algorithms, that in combination, estimate an appropriate test value for our control chart. We test our method on AR(1) processes exposed to level shifts of different sizes and compare it to CUSUM applied to one-step prediction errors. We find that, even though both methods perform comparable when tuned correctly, our method has higher probability of identifying the correct change point of the process. Furthermore, for more complicated processes our method is easier to tune, as the range of window size to be tested is independent of the process.
△ Less
Submitted 7 November, 2019; v1 submitted 11 July, 2019;
originally announced July 2019.
-
Assesment of Smarandache Curves in the Null Cone Q^2
Authors:
Mihriban Kulahci,
Fatma Almaz
Abstract:
In this paper, we give Smarandache curves according to the asymptotic orthonormal frame in null cone Q^2. By using cone frame formulas, we present some characterizations of Smarandache curves and calculate cone frenet invariants of these curves. Also, we illustrate these curves with an example.
In this paper, we give Smarandache curves according to the asymptotic orthonormal frame in null cone Q^2. By using cone frame formulas, we present some characterizations of Smarandache curves and calculate cone frenet invariants of these curves. Also, we illustrate these curves with an example.
△ Less
Submitted 7 March, 2017;
originally announced March 2017.
-
Non-zero constant curvature factorable surfaces in pseudo-Galilean space
Authors:
Muhittin Evren Aydin,
Mihriban Kulahci,
Alper Osman Ogrenmis
Abstract:
Factorable surfaces, i.e. graphs associated with the product of two functions of one variable, constitute a wide class of surfaces. Such surfaces in the pseudo-Galilean space with zero Gaussian and mean curvature were obtained in [1]. In this study, we provide new classification results relating to the factorable surfaces with non-zero Gaussian and mean curvature.
Factorable surfaces, i.e. graphs associated with the product of two functions of one variable, constitute a wide class of surfaces. Such surfaces in the pseudo-Galilean space with zero Gaussian and mean curvature were obtained in [1]. In this study, we provide new classification results relating to the factorable surfaces with non-zero Gaussian and mean curvature.
△ Less
Submitted 3 March, 2017;
originally announced March 2017.
-
Constant curvature translation surfaces in Galilean 3-space
Authors:
Alper Osman Ogrenmis,
Mihriban Kulahci,
Muhittin Evren Aydin
Abstract:
Total five different types of translation surfaces, based upon planarity of translating curves and the absolute figure, arise in a Galilean 3-space. Excepting the type in which both of translating curves are non-planar we obtain these surfaces with arbitrary constant Gaussian and mean curvature.
Total five different types of translation surfaces, based upon planarity of translating curves and the absolute figure, arise in a Galilean 3-space. Excepting the type in which both of translating curves are non-planar we obtain these surfaces with arbitrary constant Gaussian and mean curvature.
△ Less
Submitted 2 February, 2017;
originally announced February 2017.
-
Some Characterizations for Curves by the Help Of Spherical Representations in the Galilean and Pseudo-Galilean Space
Authors:
Alper Osman Öğrenmiş,
Münevver Yildirim Yilmaz,
Mihriban Külahci
Abstract:
In this paper, we focus on some characterizations for curves in the Galilean and Pseudo-Galilean space.
In this paper, we focus on some characterizations for curves in the Galilean and Pseudo-Galilean space.
△ Less
Submitted 2 November, 2011;
originally announced November 2011.