-
Dynamic Exploration-Exploitation Trade-Off in Active Learning Regression with Bayesian Hierarchical Modeling
Authors:
Upala Junaida Islam,
Kamran Paynabar,
George Runger,
Ashif Sikandar Iquebal
Abstract:
Active learning provides a framework to adaptively query the most informative experiments towards learning an unknown black-box function. Various approaches of active learning have been proposed in the literature, however, they either focus on exploration or exploitation in the design space. Methods that do consider exploration-exploitation simultaneously employ fixed or ad-hoc measures to control…
▽ More
Active learning provides a framework to adaptively query the most informative experiments towards learning an unknown black-box function. Various approaches of active learning have been proposed in the literature, however, they either focus on exploration or exploitation in the design space. Methods that do consider exploration-exploitation simultaneously employ fixed or ad-hoc measures to control the trade-off that may not be optimal. In this paper, we develop a Bayesian hierarchical approach, referred as BHEEM, to dynamically balance the exploration-exploitation trade-off as more data points are queried. To sample from the posterior distribution of the trade-off parameter, We subsequently formulate an approximate Bayesian computation approach based on the linear dependence of queried data in the feature space. Simulated and real-world examples show the proposed approach achieves at least 21% and 11% average improvement when compared to pure exploration and exploitation strategies respectively. More importantly, we note that by optimally balancing the trade-off between exploration and exploitation, BHEEM performs better or at least as well as either pure exploration or pure exploitation.
△ Less
Submitted 30 September, 2023; v1 submitted 15 April, 2023;
originally announced April 2023.
-
Directionally Dependent Multi-View Clustering Using Copula Model
Authors:
Kahkashan Afrin,
Ashif S. Iquebal,
Mostafa Karimi,
Allyson Souris,
Se Yoon Lee,
Bani K. Mallick
Abstract:
In recent biomedical scientific problems, it is a fundamental issue to integratively cluster a set of objects from multiple sources of datasets. Such problems are mostly encountered in genomics, where data is collected from various sources, and typically represent distinct yet complementary information. Integrating these data sources for multi-source clustering is challenging due to their complex…
▽ More
In recent biomedical scientific problems, it is a fundamental issue to integratively cluster a set of objects from multiple sources of datasets. Such problems are mostly encountered in genomics, where data is collected from various sources, and typically represent distinct yet complementary information. Integrating these data sources for multi-source clustering is challenging due to their complex dependence structure including directional dependency. Particularly in genomics studies, it is known that there is certain directional dependence between DNA expression, DNA methylation, and RNA expression, widely called The Central Dogma.
Most of the existing multi-view clustering methods either assume an independent structure or pair-wise (non-directional) dependency, thereby ignoring the directional relationship. Motivated by this, we propose a copula-based multi-view clustering model where a copula enables the model to accommodate the directional dependence existing in the datasets. We conduct a simulation experiment where the simulated datasets exhibiting inherent directional dependence: it turns out that ignoring the directional dependence negatively affects the clustering performance. As a real application, we applied our model to the breast cancer tumor samples collected from The Cancer Genome Altas (TCGA).
△ Less
Submitted 22 August, 2020; v1 submitted 16 March, 2020;
originally announced March 2020.
-
Consistent estimation of the max-flow problem: Towards unsupervised image segmentation
Authors:
Ashif Sikandar Iquebal,
Satish Bukkapatnam
Abstract:
Advances in the image-based diagnostics of complex biological and manufacturing processes have brought unsupervised image segmentation to the forefront of enabling automated, on the fly decision making. However, most existing unsupervised segmentation approaches are either computationally complex or require manual parameter selection (e.g., flow capacities in max-flow/min-cut segmentation). In thi…
▽ More
Advances in the image-based diagnostics of complex biological and manufacturing processes have brought unsupervised image segmentation to the forefront of enabling automated, on the fly decision making. However, most existing unsupervised segmentation approaches are either computationally complex or require manual parameter selection (e.g., flow capacities in max-flow/min-cut segmentation). In this work, we present a fully unsupervised segmentation approach using a continuous max-flow formulation over the image domain while optimally estimating the flow parameters from the image characteristics. More specifically, we show that the maximum a posteriori estimate of the image labels can be formulated as a continuous max-flow problem given the flow capacities are known. The flow capacities are then iteratively obtained by employing a novel Markov random field prior over the image domain. We present theoretical results to establish the posterior consistency of the flow capacities. We compare the performance of our approach on two real-world case studies including brain tumor image segmentation and defect identification in additively manufactured components using electron microscopic images. Comparative results with several state-of-the-art supervised as well as unsupervised methods suggest that the present method performs statistically similar to the supervised methods, but results in more than 90% improvement in the Dice score when compared to the state-of-the-art unsupervised methods.
△ Less
Submitted 29 June, 2019; v1 submitted 1 November, 2018;
originally announced November 2018.
-
Change detection in complex dynamical systems using intrinsic phase and amplitude synchronization
Authors:
Ashif Sikandar Iquebal,
Satish Bukkapatnam,
Arun Srinivasa
Abstract:
We present an approach for the detection of sharp change points (short-lived and persistent) in nonlinear and nonstationary dynamic systems under high levels of noise by tracking the local phase and amplitude synchronization among the components of a univariate time series signal. The signal components are derived via Intrinsic Time scale Decomposition (ITD)--a nonlinear, non-parametric analysis m…
▽ More
We present an approach for the detection of sharp change points (short-lived and persistent) in nonlinear and nonstationary dynamic systems under high levels of noise by tracking the local phase and amplitude synchronization among the components of a univariate time series signal. The signal components are derived via Intrinsic Time scale Decomposition (ITD)--a nonlinear, non-parametric analysis method. We show that the signatures of sharp change points are retained across multiple ITD components with a significantly higher probability as compared to random signal fluctuations. Theoretical results are presented to show that combining the change point information retained across a specific set of ITD components offers the possibility of detecting sharp transitions with high specificity and sensitivity. Subsequently, we introduce a concept of mutual agreement to identify the set of ITD components that are most likely to capture the information about dynamical changes of interest and define an InSync statistic to capture this local information. Extensive numerical, as well as real-world case studies involving benchmark neurophysiological processes and industrial machine sensor data, suggest that the present method can detect sharp change points, on an average 62% earlier (in terms of average run length) as compared to other contemporary methods tested.
△ Less
Submitted 1 August, 2020; v1 submitted 3 January, 2017;
originally announced January 2017.
-
Surface plastic flow in polishing of rough surfaces
Authors:
Ashif S. Iquebal,
Dinakar Sagapuram,
Satish Bukkapatnam
Abstract:
We report electron microscopy observations of the surface plastic flow in polishing of rough metal surfaces with a controlled spherical asperity structure. We show that asperity--abrasive sliding contacts exhibit viscous behavior, where the material flows in the form of thin fluid-like layers. Subsequent bridging of these layers among neighboring asperities result in progressive surface smoothenin…
▽ More
We report electron microscopy observations of the surface plastic flow in polishing of rough metal surfaces with a controlled spherical asperity structure. We show that asperity--abrasive sliding contacts exhibit viscous behavior, where the material flows in the form of thin fluid-like layers. Subsequent bridging of these layers among neighboring asperities result in progressive surface smoothening. Our study provides new phenomenological insights into the long-debated mechanism of polishing. The observations are of broad relevance in tribology and materials processing.
△ Less
Submitted 31 March, 2017; v1 submitted 30 October, 2016;
originally announced October 2016.
