Showing 1–4 of 4 results for author: Churchill, V

Unraveling Consumer Purchase Journey Using Neural Network Models

Authors: Victor Churchill, H. Alice Li, Dongbin Xiu

Abstract: This study utilizes an ensemble of feedforward neural network models to analyze large-volume and high-dimensional consumer touchpoints and their impact on purchase decisions. When applied to a proprietary dataset of consumer touchpoints and purchases from a global software service provider, the proposed approach demonstrates better predictive accuracy than both traditional models, such as logistic… ▽ More This study utilizes an ensemble of feedforward neural network models to analyze large-volume and high-dimensional consumer touchpoints and their impact on purchase decisions. When applied to a proprietary dataset of consumer touchpoints and purchases from a global software service provider, the proposed approach demonstrates better predictive accuracy than both traditional models, such as logistic regression, naive Bayes, and k-nearest neighbors, as well as ensemble tree-based classifiers, such as bagging, random forest, AdaBoost, and gradient boosting. By calculating the Shapley values within this network, we provide nuanced insights into touchpoint effectiveness, as we not only assess the marginal impact of diverse touchpoint types but also offer a granular view of the impact distribution within a touchpoint type. Additionally, our model shows excellent adaptability and resilience with limited data resources. When the historical data is reduced from 40 to 1 month, our model shows only a modest 19% decrease in accuracy. This modeling framework can enable managers to more accurately and comprehensively evaluate consumer touchpoints, thereby enhancing the effectiveness and efficiency of their marketing campaigns. △ Less

Submitted 10 April, 2024; originally announced April 2024.

Flow Map Learning for Unknown Dynamical Systems: Overview, Implementation, and Benchmarks

Authors: Victor Churchill, Dongbin Xiu

Abstract: Flow map learning (FML), in conjunction with deep neural networks (DNNs), has shown promises for data driven modeling of unknown dynamical systems. A remarkable feature of FML is that it is capable of producing accurate predictive models for partially observed systems, even when their exact mathematical models do not exist. In this paper, we present an overview of the FML framework, along with the… ▽ More Flow map learning (FML), in conjunction with deep neural networks (DNNs), has shown promises for data driven modeling of unknown dynamical systems. A remarkable feature of FML is that it is capable of producing accurate predictive models for partially observed systems, even when their exact mathematical models do not exist. In this paper, we present an overview of the FML framework, along with the important computational details for its successful implementation. We also present a set of well defined benchmark problems for learning unknown dynamical systems. All the numerical details of these problems are presented, along with their FML results, to ensure that the problems are accessible for cross-examination and the results are reproducible. △ Less

Submitted 20 July, 2023; originally announced July 2023.

Robust Modeling of Unknown Dynamical Systems via Ensemble Averaged Learning

Authors: Victor Churchill, Steve Manns, Zhen Chen, Dongbin Xiu

Abstract: Recent work has focused on data-driven learning of the evolution of unknown systems via deep neural networks (DNNs), with the goal of conducting long time prediction of the evolution of the unknown system. Training a DNN with low generalization error is a particularly important task in this case as error is accumulated over time. Because of the inherent randomness in DNN training, chiefly in stoch… ▽ More Recent work has focused on data-driven learning of the evolution of unknown systems via deep neural networks (DNNs), with the goal of conducting long time prediction of the evolution of the unknown system. Training a DNN with low generalization error is a particularly important task in this case as error is accumulated over time. Because of the inherent randomness in DNN training, chiefly in stochastic optimization, there is uncertainty in the resulting prediction, and therefore in the generalization error. Hence, the generalization error can be viewed as a random variable with some probability distribution. Well-trained DNNs, particularly those with many hyperparameters, typically result in probability distributions for generalization error with low bias but high variance. High variance causes variability and unpredictably in the results of a trained DNN. This paper presents a computational technique which decreases the variance of the generalization error, thereby improving the reliability of the DNN model to generalize consistently. In the proposed ensemble averaging method, multiple models are independently trained and model predictions are averaged at each time step. A mathematical foundation for the method is presented, including results regarding the distribution of the local truncation error. In addition, three time-dependent differential equation problems are considered as numerical examples, demonstrating the effectiveness of the method to decrease variance of DNN predictions generally. △ Less

Submitted 7 March, 2022; originally announced March 2022.

Synthetic Aperture Radar Image Formation with Uncertainty Quantification

Authors: Victor Churchill, Anne Gelb

Abstract: Synthetic aperture radar (SAR) is a day or night any-weather imaging modality that is an important tool in remote sensing. Most existing SAR image formation methods result in a maximum a posteriori image which approximates the reflectivity of an unknown ground scene. This single image provides no quantification of the certainty with which the features in the estimate should be trusted. In addition… ▽ More Synthetic aperture radar (SAR) is a day or night any-weather imaging modality that is an important tool in remote sensing. Most existing SAR image formation methods result in a maximum a posteriori image which approximates the reflectivity of an unknown ground scene. This single image provides no quantification of the certainty with which the features in the estimate should be trusted. In addition, finding the mode is generally not the best way to interrogate a posterior. This paper addresses these issues by introducing a sampling framework to SAR image formation. A hierarchical Bayesian model is constructed using conjugate priors that directly incorporate coherent imaging and the problematic speckle phenomenon which is known to degrade image quality. Samples of the resulting posterior as well as parameters governing speckle and noise are obtained using a Gibbs sampler. These samples may then be used to compute estimates, and also to derive other statistics like variance which aid in uncertainty quantification. The latter information is particularly important in SAR, where ground truth images even for synthetically-created examples are typically unknown. An example result using real-world data shows that the sampling-based approach introduced here to SAR image formation provides parameter-free estimates with improved contrast and significantly reduced speckle, as well as unprecedented uncertainty quantification information. △ Less

Submitted 13 July, 2020; originally announced July 2020.