-
Time Series Anomaly Detection with label-free Model Selection
Authors:
Deokwoo Jung,
Nandini Ramanan,
Mehrnaz Amjadi,
Sankeerth Rao Karingula,
Jake Taylor,
Claudionor Nunes Coelho Jr
Abstract:
Anomaly detection for time-series data becomes an essential task for many data-driven applications fueled with an abundance of data and out-of-the-box machine-learning algorithms. In many real-world settings, develo** a reliable anomaly model is highly challenging due to insufficient anomaly labels and the prohibitively expensive cost of obtaining anomaly examples. It imposes a significant bottl…
▽ More
Anomaly detection for time-series data becomes an essential task for many data-driven applications fueled with an abundance of data and out-of-the-box machine-learning algorithms. In many real-world settings, develo** a reliable anomaly model is highly challenging due to insufficient anomaly labels and the prohibitively expensive cost of obtaining anomaly examples. It imposes a significant bottleneck to evaluate model quality for model selection and parameter tuning reliably. As a result, many existing anomaly detection algorithms fail to show their promised performance after deployment.
In this paper, we propose LaF-AD, a novel anomaly detection algorithm with label-free model selection for unlabeled times-series data. Our proposed algorithm performs a fully unsupervised ensemble learning across a large number of candidate parametric models. We develop a model variance metric that quantifies the sensitivity of anomaly probability with a bootstrap** method. Then it makes a collective decision for anomaly events by model learners using the model variance. Our algorithm is easily parallelizable, more robust for ill-conditioned and seasonal data, and highly scalable for a large number of anomaly models. We evaluate our algorithm against other state-of-the-art methods on a synthetic domain and a benchmark public data set.
△ Less
Submitted 10 June, 2021;
originally announced June 2021.
-
Boosted Embeddings for Time Series Forecasting
Authors:
Sankeerth Rao Karingula,
Nandini Ramanan,
Rasool Tahmasbi,
Mehrnaz Amjadi,
Deokwoo Jung,
Ricky Si,
Charanraj Thimmisetty,
Luisa Polania Cabrera,
Marjorie Sayer,
Claudionor Nunes Coelho Jr
Abstract:
Time series forecasting is a fundamental task emerging from diverse data-driven applications. Many advanced autoregressive methods such as ARIMA were used to develop forecasting models. Recently, deep learning based methods such as DeepAr, NeuralProphet, Seq2Seq have been explored for time series forecasting problem. In this paper, we propose a novel time series forecast model, DeepGB. We formulat…
▽ More
Time series forecasting is a fundamental task emerging from diverse data-driven applications. Many advanced autoregressive methods such as ARIMA were used to develop forecasting models. Recently, deep learning based methods such as DeepAr, NeuralProphet, Seq2Seq have been explored for time series forecasting problem. In this paper, we propose a novel time series forecast model, DeepGB. We formulate and implement a variant of Gradient boosting wherein the weak learners are DNNs whose weights are incrementally found in a greedy manner over iterations. In particular, we develop a new embedding architecture that improves the performance of many deep learning models on time series using Gradient boosting variant. We demonstrate that our model outperforms existing comparable state-of-the-art models using real-world sensor data and public dataset.
△ Less
Submitted 11 July, 2021; v1 submitted 10 April, 2021;
originally announced April 2021.
-
KATRec: Knowledge Aware aTtentive Sequential Recommendations
Authors:
Mehrnaz Amjadi,
Seyed Danial Mohseni Taheri,
Theja Tulabandhula
Abstract:
Sequential recommendation systems model dynamic preferences of users based on their historical interactions with platforms. Despite recent progress, modeling short-term and long-term behavior of users in such systems is nontrivial and challenging. To address this, we present a solution enhanced by a knowledge graph called KATRec (Knowledge Aware aTtentive sequential Recommendations). KATRec learns…
▽ More
Sequential recommendation systems model dynamic preferences of users based on their historical interactions with platforms. Despite recent progress, modeling short-term and long-term behavior of users in such systems is nontrivial and challenging. To address this, we present a solution enhanced by a knowledge graph called KATRec (Knowledge Aware aTtentive sequential Recommendations). KATRec learns the short and long-term interests of users by modeling their sequence of interacted items and leveraging pre-existing side information through a knowledge graph attention network. Our novel knowledge graph-enhanced sequential recommender contains item multi-relations at the entity-level and users' dynamic sequences at the item-level. KATRec improves item representation learning by considering higher-order connections and incorporating them in user preference representation while recommending the next item. Experiments on three public datasets show that KATRec outperforms state-of-the-art recommendation models and demonstrates the importance of modeling both temporal and side information to achieve high-quality recommendations.
△ Less
Submitted 5 July, 2021; v1 submitted 6 December, 2020;
originally announced December 2020.
-
Block-Structure Based Time-Series Models For Graph Sequences
Authors:
Mehrnaz Amjadi,
Theja Tulabandhula
Abstract:
Although the computational and statistical trade-off for modeling single graphs, for instance, using block models is relatively well understood, extending such results to sequences of graphs has proven to be difficult. In this work, we take a step in this direction by proposing two models for graph sequences that capture: (a) link persistence between nodes across time, and (b) community persistenc…
▽ More
Although the computational and statistical trade-off for modeling single graphs, for instance, using block models is relatively well understood, extending such results to sequences of graphs has proven to be difficult. In this work, we take a step in this direction by proposing two models for graph sequences that capture: (a) link persistence between nodes across time, and (b) community persistence of each node across time. In the first model, we assume that the latent community of each node does not change over time, and in the second model we relax this assumption suitably. For both of these proposed models, we provide statistically and computationally efficient inference algorithms, whose unique feature is that they leverage community detection methods that work on single graphs. We also provide experimental results validating the suitability of our models and methods on synthetic and real instances.
△ Less
Submitted 18 September, 2018; v1 submitted 23 April, 2018;
originally announced April 2018.
-
Development of a high quality thin diamond membrane with embedded nitrogen-vacancy centers for hybrid spin-mechanical quantum systems
Authors:
S. Ali Momenzadeh,
Felipe Fávaro de Oliveira,
Philipp Neumann,
D. D. Bhaktavatsala Rao,
Andrej Denisenko,
Morteza Amjadi,
Sen Yang,
Neil B. Manson,
Marcus W. Doherty,
Jörg Wrachtrup
Abstract:
Hybrid quantum systems (HQSs) have attracted several research interests in the last years. In this Letter, we report on the design, fabrication, and characterization of a novel diamond architecture for HQSs that consists of a high quality thin circular diamond membrane with embedded near-surface nitrogen-vacancy centers (NVCs). To demonstrate this architecture, we employed the NVCs by means of the…
▽ More
Hybrid quantum systems (HQSs) have attracted several research interests in the last years. In this Letter, we report on the design, fabrication, and characterization of a novel diamond architecture for HQSs that consists of a high quality thin circular diamond membrane with embedded near-surface nitrogen-vacancy centers (NVCs). To demonstrate this architecture, we employed the NVCs by means of their optical and spin interfaces as nanosensors of the motion of the membrane under static pressure and in-resonance vibration, as well as the residual stress of the membrane. Driving the membrane at its fundamental resonance mode, we observed coupling of this vibrational mode to the spin of the NVCs by Hahn echo signal. Our realization of this architecture will enable futuristic HQS-based applications in diamond piezometry and vibrometry, as well as spin-mechanical and mechanically mediated spin-spin coupling in quantum information science.
△ Less
Submitted 26 February, 2016;
originally announced February 2016.
