-
Probabilistic Multi-product Trading in Sequential Intraday and Frequency-Regulation Markets
Authors:
Saeed Nordin,
Abolfazl Khodadadi,
Priyanka Shinde,
Evelin Blom,
Mohammad Reza Hesamzadeh,
Lennart Söder
Abstract:
With the increasing integration of power plants into the frequency-regulation markets, the importance of optimal trading has grown substantially. This paper conducts an in-depth analysis of their optimal trading behavior in sequential day-ahead, intraday, and frequency-regulation markets. We introduce a probabilistic multi-product optimization model, derived through a series of transformation tech…
▽ More
With the increasing integration of power plants into the frequency-regulation markets, the importance of optimal trading has grown substantially. This paper conducts an in-depth analysis of their optimal trading behavior in sequential day-ahead, intraday, and frequency-regulation markets. We introduce a probabilistic multi-product optimization model, derived through a series of transformation techniques. Additionally, we present two reformulations that re-frame the problem as a mixed-integer linear programming problem with uncertain parameters. Various aspects of the model are thoroughly examined to observe the optimal multi-product trading behavior of hydro power plant assets, along with numerous case studies. Leveraging historical data from Nordic electricity markets, we construct realistic scenarios for the uncertain parameters. Furthermore, we then proposed an algorithm based on the No-U-Turn sampler to provide probability distribution functions of cleared prices in frequency-regulation and day-ahead markets. These distribution functions offer valuable statistical insights into temporal price risks for informed multi-product optimal-trading decisions.
△ Less
Submitted 26 October, 2023;
originally announced October 2023.
-
A Natural Language Processing and Deep Learning based Model for Automated Vehicle Diagnostics using Free-Text Customer Service Reports
Authors:
Ali Khodadadi,
Soroush Ghandiparsi,
Chen-Nee Chuah
Abstract:
Initial fault detection and diagnostics are imperative measures to improve the efficiency, safety, and stability of vehicle operation. In recent years, numerous studies have investigated data-driven approaches to improve the vehicle diagnostics process using available vehicle data. Moreover, data-driven methods are employed to enhance customer-service agent interactions. In this study, we demonstr…
▽ More
Initial fault detection and diagnostics are imperative measures to improve the efficiency, safety, and stability of vehicle operation. In recent years, numerous studies have investigated data-driven approaches to improve the vehicle diagnostics process using available vehicle data. Moreover, data-driven methods are employed to enhance customer-service agent interactions. In this study, we demonstrate a machine learning pipeline to improve automated vehicle diagnostics. First, Natural Language Processing (NLP) is used to automate the extraction of crucial information from free-text failure reports (generated during customers' calls to the service department). Then, deep learning algorithms are employed to validate service requests and filter vague or misleading claims. Ultimately, different classification algorithms are implemented to classify service requests so that valid service requests can be directed to the relevant service department. The proposed model- Bidirectional Long Short Term Memory (BiLSTM) along with Convolution Neural Network (CNN)- shows more than 18\% accuracy improvement in validating service requests compared to technicians' capabilities. In addition, using domain-based NLP techniques at preprocessing and feature extraction stages along with CNN-BiLSTM based request validation enhanced the accuracy ($>25\%$), sensitivity ($>39\%$), specificity ($>11\%$), and precision ($>11\%$) of Gradient Tree Boosting (GTB) service classification model. The Receiver Operating Characteristic Area Under the Curve (ROC-AUC) reached 0.82.
△ Less
Submitted 29 November, 2021;
originally announced November 2021.
-
Pólya-Knopp and Hardy-Knopp type inequalities for Sugeno integral
Authors:
B. Daraby,
F. Rostampour,
A. R. Khodadadi,
A. Rahimi,
R. Mesiar
Abstract:
In this paper, we investigate the Pólya-Knopp type inequality for Sugeno integrals in two cases. In the first case, we suppose that the inner integral is the standard Riemann integral and the remaining two integrals are of Sugeno type. In the second case, all involved integrals are Sugeno integral. We present several examples illustrating the validity of our theorems. Finally, we prove a Hardy-Kno…
▽ More
In this paper, we investigate the Pólya-Knopp type inequality for Sugeno integrals in two cases. In the first case, we suppose that the inner integral is the standard Riemann integral and the remaining two integrals are of Sugeno type. In the second case, all involved integrals are Sugeno integral. We present several examples illustrating the validity of our theorems. Finally, we prove a Hardy-Knopp type inequality for Sugeno integral.
△ Less
Submitted 9 October, 2019;
originally announced October 2019.
-
ChOracle: A Unified Statistical Framework for Churn Prediction
Authors:
Ali Khodadadi,
Seyed Abbas Hosseini,
Ehsan Pajouheshgar,
Farnam Mansouri,
Hamid R. Rabiee
Abstract:
User churn is an important issue in online services that threatens the health and profitability of services. Most of the previous works on churn prediction convert the problem into a binary classification task where the users are labeled as churned and non-churned. More recently, some works have tried to convert the user churn prediction problem into the prediction of user return time. In this app…
▽ More
User churn is an important issue in online services that threatens the health and profitability of services. Most of the previous works on churn prediction convert the problem into a binary classification task where the users are labeled as churned and non-churned. More recently, some works have tried to convert the user churn prediction problem into the prediction of user return time. In this approach which is more realistic in real world online services, at each time-step the model predicts the user return time instead of predicting a churn label. However, the previous works in this category suffer from lack of generality and require high computational complexity. In this paper, we introduce \emph{ChOracle}, an oracle that predicts the user churn by modeling the user return times to service by utilizing a combination of Temporal Point Processes and Recurrent Neural Networks. Moreover, we incorporate latent variables into the proposed recurrent neural network to model the latent user loyalty to the system. We also develop an efficient approximate variational algorithm for learning parameters of the proposed RNN by using back propagation through time. Finally, we demonstrate the superior performance of ChOracle on a wide variety of real world datasets.
△ Less
Submitted 15 September, 2019;
originally announced September 2019.
-
Fast Context-Annotated Classification of Different Types of Web Service Descriptions
Authors:
Serguei A. Mokhov,
Joey Paquet,
Arash Khodadadi
Abstract:
In the recent rapid growth of web services, IoT, and cloud computing, many web services and APIs appeared on the web. With the failure of global UDDI registries, different service repositories started to appear, trying to list and categorize various types of web services for client applications' discover and use. In order to increase the effectiveness and speed up the task of finding compatible We…
▽ More
In the recent rapid growth of web services, IoT, and cloud computing, many web services and APIs appeared on the web. With the failure of global UDDI registries, different service repositories started to appear, trying to list and categorize various types of web services for client applications' discover and use. In order to increase the effectiveness and speed up the task of finding compatible Web Services in the brokerage when performing service composition or suggesting Web Services to the requests, high-level functionality of the service needs to be determined. Due to the lack of structured support for specifying such functionality, classification of services into a set of abstract categories is necessary. We employ a wide range of Machine Learning and Signal Processing algorithms and techniques in order to find the highest precision achievable in the scope of this article for the fast classification of three type of service descriptions: WSDL, REST, and WADL. In addition, we complement our approach by showing the importance and effect of contextual information on the classification of the service descriptions and show that it improves the accuracy in 5 different categories of services.
△ Less
Submitted 31 May, 2018;
originally announced June 2018.
-
Algorithms for Estimating Trends in Global Temperature Volatility
Authors:
Arash Khodadadi,
Daniel J McDonald
Abstract:
Trends in terrestrial temperature variability are perhaps more relevant for species viability than trends in mean temperature. In this paper, we develop methodology for estimating such trends using multi-resolution climate data from polar orbiting weather satellites. We derive two novel algorithms for computation that are tailored for dense, gridded observations over both space and time. We evalua…
▽ More
Trends in terrestrial temperature variability are perhaps more relevant for species viability than trends in mean temperature. In this paper, we develop methodology for estimating such trends using multi-resolution climate data from polar orbiting weather satellites. We derive two novel algorithms for computation that are tailored for dense, gridded observations over both space and time. We evaluate our methods with a simulation that mimics these data's features and on a large, publicly available, global temperature dataset with the eventual goal of tracking trends in cloud reflectance temperature variability.
△ Less
Submitted 19 January, 2019; v1 submitted 18 May, 2018;
originally announced May 2018.
-
Rotation curves of galaxies and the stellar mass-to-light ratio
Authors:
Hosein Haghi,
Aziz Khodadadi,
Amir Ghari,
Akram Hasani Zonoozi,
Pavel Kroupa
Abstract:
Mass models of a sample of 171 low- and high-surface brightness galaxies are presented in the context of the cold dark matter (CDM) theory using the NFW dark matter halo density distribution to extract a new concentration-viral mass relation ($c-M_{vir}$). The rotation curves (RCs) are calculated from the total baryonic matter based on the 3.6 $μm $-band surface photometry, the observed distributi…
▽ More
Mass models of a sample of 171 low- and high-surface brightness galaxies are presented in the context of the cold dark matter (CDM) theory using the NFW dark matter halo density distribution to extract a new concentration-viral mass relation ($c-M_{vir}$). The rotation curves (RCs) are calculated from the total baryonic matter based on the 3.6 $μm $-band surface photometry, the observed distribution of neutral hydrogen, and the dark halo, in which the three adjustable parameters are the stellar mass-to-light ratio, halo concentration and virial mass. Although accounting for a NFW dark halo profile can explain rotation curve observations, the implied $c-M_{vir}$ relation from RC analysis strongly disagrees with that resulting from different cosmological simulations. Also, the $M/L-$color correlation of the studied galaxies is inconsistent with that expected from stellar population synthesis models with different stellar initial mass functions. Moreover, we show that the best-fitting stellar $M/L-$ ratios of 51 galaxies (30\% of our sample) have unphysically negative values in the framework of the $Λ$CDM theory. This can be interpreted as a serious crisis for this theory. This suggests either that the commonly used NFW halo profile, which is a natural result of $Λ$CDM cosmological structure formation, is not an appropriate profile for the dark halos of galaxies, or, new dark matter physics or alternative gravity models are needed to explain the rotational velocities of disk galaxies.
△ Less
Submitted 5 March, 2018;
originally announced March 2018.
-
The detour problem in a stochastic environment: Tolman revisited
Authors:
Pegah Fakhari,
Arash Khodadadi,
Jerome Busemeyer
Abstract:
We designed a grid world task to study human planning and re-planning behavior in an unknown stochastic environment. In our grid world, participants were asked to travel from a random starting point to a random goal position while maximizing their reward. Because they were not familiar with the environment, they needed to learn its characteristics from experience to plan optimally. Later in the ta…
▽ More
We designed a grid world task to study human planning and re-planning behavior in an unknown stochastic environment. In our grid world, participants were asked to travel from a random starting point to a random goal position while maximizing their reward. Because they were not familiar with the environment, they needed to learn its characteristics from experience to plan optimally. Later in the task, we randomly blocked the optimal path to investigate whether and how people adjust their original plans to find a detour. To this end, we developed and compared 12 different models. These models were different on how they learned and represented the environment and how they planned to catch the goal. The majority of our participants were able to plan optimally. We also showed that people were capable of revising their plans when an unexpected event occurred. The result from the model comparison showed that the model-based reinforcement learning approach provided the best account for the data and outperformed heuristics in explaining the behavioral data in the re-planning trials.
△ Less
Submitted 27 September, 2017;
originally announced September 2017.
-
Recurrent Poisson Factorization for Temporal Recommendation
Authors:
Seyed Abbas Hosseini,
Keivan Alizadeh,
Ali Khodadadi,
Ali Arabzadeh,
Mehrdad Farajtabar,
Hongyuan Zha,
Hamid R. Rabiee
Abstract:
Poisson factorization is a probabilistic model of users and items for recommendation systems, where the so-called implicit consumer data is modeled by a factorized Poisson distribution. There are many variants of Poisson factorization methods who show state-of-the-art performance on real-world recommendation tasks. However, most of them do not explicitly take into account the temporal behavior and…
▽ More
Poisson factorization is a probabilistic model of users and items for recommendation systems, where the so-called implicit consumer data is modeled by a factorized Poisson distribution. There are many variants of Poisson factorization methods who show state-of-the-art performance on real-world recommendation tasks. However, most of them do not explicitly take into account the temporal behavior and the recurrent activities of users which is essential to recommend the right item to the right user at the right time. In this paper, we introduce Recurrent Poisson Factorization (RPF) framework that generalizes the classical PF methods by utilizing a Poisson process for modeling the implicit feedback. RPF treats time as a natural constituent of the model and brings to the table a rich family of time-sensitive factorization models. To elaborate, we instantiate several variants of RPF who are capable of handling dynamic user preferences and item specification (DRPF), modeling the social-aspect of product adoption (SRPF), and capturing the consumption heterogeneity among users and items (HRPF). We also develop a variational algorithm for approximate posterior inference that scales up to massive data sets. Furthermore, we demonstrate RPF's superior performance over many state-of-the-art methods on synthetic dataset, and large scale real-world datasets on music streaming logs, and user-item interactions in M-Commerce platforms.
△ Less
Submitted 4 March, 2017;
originally announced March 2017.
-
Continuous-Time User Modeling in the Presence of Badges: A Probabilistic Approach
Authors:
Ali Khodadadi,
Seyed Abbas Hosseini,
Erfan Tavakoli,
Hamid R. Rabiee
Abstract:
User modeling plays an important role in delivering customized web services to the users and improving their engagement. However, most user models in the literature do not explicitly consider the temporal behavior of users. More recently, continuous-time user modeling has gained considerable attention and many user behavior models have been proposed based on temporal point processes. However, typi…
▽ More
User modeling plays an important role in delivering customized web services to the users and improving their engagement. However, most user models in the literature do not explicitly consider the temporal behavior of users. More recently, continuous-time user modeling has gained considerable attention and many user behavior models have been proposed based on temporal point processes. However, typical point process based models often considered the impact of peer influence and content on the user participation and neglected other factors. Gamification elements, are among those factors that are neglected, while they have a strong impact on user participation in online services. In this paper, we propose interdependent multi-dimensional temporal point processes that capture the impact of badges on user participation besides the peer influence and content factors. We extend the proposed processes to model user actions over the community based question and answering websites, and propose an inference algorithm based on Variational-EM that can efficiently learn the model parameters. Extensive experiments on both synthetic and real data gathered from Stack Overflow show that our inference algorithm learns the parameters efficiently and the proposed method can better predict the user behavior compared to the alternatives.
△ Less
Submitted 7 February, 2017;
originally announced February 2017.
-
HNP3: A Hierarchical Nonparametric Point Process for Modeling Content Diffusion over Social Media
Authors:
Seyed Abbas Hosseini,
Ali Khodadadi,
Soheil Arabzade,
Hamid R. Rabiee
Abstract:
This paper introduces a novel framework for modeling temporal events with complex longitudinal dependency that are generated by dependent sources. This framework takes advantage of multidimensional point processes for modeling time of events. The intensity function of the proposed process is a mixture of intensities, and its complexity grows with the complexity of temporal patterns of data. Moreov…
▽ More
This paper introduces a novel framework for modeling temporal events with complex longitudinal dependency that are generated by dependent sources. This framework takes advantage of multidimensional point processes for modeling time of events. The intensity function of the proposed process is a mixture of intensities, and its complexity grows with the complexity of temporal patterns of data. Moreover, it utilizes a hierarchical dependent nonparametric approach to model marks of events. These capabilities allow the proposed model to adapt its temporal and topical complexity according to the complexity of data, which makes it a suitable candidate for real world scenarios. An online inference algorithm is also proposed that makes the framework applicable to a vast range of applications. The framework is applied to a real world application, modeling the diffusion of contents over networks. Extensive experiments reveal the effectiveness of the proposed framework in comparison with state-of-the-art methods.
△ Less
Submitted 2 October, 2016;
originally announced October 2016.
-
A Neuro-Fuzzy Model of Time-Varying Decision Boundaries
Authors:
Arash Khodadadi,
Pegah Fakhari,
Jerome R Busemeyer
Abstract:
In a recent study, we reported the results of a new decision making paradigm in which the participants were asked to balance between their speed and accuracy to maximize the total reward they achieve during the experiment. The results of computational modeling provided strong evidence suggesting that the participants used time-varying decision boundaries. Previous theoretical studies of the optima…
▽ More
In a recent study, we reported the results of a new decision making paradigm in which the participants were asked to balance between their speed and accuracy to maximize the total reward they achieve during the experiment. The results of computational modeling provided strong evidence suggesting that the participants used time-varying decision boundaries. Previous theoretical studies of the optimal speed-accuracy trade-off suggested that the participants may learn to use these time-varying boundaries to maximize their average reward rate. The results in our experiment, however, showed that the participants used such boundaries even at the beginning of the experiment and without any prior experience in the task. In this paper, we hypothesize that these boundaries are the results of using some heuristic rules to make decisions in the task. To formulate decision making by these heuristic rules as a computational framework, we use the fuzzy logic theory. Based on this theory, we propose a new computational framework for decision making in evidence accumulation tasks. In this framework, there is no explicit decision boundary. Instead, the subject's desire to stop accumulating evidence and responding at each moment within a trial and for a given value of the accumulated evidence, is determined by a set of fuzzy "IF-TEHN rules". We then use the back-propagation method to derive an algorithm for fitting the fuzzy model to each participant's data. We then investigate how the difference in the participants' performance in the experiment is reflected in the difference in the parameters of the fitted model
△ Less
Submitted 25 August, 2016;
originally announced August 2016.
-
Predicting Anchor Links between Heterogeneous Social Networks
Authors:
Sina Sajadmanesh,
Hamid R. Rabiee,
Ali Khodadadi
Abstract:
People usually get involved in multiple social networks to enjoy new services or to fulfill their needs. Many new social networks try to attract users of other existing networks to increase the number of their users. Once a user (called source user) of a social network (called source network) joins a new social network (called target network), a new inter-network link (called anchor link) is forme…
▽ More
People usually get involved in multiple social networks to enjoy new services or to fulfill their needs. Many new social networks try to attract users of other existing networks to increase the number of their users. Once a user (called source user) of a social network (called source network) joins a new social network (called target network), a new inter-network link (called anchor link) is formed between the source and target networks. In this paper, we concentrated on predicting the formation of such anchor links between heterogeneous social networks. Unlike conventional link prediction problems in which the formation of a link between two existing users within a single network is predicted, in anchor link prediction, the target user is missing and will be added to the target network once the anchor link is created. To solve this problem, we use meta-paths as a powerful tool for utilizing heterogeneous information in both the source and target networks. To this end, we propose an effective general meta-path-based approach called Connector and Recursive Meta-Paths (CRMP). By using those two different categories of meta-paths, we model different aspects of social factors that may affect a source user to join the target network, resulting in the formation of a new anchor link. Extensive experiments on real-world heterogeneous social networks demonstrate the effectiveness of the proposed method against the recent methods.
△ Less
Submitted 1 August, 2016; v1 submitted 29 July, 2016;
originally announced July 2016.
-
Learning to Allocate Limited Time to Decisions with Different Expected Outcomes
Authors:
Arash Khodadadi,
Pegah Fakhari,
Jerome R. Busemeyer
Abstract:
The goal of this article is to investigate how human participants allocate their limited time to decisions with different properties. We report the results of two behavioral experiments. In each trial of the experiments, the participant must accumulate noisy information to make a decision. The participants received positive and negative rewards for their correct and incorrect decisions, respective…
▽ More
The goal of this article is to investigate how human participants allocate their limited time to decisions with different properties. We report the results of two behavioral experiments. In each trial of the experiments, the participant must accumulate noisy information to make a decision. The participants received positive and negative rewards for their correct and incorrect decisions, respectively. The stimulus was designed such that decisions based on more accumulated information were more accurate but took longer. Therefore, the total outcome that a participant could achieve during the limited experiments' time depended on her "decision threshold", the amount of information she needed to make a decision. In the first experiment, two types of trials were intermixed randomly: hard and easy. Crucially, the hard trials were associated with smaller positive and negative rewards than the easy trials. A cue presented at the beginning of each trial would indicate the type of the upcoming trial. The optimal strategy was to adopt a small decision threshold for hard trials. The results showed that several of the participants did not learn this simple strategy. We then investigated how the participants adjusted their decision threshold based on the feedback they received in each trial. To this end, we developed and compared 10 computational models for adjusting the decision threshold. The models differ in their assumptions on the shape of the decision thresholds and the way the feedback is used to adjust the decision thresholds. The results of Bayesian model comparison showed that a model with time-varying thresholds whose parameters are updated by a reinforcement learning algorithm is the most likely model.
△ Less
Submitted 18 July, 2016;
originally announced July 2016.
-
Bayesian Overlap** Community Detection in Dynamic Networks
Authors:
Mahsa Ghorbani,
Hamid R. Rabiee,
Ali Khodadadi
Abstract:
Detecting community structures in social networks has gained considerable attention in recent years. However, lack of prior knowledge about the number of communities, and their overlap** nature have made community detection a challenging problem. Moreover, many of the existing methods only consider static networks, while most of real world networks are dynamic and evolve over time. Hence, findin…
▽ More
Detecting community structures in social networks has gained considerable attention in recent years. However, lack of prior knowledge about the number of communities, and their overlap** nature have made community detection a challenging problem. Moreover, many of the existing methods only consider static networks, while most of real world networks are dynamic and evolve over time. Hence, finding consistent overlap** communities in dynamic networks without any prior knowledge about the number of communities is still an interesting open research problem. In this paper, we present an overlap** community detection method for dynamic networks called Dynamic Bayesian Overlap** Community Detector (DBOCD). DBOCD assumes that in every snapshot of network, overlap** parts of communities are dense areas and utilizes link communities instead of common node communities. Using Recurrent Chinese Restaurant Process and community structure of the network in the last snapshot, DBOCD simultaneously extracts the number of communities and soft community memberships of nodes while maintaining the consistency of communities over time. We evaluated DBOCD on both synthetic and real dynamic data-sets to assess its ability to find overlap** communities in different types of network evolution. The results show that DBOCD outperforms the recent state of the art dynamic community detection methods.
△ Less
Submitted 8 May, 2016;
originally announced May 2016.
-
Correlated Cascades: Compete or Cooperate
Authors:
Ali Zarezade,
Ali Khodadadi,
Mehrdad Farajtabar,
Hamid R. Rabiee,
Hongyuan Zha
Abstract:
In real world social networks, there are multiple cascades which are rarely independent. They usually compete or cooperate with each other. Motivated by the reinforcement theory in sociology we leverage the fact that adoption of a user to any behavior is modeled by the aggregation of behaviors of its neighbors. We use a multidimensional marked Hawkes process to model users product adoption and con…
▽ More
In real world social networks, there are multiple cascades which are rarely independent. They usually compete or cooperate with each other. Motivated by the reinforcement theory in sociology we leverage the fact that adoption of a user to any behavior is modeled by the aggregation of behaviors of its neighbors. We use a multidimensional marked Hawkes process to model users product adoption and consequently spread of cascades in social networks. The resulting inference problem is proved to be convex and is solved in parallel by using the barrier method. The advantage of the proposed model is twofold; it models correlated cascades and also learns the latent diffusion network. Experimental results on synthetic and two real datasets gathered from Twitter, URL shortening and music streaming services, illustrate the superior performance of the proposed model over the alternatives.
△ Less
Submitted 22 November, 2016; v1 submitted 4 October, 2015;
originally announced October 2015.
