-
Tiny Graph Neural Networks for Radio Resource Management
Authors:
Ahmad Ghasemi,
Hossein Pishro-Nik
Abstract:
The surge in demand for efficient radio resource management has necessitated the development of sophisticated yet compact neural network architectures. In this paper, we introduce a novel approach to Graph Neural Networks (GNNs) tailored for radio resource management by presenting a new architecture: the Low Rank Message Passing Graph Neural Network (LR-MPGNN). The cornerstone of LR-MPGNN is the i…
▽ More
The surge in demand for efficient radio resource management has necessitated the development of sophisticated yet compact neural network architectures. In this paper, we introduce a novel approach to Graph Neural Networks (GNNs) tailored for radio resource management by presenting a new architecture: the Low Rank Message Passing Graph Neural Network (LR-MPGNN). The cornerstone of LR-MPGNN is the implementation of a low-rank approximation technique that substitutes the conventional linear layers with their low-rank counterparts. This innovative design significantly reduces the model size and the number of parameters. We evaluate the performance of the proposed LR-MPGNN model based on several key metrics: model size, number of parameters, weighted sum rate of the communication system, and the distribution of eigenvalues of weight matrices. Our extensive evaluations demonstrate that the LR-MPGNN model achieves a sixtyfold decrease in model size, and the number of model parameters can be reduced by up to 98%. Performance-wise, the LR-MPGNN demonstrates robustness with a marginal 2% reduction in the best-case scenario in the normalized weighted sum rate compared to the original MPGNN model. Additionally, the distribution of eigenvalues of the weight matrices in the LR-MPGNN model is more uniform and spans a wider range, suggesting a strategic redistribution of weights.
△ Less
Submitted 28 March, 2024;
originally announced March 2024.
-
Adversarial Attacks on Graph Neural Networks based Spatial Resource Management in P2P Wireless Communications
Authors:
Ahmad Ghasemi,
Ehsan Zeraatkar,
Majid Moradikia,
Seyed,
Zekavat
Abstract:
This paper introduces adversarial attacks targeting a Graph Neural Network (GNN) based radio resource management system in point to point (P2P) communications. Our focus lies on perturbing the trained GNN model during the test phase, specifically targeting its vertices and edges. To achieve this, four distinct adversarial attacks are proposed, each accounting for different constraints, and aiming…
▽ More
This paper introduces adversarial attacks targeting a Graph Neural Network (GNN) based radio resource management system in point to point (P2P) communications. Our focus lies on perturbing the trained GNN model during the test phase, specifically targeting its vertices and edges. To achieve this, four distinct adversarial attacks are proposed, each accounting for different constraints, and aiming to manipulate the behavior of the system. The proposed adversarial attacks are formulated as optimization problems, aiming to minimize the system's communication quality. The efficacy of these attacks is investigated against the number of users, signal-to-noise ratio (SNR), and adversary power budget. Furthermore, we address the detection of such attacks from the perspective of the Central Processing Unit (CPU) of the system. To this end, we formulate an optimization problem that involves analyzing the distribution of channel eigenvalues before and after the attacks are applied. This formulation results in a Min-Max optimization problem, allowing us to detect the presence of attacks. Through extensive simulations, we observe that in the absence of adversarial attacks, the eigenvalues conform to Johnson's SU distribution. However, the attacks significantly alter the characteristics of the eigenvalue distribution, and in the most effective attack, they even change the type of the eigenvalue distribution.
△ Less
Submitted 13 December, 2023;
originally announced December 2023.
-
Combating Uncertainties in Wind and Distributed PV Energy Sources Using Integrated Reinforcement Learning and Time-Series Forecasting
Authors:
Arman Ghasemi,
Amin Shojaeighadikolaei,
Morteza Hashemi
Abstract:
Renewable energy sources, such as wind and solar power, are increasingly being integrated into smart grid systems. However, when compared to traditional energy resources, the unpredictability of renewable energy generation poses significant challenges for both electricity providers and utility companies. Furthermore, the large-scale integration of distributed energy resources (such as PV systems)…
▽ More
Renewable energy sources, such as wind and solar power, are increasingly being integrated into smart grid systems. However, when compared to traditional energy resources, the unpredictability of renewable energy generation poses significant challenges for both electricity providers and utility companies. Furthermore, the large-scale integration of distributed energy resources (such as PV systems) creates new challenges for energy management in microgrids. To tackle these issues, we propose a novel framework with two objectives: (i) combating uncertainty of renewable energy in smart grid by leveraging time-series forecasting with Long-Short Term Memory (LSTM) solutions, and (ii) establishing distributed and dynamic decision-making framework with multi-agent reinforcement learning using Deep Deterministic Policy Gradient (DDPG) algorithm. The proposed framework considers both objectives concurrently to fully integrate them, while considering both wholesale and retail markets, thereby enabling efficient energy management in the presence of uncertain and distributed renewable energy sources. Through extensive numerical simulations, we demonstrate that the proposed solution significantly improves the profit of load serving entities (LSE) by providing a more accurate wind generation forecast. Furthermore, our results demonstrate that households with PV and battery installations can increase their profits by using intelligent battery charge/discharge actions determined by the DDPG agents.
△ Less
Submitted 27 February, 2023;
originally announced February 2023.
-
Distributed Energy Management and Demand Response in Smart Grids: A Multi-Agent Deep Reinforcement Learning Framework
Authors:
Amin Shojaeighadikolaei,
Arman Ghasemi,
Kailani Jones,
Yousif Dafalla,
Alexandru G. Bardas,
Reza Ahmadi,
Morteza Haashemi
Abstract:
This paper presents a multi-agent Deep Reinforcement Learning (DRL) framework for autonomous control and integration of renewable energy resources into smart power grid systems. In particular, the proposed framework jointly considers demand response (DR) and distributed energy management (DEM) for residential end-users. DR has a widely recognized potential for improving power grid stability and re…
▽ More
This paper presents a multi-agent Deep Reinforcement Learning (DRL) framework for autonomous control and integration of renewable energy resources into smart power grid systems. In particular, the proposed framework jointly considers demand response (DR) and distributed energy management (DEM) for residential end-users. DR has a widely recognized potential for improving power grid stability and reliability, while at the same time reducing end-users energy bills. However, the conventional DR techniques come with several shortcomings, such as the inability to handle operational uncertainties while incurring end-user disutility, which prevents widespread adoption in real-world applications. The proposed framework addresses these shortcomings by implementing DR and DEM based on real-time pricing strategy that is achieved using deep reinforcement learning. Furthermore, this framework enables the power grid service provider to leverage distributed energy resources (i.e., PV rooftop panels and battery storage) as dispatchable assets to support the smart grid during peak hours, thus achieving management of distributed energy resources. Simulation results based on the Deep Q-Network (DQN) demonstrate significant improvements of the 24-hour accumulative profit for both prosumers and the power grid service provider, as well as major reductions in the utilization of the power grid reserve generators.
△ Less
Submitted 28 November, 2022;
originally announced November 2022.
-
A Combined Model for Noise Reduction of Lung Sound Signals Based on Empirical Mode Decomposition and Artificial Neural Network
Authors:
Mozhde Firoozi Pouyani,
Mansour Vali,
Mohammad Amin Ghasemi
Abstract:
Computer analysis of Lung Sound (LS) signals has been proposed in recent years as a tool to analyze the lungs' status but there have always been main challenges, including the contamination of LS with environmental noises, which come from different sources of unlike intensities. One of the common methods in noise reduction of LS signals is based on thresholding on Discrete Wavelet Transform (DWT)…
▽ More
Computer analysis of Lung Sound (LS) signals has been proposed in recent years as a tool to analyze the lungs' status but there have always been main challenges, including the contamination of LS with environmental noises, which come from different sources of unlike intensities. One of the common methods in noise reduction of LS signals is based on thresholding on Discrete Wavelet Transform (DWT) coefficients or Empirical Mode Decomposition (EMD) of the signal, however, in these methods, it is necessary to calculate the SNR value to determine the appropriate threshold for noise removal. To solve this problem, a combined model based on EMD and Artificial Neural Network (ANN) trained with different SNRs (0, 5, 10, 15, and 20dB) is proposed in this research. The model can denoise white and pink noises in the range of -2 to 20dB without thresholding or even estimating SNR, and at the same time, keep the main content of the LS signal well. The proposed method is also compared with the EMD-custom method, and the results obtained from the SNR, and fit criteria indicate the absolute superiority of the proposed method. For example, at SNR = 0dB, the combined method can improve the SNR by 9.41 and 8.23dB for white and pink noises, respectively, while the corresponding values are respectively 5.89 and 4.31dB for the EMD-Custom method.
△ Less
Submitted 20 September, 2022;
originally announced September 2022.
-
A Comprehensive Survey of Spectrum Sharing Schemes from a Standardization and Implementation Perspective
Authors:
Mohammad Parvini,
Amir Hossein Zarif,
Ali Nouruzi,
Nader Mokari,
Mohammad Reza Javan,
Bijan Abbasi,
Amir Ghasemi,
Halim Yanikomeroglu
Abstract:
As the services and requirements of next-generation wireless networks become increasingly diversified, it is estimated that the current frequency bands of mobile network operators (MNOs) will be unable to cope with the immensity of anticipated demands. Due to spectrum scarcity, there has been a growing trend among stakeholders toward identifying practical solutions to make the most productive use…
▽ More
As the services and requirements of next-generation wireless networks become increasingly diversified, it is estimated that the current frequency bands of mobile network operators (MNOs) will be unable to cope with the immensity of anticipated demands. Due to spectrum scarcity, there has been a growing trend among stakeholders toward identifying practical solutions to make the most productive use of the exclusively allocated bands on a shared basis through spectrum sharing mechanisms. However, due to the technical complexities of these mechanisms, their design presents challenges, as it requires coordination among multiple entities. To address this challenge, in this paper, we begin with a detailed review of the recent literature on spectrum sharing methods, classifying them on the basis of their operational frequency regime that is, whether they are implemented to operate in licensed bands (e.g., licensed shared access (LSA), spectrum access system (SAS), and dynamic spectrum sharing (DSS)) or unlicensed bands (e.g., LTE-unlicensed (LTE-U), licensed assisted access (LAA), MulteFire, and new radio-unlicensed (NR-U)). Then, in order to narrow the gap between the standardization and vendor-specific implementations, we provide a detailed review of the potential implementation scenarios and necessary amendments to legacy cellular networks from the perspective of telecom vendors and regulatory bodies. Next, we analyze applications of artificial intelligence (AI) and machine learning (ML) techniques for facilitating spectrum sharing mechanisms and leveraging the full potential of autonomous sharing scenarios. Finally, we conclude the paper by presenting open research challenges, which aim to provide insights into prospective research endeavors.
△ Less
Submitted 21 March, 2022;
originally announced March 2022.
-
A New Method for Features Normalization in Motor Imagery Few-Shot Learning using Resting-State
Authors:
M. Amin. Ghasemi,
Sadjaad Ozgoli,
Ali. M. NasrAbadi
Abstract:
Brain-computer interface (BCI) systems are usually designed specifically for each subject based on motor imagery. Therefore, the usability of these networks has become a significant challenge. The network has to be designed separately for each user, which is time-consuming for the user. Therefore, this study proposes a method by which the calibration time is significantly reduced while the classif…
▽ More
Brain-computer interface (BCI) systems are usually designed specifically for each subject based on motor imagery. Therefore, the usability of these networks has become a significant challenge. The network has to be designed separately for each user, which is time-consuming for the user. Therefore, this study proposes a method by which the calibration time is significantly reduced while the classification accuracy is increased. In this method, we calibrated the features extracted from the motor imagery task by dividing the features extracted from the resting-state into both open-eye and closed-eye modes and the state in which the subject moves his eyes. The best classification accuracy was obtained using the SVM classifier using the resting-state signal in the open eye, which increased by 3.64% to 74.04%. In this paper, we also investigated the effect of recording time of the resting-state signal and the impact of eye state on the classification accuracy.
△ Less
Submitted 17 March, 2021;
originally announced March 2021.
-
A Multi-Agent Deep Reinforcement Learning Approach for a Distributed Energy Marketplace in Smart Grids
Authors:
Arman Ghasemi,
Amin Shojaeighadikolaei,
Kailani Jones,
Morteza Hashemi,
Alexandru G. Bardas,
Reza Ahmadi
Abstract:
This paper presents a Reinforcement Learning (RL) based energy market for a prosumer dominated microgrid. The proposed market model facilitates a real-time and demanddependent dynamic pricing environment, which reduces grid costs and improves the economic benefits for prosumers. Furthermore, this market model enables the grid operator to leverage prosumers storage capacity as a dispatchable asset…
▽ More
This paper presents a Reinforcement Learning (RL) based energy market for a prosumer dominated microgrid. The proposed market model facilitates a real-time and demanddependent dynamic pricing environment, which reduces grid costs and improves the economic benefits for prosumers. Furthermore, this market model enables the grid operator to leverage prosumers storage capacity as a dispatchable asset for grid support applications. Simulation results based on the Deep QNetwork (DQN) framework demonstrate significant improvements of the 24-hour accumulative profit for both prosumers and the grid operator, as well as major reductions in grid reserve power utilization.
△ Less
Submitted 22 September, 2020;
originally announced September 2020.
-
Demand Responsive Dynamic Pricing Framework for Prosumer Dominated Microgrids using Multiagent Reinforcement Learning
Authors:
Amin Shojaeighadikolaei,
Arman Ghasemi,
Kailani R. Jones,
Alexandru G. Bardas,
Morteza Hashemi,
Reza Ahmadi
Abstract:
Demand Response (DR) has a widely recognized potential for improving grid stability and reliability while reducing customers energy bills. However, the conventional DR techniques come with several shortcomings, such as inability to handle operational uncertainties and incurring customer disutility, impeding their wide spread adoption in real-world applications. This paper proposes a new multiagent…
▽ More
Demand Response (DR) has a widely recognized potential for improving grid stability and reliability while reducing customers energy bills. However, the conventional DR techniques come with several shortcomings, such as inability to handle operational uncertainties and incurring customer disutility, impeding their wide spread adoption in real-world applications. This paper proposes a new multiagent Reinforcement Learning (RL) based decision-making environment for implementing a Real-Time Pricing (RTP) DR technique in a prosumer dominated microgrid. The proposed technique addresses several shortcomings common to traditional DR methods and provides significant economic benefits to the grid operator and prosumers. To show its better efficacy, the proposed DR method is compared to a baseline traditional operation scenario in a small-scale microgrid system. Finally, investigations on the use of prosumers energy storage capacity in this microgrid highlight the advantages of the proposed method in establishing a balanced market setup.
△ Less
Submitted 22 September, 2020;
originally announced September 2020.
-
Modulation of Control Authority in Adaptive HapticShared Control Paradigms
Authors:
Vahid Izadi,
Amir H. Ghasemi
Abstract:
This paper presents an adaptive haptic shared control framework wherein a driver and an automation system are physically connected through a motorized steering wheel. The automation system is modeled as an intelligent agent that is not only capable of making decisions but also monitoring the human's behavior and adjusting its behavior accordingly. To enable the automation system to smoothly exchan…
▽ More
This paper presents an adaptive haptic shared control framework wherein a driver and an automation system are physically connected through a motorized steering wheel. The automation system is modeled as an intelligent agent that is not only capable of making decisions but also monitoring the human's behavior and adjusting its behavior accordingly. To enable the automation system to smoothly exchange the control authority with the human partner, this paper introduces a novel self-regulating impedance controller for the automation system. To determine an optimal modulation policy, a cost function is defined. The terms of the cost function are assigned to minimize the performance error and reduce the disagreement between the human and automation system. To solve the optimal control problem, we employed a nonlinear model predictive approach and used the continuation generalized minimum residual method to solve the nonlinear cost function. To demonstrate the effectiveness of the proposed approach, simulation studies consider a scenario where the human and the automation system both detect an obstacle and negotiate on controlling the steering wheel so that the obstacle can be avoided safely. The simulations involve four interaction modes addressing the cooperation status (cooperative and uncooperative) and the desired direction of the control transfer (active safety and autopilot).
△ Less
Submitted 14 July, 2020;
originally announced July 2020.
-
Multi-Objective Channel Allocation in Cognitive Radio Networks
Authors:
Ahmad Ghasemi,
Foad Ghasemi
Abstract:
This paper addresses the problem of channel allocation in Cognitive Radio (CR) networks. CR has been considered as a technology which improves spectrum utilization significantly by carrying out Dynamic Spectrum Management (DSM). One issue of the DSM is the using of frequency channels by secondary/CR users that are under-utilized and/or not used by primary users. CR users eager to use them when the…
▽ More
This paper addresses the problem of channel allocation in Cognitive Radio (CR) networks. CR has been considered as a technology which improves spectrum utilization significantly by carrying out Dynamic Spectrum Management (DSM). One issue of the DSM is the using of frequency channels by secondary/CR users that are under-utilized and/or not used by primary users. CR users eager to use them when they are not used by primary users. The number of these spectrum bands is limited. This scarcity leads to conflict among CR users; As many as bands used by any CR user leads to decaying objective functions of other users. Thus, they have a destructive effect on each other. The paper models this conflict as a new multi-objective problem. Pareto set is attained via a Multi-Objective Optimization (MOO) technique, namely ε - constraint method. Results show the efficiency of the method.
△ Less
Submitted 15 April, 2020; v1 submitted 13 April, 2020;
originally announced April 2020.
-
Impedance Modulation for Negotiating Control Authority in a Haptic Shared Control Paradigm
Authors:
Vahid Izadi,
Akshay Bhardwaj,
Amir H. Ghasemi
Abstract:
Communication and cooperation among team members can be enhanced significantly with physical interaction. Successful collaboration requires the integration of the individual partners' intentions into a shared action plan, which may involve a continuous negotiation of intentions and roles. This paper presents an adaptive haptic shared control framework wherein a human driver and an automation syste…
▽ More
Communication and cooperation among team members can be enhanced significantly with physical interaction. Successful collaboration requires the integration of the individual partners' intentions into a shared action plan, which may involve a continuous negotiation of intentions and roles. This paper presents an adaptive haptic shared control framework wherein a human driver and an automation system are physically connected through a motorized steering wheel. By virtue of haptic feedback, the driver and automation system can monitor each other actions and can still intuitively express their control intentions. The objective of this paper is to develop a systematic model for an automation system that can vary its impedance such that the control authority can transit between the two agents intuitively and smoothly. To this end, we defined a cost function that not only ensures the safety of the collaborative task but also takes account of the assistive behavior of the automation system. We employed a predictive controller based on modified least square to modulate the automation system impedance such that the cost function is optimized. The results demonstrate the significance of the proposed approach for negotiating the control authority, specifically when humans and automation are in a non-cooperative mode. Furthermore, the performance of the adaptive haptic shared control is compared with the traditional fixed automation impedance haptic shared control paradigm.
△ Less
Submitted 19 March, 2020; v1 submitted 21 January, 2020;
originally announced January 2020.
-
Partial Shading Detection and Smooth Maximum Power Point Tracking of PV Arrays under PSC
Authors:
Mohammad Amin Ghasemi,
Hossein Mohammadian Foroushani,
Mostafa Parniani
Abstract:
One of the most important issues in the operation of a photovoltaic (PV) system is extracting maximum power from the PV array, especially in partial shading condition (PSC). Under PSC, P-V characteristic of PV arrays will have multiple peak points, only one of which is global maximum. Conventional maximum power point tracking (MPPT) methods are not able to extract maximum power in this condition.…
▽ More
One of the most important issues in the operation of a photovoltaic (PV) system is extracting maximum power from the PV array, especially in partial shading condition (PSC). Under PSC, P-V characteristic of PV arrays will have multiple peak points, only one of which is global maximum. Conventional maximum power point tracking (MPPT) methods are not able to extract maximum power in this condition. In this paper, a novel two-stage MPPT method is presented to overcome this drawback. In the first stage, a method is proposed to determine the occurrence of PSC, and in the second stage, using a new algorithm that is based on ramp change of the duty cycle and continuous sampling from the P-V characteristic of the array, global maximum power point of array is reached. P&O algorithm is then re-activated to trace small changes of the new MPP. Open loop operation of the proposed method makes its implementation cheap and simple. The method is robust in the face of changing environmental conditions and array characteristics, and has minimum negative impact on the connected power system. Simulations in Matlab/Simulink and experimental results validate the performance of the proposed methods.
△ Less
Submitted 29 October, 2018;
originally announced October 2018.
-
Fast Maximum Power Point Tracking for PV Arrays under Partial shaded Conditions
Authors:
M. Amin Ghasemi,
Mostafa Parniani,
S. Fariborz Zarei,
Hossein Mohammadian Foroushani
Abstract:
P-V characteristic of photovoltaic (PV) arrays under partially shaded conditions (PSC) has multiple peaks, and conventional maximum power point tracking (MPPT) algorithms may fail to track the global maximum power point (GMPP) because of their insufficient intelligence in discriminating the local and global peaks. This paper proposes a novel fast MPPT method to achieve GMPP of PV array under all P…
▽ More
P-V characteristic of photovoltaic (PV) arrays under partially shaded conditions (PSC) has multiple peaks, and conventional maximum power point tracking (MPPT) algorithms may fail to track the global maximum power point (GMPP) because of their insufficient intelligence in discriminating the local and global peaks. This paper proposes a novel fast MPPT method to achieve GMPP of PV array under all PSCs. The proposed method reduces the number of required samples and increases the speed of GMPP tracking based on comprehensive study of I-V and P-V characteristics of PV array. Performance of the proposed method has been evaluated in simulations of different PSCs. Also, its performance has been compared with two selected methods in the literature through simulations. Comparisons highlight the superiority of the proposed method.
△ Less
Submitted 16 September, 2018;
originally announced September 2018.
