-
Radio Resource Management and Path Planning in Intelligent Transportation Systems via Reinforcement Learning for Environmental Sustainability
Authors:
S. Norouzi,
N. Azarasa,
M. R. Abedi,
N. Mokari,
S. E. Seyedabrishami,
H. Saeedi,
E. A. Jorswieck
Abstract:
Efficient and dynamic path planning has become an important topic for urban areas with larger density of connected vehicles (CV) which results in reduction of travel time and directly contributes to environmental sustainability through reducing energy consumption. CVs exploit the cellular wireless vehicle-to-everything (C-V2X) communication technology to disseminate the vehicle-to-infrastructure (…
▽ More
Efficient and dynamic path planning has become an important topic for urban areas with larger density of connected vehicles (CV) which results in reduction of travel time and directly contributes to environmental sustainability through reducing energy consumption. CVs exploit the cellular wireless vehicle-to-everything (C-V2X) communication technology to disseminate the vehicle-to-infrastructure (V2I) messages to the Base-station (BS) to improve situation awareness on urban roads. In this paper, we investigate radio resource management (RRM) in such a framework to minimize the age of information (AoI) so as to enhance path planning results. We use the fact that V2I messages with lower AoI value result in less error in estimating the road capacity and more accurate path planning. Through simulations, we compare road travel times and volume over capacity (V/C) against different levels of AoI and demonstrate the promising performance of the proposed framework.
△ Less
Submitted 13 May, 2024;
originally announced May 2024.
-
AI-Based and Mobility-Aware Energy Efficient Resource Allocation and Trajectory Design for NFV Enabled Aerial Networks
Authors:
Mohsen Pourghasemian,
Mohammad Reza Abedi,
Shima Salarhosseini,
Nader Mokari,
Mohammad Reza Javan,
Eduard A. Jorswieck
Abstract:
In this paper, we propose a novel joint intelligent trajectory design and resource allocation algorithm based on user's mobility and their requested services for unmanned aerial vehicles (UAVs) assisted networks, where UAVs act as nodes of a network function virtualization (NFV) enabled network. Our objective is to maximize energy efficiency and minimize the average delay on all services by alloca…
▽ More
In this paper, we propose a novel joint intelligent trajectory design and resource allocation algorithm based on user's mobility and their requested services for unmanned aerial vehicles (UAVs) assisted networks, where UAVs act as nodes of a network function virtualization (NFV) enabled network. Our objective is to maximize energy efficiency and minimize the average delay on all services by allocating the limited radio and NFV resources. In addition, due to the traffic conditions and mobility of users, we let some Virtual Network Functions (VNFs) to migrate from their current locations to other locations to satisfy the Quality of Service requirements. We formulate our problem to find near-optimal locations of UAVs, transmit power, subcarrier assignment, placement, and scheduling the requested service's functions over the UAVs and perform suitable VNF migration. Then we propose a novel Hierarchical Hybrid Continuous and Discrete Action (HHCDA) deep reinforcement learning method to solve our problem. Finally, the convergence and computational complexity of the proposed algorithm and its performance analyzed for different parameters. Simulation results show that our proposed HHCDA method decreases the request reject rate and average delay by 31.5% and 20% and increases the energy efficiency by 40% compared to DDPG method.
△ Less
Submitted 21 May, 2021;
originally announced May 2021.
-
Age of Information Aware VNF Scheduling in Industrial IoT Using Deep Reinforcement Learning
Authors:
Mohammad Akbari,
Mohammad Reza Abedi,
Roghayeh Joda,
Mohsen Pourghasemian,
Nader Mokari,
Melike Erol-Kantarci
Abstract:
In delay-sensitive industrial internet of things (IIoT) applications, the age of information (AoI) is employed to characterize the freshness of information. Meanwhile, the emerging network function virtualization provides flexibility and agility for service providers to deliver a given network service using a sequence of virtual network functions (VNFs). However, suitable VNF placement and schedul…
▽ More
In delay-sensitive industrial internet of things (IIoT) applications, the age of information (AoI) is employed to characterize the freshness of information. Meanwhile, the emerging network function virtualization provides flexibility and agility for service providers to deliver a given network service using a sequence of virtual network functions (VNFs). However, suitable VNF placement and scheduling in these schemes is NP-hard and finding a globally optimal solution by traditional approaches is complex. Recently, deep reinforcement learning (DRL) has appeared as a viable way to solve such problems. In this paper, we first utilize single agent low-complex compound action actor-critic RL to cover both discrete and continuous actions and jointly minimize VNF cost and AoI in terms of network resources under end-to end Quality of Service constraints. To surmount the single-agent capacity limitation for learning, we then extend our solution to a multi-agent DRL scheme in which agents collaborate with each other. Simulation results demonstrate that single-agent schemes significantly outperform the greedy algorithm in terms of average network cost and AoI. Moreover, multi-agent solution decreases the average cost by dividing the tasks between the agents. However, it needs more iterations to be learned due to the requirement on the agents collaboration.
△ Less
Submitted 10 May, 2021;
originally announced May 2021.
-
Dynamic Frame Structure for Next Generation Wireless Networks
Authors:
Mohammad R. Abedi,
Mohammad R. Javan,
Nader Mokari,
Eduard . A. Jorswieck
Abstract:
In this paper, we devise a novel radio resource block (RB) structure named dynamic resource block structure (D-RBS) which can handle low latency traffics and large fluctuations in data rates by exploiting smart time and frequency duplexing. In our framework, the main resource block with a predefined bandwidth and time duration is divided into several small blocks with the same bandwidth and time d…
▽ More
In this paper, we devise a novel radio resource block (RB) structure named dynamic resource block structure (D-RBS) which can handle low latency traffics and large fluctuations in data rates by exploiting smart time and frequency duplexing. In our framework, the main resource block with a predefined bandwidth and time duration is divided into several small blocks with the same bandwidth and time duration. Depending on the service requirements, e.g., data rate and latency, the users are assigned to some these small blocks which could be noncontiguous both in frequency and time. This is in contrast to the previously introduced static resource block structure (S-RBS) where the size of each RB is predetermined and fixed. We provide resource allocation frameworks for this RB structure and formulate the optimization problems whose solutions are obtained by alternate search method (ASM) based on successive convex approximation approach (SCA). We provide a global optimal solution by exploiting the monotonic optimization method. By simulation we study the performance of our proposed scheme with S-RBS scheme and show it has 26% gain compared to the S-RBS scheme.
△ Less
Submitted 2 February, 2020;
originally announced February 2020.
-
Single or Multiple Frames Content Delivery for Next-Generation Networks?
Authors:
Mohammad R. Abedi,
Nader Mokari,
Mohammad R. Javan,
Eduard. A. Jorswieck
Abstract:
This paper addresses the four enabling technologies, namely multi-user sparse code multiple access (SCMA), content caching, energy harvesting, and physical layer security for proposing an energy and spectral efficient resource allocation algorithm for the access and backhaul links in heterogeneous cellular networks. Although each of the above mentioned issues could be a topic of research, in a rea…
▽ More
This paper addresses the four enabling technologies, namely multi-user sparse code multiple access (SCMA), content caching, energy harvesting, and physical layer security for proposing an energy and spectral efficient resource allocation algorithm for the access and backhaul links in heterogeneous cellular networks. Although each of the above mentioned issues could be a topic of research, in a real situation, we would face a complicated scenario where they should be considered jointly, and hence, our target is to consider these technologies jointly in a unified framework. Moreover, we propose two novel content delivery scenarios: 1) single frame content delivery (SFCD), and 2) multiple frames content delivery (MFCD), where the time duration of serving user requests is divided into several frames. In the first scenario, the requested content by each user is served over one frame. However, in the second scenario, the requested content by each user can be delivered over several frames. We formulate the resource allocation for the proposed scenarios as optimization problems where our main aim is to maximize the energy efficiency of access links subject to the transmit power and rate constraints of access and backhaul links, caching and energy harvesting constraints, and SCMA codebook allocation limitations. Due to the practical limitations, we assume that the channel state information values between eavesdroppers and base stations are uncertain and design the network for the worst case scenario. Since the corresponding optimization problems are mixed integer non-linear and nonconvex programming, NP-hard, and intractable, we propose an iterative algorithm based on the well-known alternate and successive convex approximation methods.
△ Less
Submitted 14 August, 2018; v1 submitted 19 February, 2018;
originally announced February 2018.