-
Dynamic CU-DU Selection for Resource Allocation in O-RAN Using Actor-Critic Learning
Authors:
Shahram Mollahasani,
Melike Erol-Kantarci,
Rodney Wilson
Abstract:
Recently, there has been tremendous efforts by network operators and equipment vendors to adopt intelligence and openness in the next generation radio access network (RAN). The goal is to reach a RAN that can self-optimize in a highly complex setting with multiple platforms, technologies and vendors in a converged compute and connect architecture. In this paper, we propose two nested actor-critic…
▽ More
Recently, there has been tremendous efforts by network operators and equipment vendors to adopt intelligence and openness in the next generation radio access network (RAN). The goal is to reach a RAN that can self-optimize in a highly complex setting with multiple platforms, technologies and vendors in a converged compute and connect architecture. In this paper, we propose two nested actor-critic learning based techniques to optimize the placement of resource allocation function, and as well, the decisions for resource allocation. By this, we investigate the impact of observability on the performance of the reinforcement learning based resource allocation. We show that when a network function (NF) is dynamically relocated based on service requirements, using reinforcement learning techniques, latency and throughput gains are obtained.
△ Less
Submitted 1 October, 2021;
originally announced October 2021.
-
Energy-Efficient and Delay-Guaranteed Joint Resource Allocation and DU Selection in O-RAN
Authors:
Turgay Pamuklu,
Shahram Mollahasani,
Melike Erol-Kantarci
Abstract:
The radio access network (RAN) part of the next-generation wireless networks will require efficient solutions for satisfying low latency and high-throughput services. The open RAN (O-RAN) is one of the candidates to achieve this goal, in addition to increasing vendor diversity and promoting openness. In the O-RAN architecture, network functions are executed in central units (CU), distributed units…
▽ More
The radio access network (RAN) part of the next-generation wireless networks will require efficient solutions for satisfying low latency and high-throughput services. The open RAN (O-RAN) is one of the candidates to achieve this goal, in addition to increasing vendor diversity and promoting openness. In the O-RAN architecture, network functions are executed in central units (CU), distributed units (DU), and radio units (RU). These entities are virtualized on general-purpose CPUs and form a processing pool. These processing pools can be located in different geographical places and have limited capacity, affecting the energy consumption and the performance of networks. Additionally, since user demand is not deterministic, special attention should be paid to allocating resource blocks to users by ensuring their expected quality of service for latency-sensitive traffic flows. In this paper, we propose a joint optimization solution to enhance energy efficiency and provide delay guarantees to the users in the O-RAN architecture. We formulate this novel problem and linearize it to provide a solution with a mixed-integer linear problem (MILP) solver. We compare this with a baseline that addresses this optimization problem using a disjoint approach. The results show that our approach outperforms the baseline method in terms of energy efficiency.
△ Less
Submitted 29 January, 2022; v1 submitted 30 September, 2021;
originally announced October 2021.
-
Actor-Critic Learning Based QoS-Aware Scheduler for Reconfigurable Wireless Networks
Authors:
Shahram Mollahasani,
Melike Erol-Kantarci,
Mahdi Hirab,
Hoda Dehghan,
Rodney Wilson
Abstract:
The flexibility offered by reconfigurable wireless networks, provide new opportunities for various applications such as online AR/VR gaming, high-quality video streaming and autonomous vehicles, that desire high-bandwidth, reliable and low-latency communications. These applications come with very stringent Quality of Service (QoS) requirements and increase the burden over mobile networks. Currentl…
▽ More
The flexibility offered by reconfigurable wireless networks, provide new opportunities for various applications such as online AR/VR gaming, high-quality video streaming and autonomous vehicles, that desire high-bandwidth, reliable and low-latency communications. These applications come with very stringent Quality of Service (QoS) requirements and increase the burden over mobile networks. Currently, there is a huge spectrum scarcity due to the massive data explosion and this problem can be solved by helps of Reconfigurable Wireless Networks (RWNs) where nodes have reconfiguration and perception capabilities. Therefore, a necessity of AI-assisted algorithms for resource block allocation is observed. To tackle this challenge, in this paper, we propose an actor-critic learning-based scheduler for allocating resource blocks in a RWN. Various traffic types with different QoS levels are assigned to our agents to provide more realistic results. We also include mobility in our simulations to increase the dynamicity of networks. The proposed model is compared with another actor-critic model and with other traditional schedulers; proportional fair (PF) and Channel and QoS Aware (CQA) techniques. The proposed models are evaluated by considering the delay experienced by user equipment (UEs), successful transmissions and head-of-the-line delays. The results show that the proposed model noticeably outperforms other techniques in different aspects.
△ Less
Submitted 29 January, 2021;
originally announced February 2021.
-
Multi Agent Team Learning in Disaggregated Virtualized Open Radio Access Networks (O-RAN)
Authors:
Pedro Enrique Iturria Rivera,
Shahram Mollahasani,
Melike Erol-Kantarci
Abstract:
Starting from the Cloud Radio Access Network (C-RAN), continuing with the virtual Radio Access Network (vRAN) and most recently with Open RAN (O-RAN) initiative, Radio Access Network (RAN) architectures have significantly evolved in the past decade. In the last few years, the wireless industry has witnessed a strong trend towards disaggregated, virtualized and open RANs, with numerous tests and de…
▽ More
Starting from the Cloud Radio Access Network (C-RAN), continuing with the virtual Radio Access Network (vRAN) and most recently with Open RAN (O-RAN) initiative, Radio Access Network (RAN) architectures have significantly evolved in the past decade. In the last few years, the wireless industry has witnessed a strong trend towards disaggregated, virtualized and open RANs, with numerous tests and deployments world wide. One unique aspect that motivates this paper is the availability of new opportunities that arise from using machine learning to optimize the RAN in closed-loop, i.e. without human intervention, where the complexity of disaggregation and virtualization makes well-known Self-Organized Networking (SON) solutions inadequate. In our view, Multi-Agent Systems (MASs) with team learning, can play an essential role in the control and coordination of controllers of O-RAN, i.e. near-real-time and non-real-time RAN Intelligent Controller (RIC). In this article, we first present the state-of-the-art research in multi-agent systems and team learning, then we provide an overview of the landscape in RAN disaggregation and virtualization, as well as O-RAN which emphasizes the open interfaces introduced by the O-RAN Alliance. We present a case study for agent placement and the AI feedback required in O-RAN, and finally, we identify challenges and open issues to provide a roadmap for researchers.
△ Less
Submitted 22 February, 2021; v1 submitted 8 December, 2020;
originally announced December 2020.
-
Density-aware Dynamic Mobile Networks: Opportunities and Challenges
Authors:
Ertan Onur,
Shahram Mollahasani,
Alperen Eroğlu,
Nina Razi Moftakhar
Abstract:
We experience a major paradigm change in mobile networks. The infrastructure of cellular networks becomes mobile as it is densified by using mobile and nomadic small cells to increase coverage and capacity. Furthermore, the innovative approaches such as green operation through sleep scheduling, user-controlled small cells, and end-to-end slicing will make the network highly dynamic. Mobile cells,…
▽ More
We experience a major paradigm change in mobile networks. The infrastructure of cellular networks becomes mobile as it is densified by using mobile and nomadic small cells to increase coverage and capacity. Furthermore, the innovative approaches such as green operation through sleep scheduling, user-controlled small cells, and end-to-end slicing will make the network highly dynamic. Mobile cells, while bringing many benefits, introduce many unconventional challenges that we present in this paper. We have to introduce novel techniques for adapting network functions, communication protocols and their parameters to network density. Especially when cells on wheels or wings are considered, static and man-made configurations will waste valuable resources such as spectrum or energy if density is not considered as an optimization parameter. In this paper, we present the existing density estimators. We analyze the impact of density on coverage, interference, mobility management, scalability, capacity, caching, routing protocols and energy consumption. We evaluate nomadic cells in dynamic networks in a comprehensive way and illustrate the potential objectives we can achieve by adapting mobile networks to base station density. The main challenges we may face by employing dynamic networks and how we can tackle these problems are discussed in detail.
△ Less
Submitted 25 December, 2017;
originally announced December 2017.