-
Multi-Agent Reinforcement Learning for Adaptive User Association in Dynamic mmWave Networks
Authors:
Mohamed Sana,
Antonio De Domenico,
Wei Yu,
Yves Lostanlen,
Emilio Calvanese Strinati
Abstract:
Network densification and millimeter-wave technologies are key enablers to fulfill the capacity and data rate requirements of the fifth generation (5G) of mobile networks. In this context, designing low-complexity policies with local observations, yet able to adapt the user association with respect to the global network state and to the network dynamics is a challenge. In fact, the frameworks prop…
▽ More
Network densification and millimeter-wave technologies are key enablers to fulfill the capacity and data rate requirements of the fifth generation (5G) of mobile networks. In this context, designing low-complexity policies with local observations, yet able to adapt the user association with respect to the global network state and to the network dynamics is a challenge. In fact, the frameworks proposed in literature require continuous access to global network information and to recompute the association when the radio environment changes. With the complexity associated to such an approach, these solutions are not well suited to dense 5G networks. In this paper, we address this issue by designing a scalable and flexible algorithm for user association based on multi-agent reinforcement learning. In this approach, users act as independent agents that, based on their local observations only, learn to autonomously coordinate their actions in order to optimize the network sum-rate. Since there is no direct information exchange among the agents, we also limit the signaling overhead. Simulation results show that the proposed algorithm is able to adapt to (fast) changes of radio environment, thus providing large sum-rate gain in comparison to state-of-the-art solutions.
△ Less
Submitted 16 June, 2020;
originally announced June 2020.
-
Assessing the Performance of a 60-GHz Dense Small-Cell Network Deployment from Ray-Based Simulations
Authors:
Yoann Corre,
Romain Charbonnier,
Mohammed Zahid Aslam,
Yves Lostanlen
Abstract:
Future dense small-cell networks are one key 5G candidates to offer outdoor high access data rates, especially in millimeter wave (mmWave) frequency bands. At those frequencies, the free space propagation loss and shadowing (from buildings, vegetation or any kind of obstacles) are far stronger than in the traditional radio cellular spectrum. Therefore, the cell range is expected to be limited to 5…
▽ More
Future dense small-cell networks are one key 5G candidates to offer outdoor high access data rates, especially in millimeter wave (mmWave) frequency bands. At those frequencies, the free space propagation loss and shadowing (from buildings, vegetation or any kind of obstacles) are far stronger than in the traditional radio cellular spectrum. Therefore, the cell range is expected to be limited to 50 - 100 meters, and directive high gain antennas are required at least for the base stations. This paper investigates the kind of topology that is required to serve a suburban area with a small-cell network operating at 60 GHz and equipped with beam-steering antennas. A real environment is considered to introduce practical deployment and propagation constraints. The analysis relies on Monte-Carlo system simulations with non-full buffer, and ray-based predictions. The ray-tracing techniques are today identified as a relevant solution to capture the main channel properties impacting the beam-steering performance (angular dispersion, inter-link correlation); and the one involved in the present study was specifically enhanced to deal with detailed vegetation modeling. In addition to the user outage, the paper evaluates the evolution of the inter-cell interference along with the user density, and investigates the network behavior in case of local strong obstructions.
△ Less
Submitted 10 November, 2016;
originally announced November 2016.
-
Coordination-based Medium Access Control with Space-reservation for Wireless Ad Hoc Networks
Authors:
Kamal Rahimi Malekshan,
Weihua Zhuang,
Yves Lostanlen
Abstract:
Efficient radio spectrum utilization and low energy consumption in mobile devices are essential in develo** next generation wireless networks. This paper presents a new medium access control (MAC) mechanism to enhance spectrum efficiency and reduce energy consumption in a wireless ad hoc network. A set of coordinator nodes, distributed in the network area, periodically schedule contention-free t…
▽ More
Efficient radio spectrum utilization and low energy consumption in mobile devices are essential in develo** next generation wireless networks. This paper presents a new medium access control (MAC) mechanism to enhance spectrum efficiency and reduce energy consumption in a wireless ad hoc network. A set of coordinator nodes, distributed in the network area, periodically schedule contention-free time slots for all data transmissions/receptions in the network, based on transmission requests from source nodes. Adjacent coordinators exchange scheduling information to effectively increase spatial spectrum reuse and avoid transmission collisions. Moreover, the proposed MAC scheme allows a node to put its radio interface into a sleep mode when it is not transmitting/receiving a packet, in order to reduce energy consumption. Simulation results demonstrate that the proposed scheme achieves substantially higher throughput and has significantly lower energy consumption in comparison with existing schemes.
△ Less
Submitted 18 October, 2015;
originally announced October 2015.
-
An Energy Efficient MAC Protocol for Fully Connected Wireless Ad Hoc Networks
Authors:
K. Rahimi Malekshan,
W. Zhuang,
Y. Lostanlen
Abstract:
Energy efficiency is an important performance measure of wireless network protocols, especially for battery-powered mobile devices such as smartphones. This paper presents a new energy-efficient medium access control (MAC) scheme for fully connected wireless ad hoc networks. The proposed scheme reduces energy consumption by putting radio interfaces in the sleep state periodically and by reducing t…
▽ More
Energy efficiency is an important performance measure of wireless network protocols, especially for battery-powered mobile devices such as smartphones. This paper presents a new energy-efficient medium access control (MAC) scheme for fully connected wireless ad hoc networks. The proposed scheme reduces energy consumption by putting radio interfaces in the sleep state periodically and by reducing transmission collisions, which results in high throughput and low packet transmission delay. The proposed MAC scheme can also address the energy saving in realtime traffics which require very low packet transmission delay. An analytical model is established to evaluate the performance of the proposed MAC scheme. Analytical and simulation results demonstrate that the proposed scheme has a significantly lower power consumption, achieves substantially higher throughput, and has lower packet transmission delay in comparison with existing power saving MAC protocols.
△ Less
Submitted 23 July, 2014;
originally announced July 2014.
-
Joint Indoor Localization and Radio Map Construction with Limited Deployment Load
Authors:
Sameh Sorour,
Yves Lostanlen,
Shahrokh Valaee
Abstract:
One major bottleneck in the practical implementation of received signal strength (RSS) based indoor localization systems is the extensive deployment efforts required to construct the radio maps through fingerprinting. In this paper, we aim to design an indoor localization scheme that can be directly employed without building a full fingerprinted radio map of the indoor environment. By accumulating…
▽ More
One major bottleneck in the practical implementation of received signal strength (RSS) based indoor localization systems is the extensive deployment efforts required to construct the radio maps through fingerprinting. In this paper, we aim to design an indoor localization scheme that can be directly employed without building a full fingerprinted radio map of the indoor environment. By accumulating the information of localized RSSs, this scheme can also simultaneously construct the radio map with limited calibration. To design this scheme, we employ a source data set that possesses the same spatial correlation of the RSSs in the indoor environment under study. The knowledge of this data set is then transferred to a limited number of calibration fingerprints and one or several RSS observations with unknown locations, in order to perform direct localization of these observations using manifold alignment. We test two different source data sets, namely a simulated radio propagation map and the environments plan coordinates. For moving users, we exploit the correlation of their observations to improve the localization accuracy. The online testing in two indoor environments shows that the plan coordinates achieve better results than the simulated radio maps, and a negligible degradation with 70-85% reduction in calibration load.
△ Less
Submitted 12 October, 2013;
originally announced October 2013.
-
Indoor Channel Measurements and Communications System Design at 60 GHz
Authors:
Lahatra Rakotondrainibe,
Gheorghe Zaharia,
Ghaïs El Zein,
Yves Lostanlen
Abstract:
This paper presents a brief overview of several studies concerning the indoor wireless communications at 60 GHz performed by the IETR. The characterization and the modeling of the radio propagation channel are based on several measurement campaigns realized with the channel sounder developed at IETR. Some typical residential environments were also simulated by ray tracing and Gaussian Beam Track…
▽ More
This paper presents a brief overview of several studies concerning the indoor wireless communications at 60 GHz performed by the IETR. The characterization and the modeling of the radio propagation channel are based on several measurement campaigns realized with the channel sounder developed at IETR. Some typical residential environments were also simulated by ray tracing and Gaussian Beam Tracking. The obtained results show a good agreement with the similar experimental results. Currently, the IETR is develo** a high data rate wireless communication system operating at 60 GHz. The single-carrier architecture of this system is also presented.
△ Less
Submitted 26 December, 2008;
originally announced December 2008.
