-
QoE Optimization for Live Video Streaming in UAV-to-UAV Communications via Deep Reinforcement Learning
Authors:
Liyana Adilla binti Burhanuddin,
Xiaonan Liu,
Yansha Deng,
Ursula Challita,
Andras Zahemszky
Abstract:
A challenge for rescue teams when fighting against wildfire in remote areas is the lack of information, such as the size and images of fire areas. As such, live streaming from Unmanned Aerial Vehicles (UAVs), capturing videos of dynamic fire areas, is crucial for firefighter commanders in any location to monitor the fire situation with quick response. The 5G network is a promising wireless technol…
▽ More
A challenge for rescue teams when fighting against wildfire in remote areas is the lack of information, such as the size and images of fire areas. As such, live streaming from Unmanned Aerial Vehicles (UAVs), capturing videos of dynamic fire areas, is crucial for firefighter commanders in any location to monitor the fire situation with quick response. The 5G network is a promising wireless technology to support such scenarios. In this paper, we consider a UAV-to-UAV (U2U) communication scenario, where a UAV at a high altitude acts as a mobile base station (UAV-BS) to stream videos from other flying UAV-users (UAV-UEs) through the uplink. Due to the mobility of the UAV-BS and UAV-UEs, it is important to determine the optimal movements and transmission powers for UAV-BSs and UAV-UEs in real-time, so as to maximize the data rate of video transmission with smoothness and low latency, while mitigating the interference according to the dynamics in fire areas and wireless channel conditions. In this paper, we co-design the video resolution, the movement, and the power control of UAV-BS and UAV-UEs to maximize the Quality of Experience (QoE) of real-time video streaming. To learn the Deep Q-Network (DQN) and Actor-Critic (AC) to maximize the QoE of video transmission from all UAV-UEs to a single UAVBS. Simulation results show the effectiveness of our proposed algorithm in terms of the QoE, delay and video smoothness as compared to the Greedy algorithm.
△ Less
Submitted 21 February, 2021;
originally announced February 2021.
-
Noise Learning Based Denoising Autoencoder
Authors:
Woong-Hee Lee,
Mustafa Ozger,
Ursula Challita,
Ki Won Sung
Abstract:
This letter introduces a new denoiser that modifies the structure of denoising autoencoder (DAE), namely noise learning based DAE (nlDAE). The proposed nlDAE learns the noise of the input data. Then, the denoising is performed by subtracting the regenerated noise from the noisy input. Hence, nlDAE is more effective than DAE when the noise is simpler to regenerate than the original data. To validat…
▽ More
This letter introduces a new denoiser that modifies the structure of denoising autoencoder (DAE), namely noise learning based DAE (nlDAE). The proposed nlDAE learns the noise of the input data. Then, the denoising is performed by subtracting the regenerated noise from the noisy input. Hence, nlDAE is more effective than DAE when the noise is simpler to regenerate than the original data. To validate the performance of nlDAE, we provide three case studies: signal restoration, symbol demodulation, and precise localization. Numerical results suggest that nlDAE requires smaller latent space dimension and smaller training dataset compared to DAE.
△ Less
Submitted 21 June, 2021; v1 submitted 19 January, 2021;
originally announced January 2021.
-
Performance Evaluation for the Co-existence of eMBB and URLLC Networks: Synchronized versus Unsynchronized TDD
Authors:
Ursula Challita,
Kimmo Hiltunen,
Miurel Tercero
Abstract:
To ensure the high level of automation required in today's industrial applications, next-generation wireless networks must enable real-time control and automation of dynamic processes with the requirements of extreme low-latency and ultra-reliable communications. In this paper, we provide a performance assessment for the co-existence of a macro (eMBB) and a local factory (URLLC) network and evalua…
▽ More
To ensure the high level of automation required in today's industrial applications, next-generation wireless networks must enable real-time control and automation of dynamic processes with the requirements of extreme low-latency and ultra-reliable communications. In this paper, we provide a performance assessment for the co-existence of a macro (eMBB) and a local factory (URLLC) network and evaluate the network conditions under which the latency and reliability requirements of factory automation applications are met. In particular, we evaluate the co-existence of the eMBB and URLLC networks under two scenarios: (i) synchronized TDD, in which both networks follow the same TDD pattern, and (ii) unsynchronized TDD, in which the eMBB and URLLC networks follow different TDD patterns. Simulation results show that the high downlink interference from the macro base stations towards the factory results in a reduction of the downlink URLLC capacity and service availability in case of synchronized TDD and a reduction of the uplink URLLC capacity and service availability in case of unsynchronized TDD. Finally, it is shown that a promising case for co-existence is the adjacent channel allocation, for both synchronized and unsynchronized TDD deployments. Here, the required isolation to protect the URLLC network in the worst-case scenario where the factory is located next to a macro site can be handled via the factory wall penetration loss (e.g., considering high concrete or metal-coated building walls) along with other solutions such as filters, larger separation distance, and band pairing.
△ Less
Submitted 1 June, 2019;
originally announced June 2019.
-
Robust Deep Reinforcement Learning for Security and Safety in Autonomous Vehicle Systems
Authors:
Aidin Ferdowsi,
Ursula Challita,
Walid Saad,
Narayan B. Mandayam
Abstract:
To operate effectively in tomorrow's smart cities, autonomous vehicles (AVs) must rely on intra-vehicle sensors such as camera and radar as well as inter-vehicle communication. Such dependence on sensors and communication links exposes AVs to cyber-physical (CP) attacks by adversaries that seek to take control of the AVs by manipulating their data. Thus, to ensure safe and optimal AV dynamics cont…
▽ More
To operate effectively in tomorrow's smart cities, autonomous vehicles (AVs) must rely on intra-vehicle sensors such as camera and radar as well as inter-vehicle communication. Such dependence on sensors and communication links exposes AVs to cyber-physical (CP) attacks by adversaries that seek to take control of the AVs by manipulating their data. Thus, to ensure safe and optimal AV dynamics control, the data processing functions at AVs must be robust to such CP attacks. To this end, in this paper, the state estimation process for monitoring AV dynamics, in presence of CP attacks, is analyzed and a novel adversarial deep reinforcement learning (RL) algorithm is proposed to maximize the robustness of AV dynamics control to CP attacks. The attacker's action and the AV's reaction to CP attacks are studied in a game-theoretic framework. In the formulated game, the attacker seeks to inject faulty data to AV sensor readings so as to manipulate the inter-vehicle optimal safe spacing and potentially increase the risk of AV accidents or reduce the vehicle flow on the roads. Meanwhile, the AV, acting as a defender, seeks to minimize the deviations of spacing so as to ensure robustness to the attacker's actions. Since the AV has no information about the attacker's action and due to the infinite possibilities for data value manipulations, the outcome of the players' past interactions are fed to long-short term memory (LSTM) blocks. Each player's LSTM block learns the expected spacing deviation resulting from its own action and feeds it to its RL algorithm. Then, the the attacker's RL algorithm chooses the action which maximizes the spacing deviation, while the AV's RL algorithm tries to find the optimal action that minimizes such deviation.
△ Less
Submitted 8 May, 2018; v1 submitted 2 May, 2018;
originally announced May 2018.
