-
Sustainable Edge Intelligence Through Energy-Aware Early Exiting
Authors:
Marcello Bullo,
Seifallah Jardak,
Pietro Carnelli,
Deniz Gündüz
Abstract:
Deep learning (DL) models have emerged as a promising solution for the Internet of Things (IoT). However, due to their computational complexity, DL models consume significant amounts of energy, which can rapidly drain the battery and compromise the performance of IoT devices. For sustainable operation, we consider an edge device with a rechargeable battery and energy harvesting (EH) capabilities.…
▽ More
Deep learning (DL) models have emerged as a promising solution for the Internet of Things (IoT). However, due to their computational complexity, DL models consume significant amounts of energy, which can rapidly drain the battery and compromise the performance of IoT devices. For sustainable operation, we consider an edge device with a rechargeable battery and energy harvesting (EH) capabilities. In addition to the stochastic nature of the ambient energy source, the harvesting rate is often insufficient to meet the inference energy requirements, leading to drastic performance degradation in energy-agnostic devices. To mitigate this problem, we propose energy-adaptive dynamic early exiting (EE) to enable efficient and accurate inference in an EH edge intelligence system. Our approach derives an energy-aware EE policy that determines the optimal amount of computational processing on a per-sample basis. The proposed policy balances the energy consumption to match the limited incoming energy and achieves continuous availability. Numerical results show that accuracy and service rate are improved up to 25% and 35%, respectively, in comparison with an energy-agnostic policy.
△ Less
Submitted 16 July, 2023; v1 submitted 23 May, 2023;
originally announced May 2023.
-
LE3D: A Lightweight Ensemble Framework of Data Drift Detectors for Resource-Constrained Devices
Authors:
Ioannis Mavromatis,
Adrian Sanchez-Mompo,
Francesco Raimondo,
James Pope,
Marcello Bullo,
Ingram Weeks,
Vijay Kumar,
Pietro Carnelli,
George Oikonomou,
Theodoros Spyridopoulos,
Aftab Khan
Abstract:
Data integrity becomes paramount as the number of Internet of Things (IoT) sensor deployments increases. Sensor data can be altered by benign causes or malicious actions. Mechanisms that detect drifts and irregularities can prevent disruptions and data bias in the state of an IoT application. This paper presents LE3D, an ensemble framework of data drift estimators capable of detecting abnormal sen…
▽ More
Data integrity becomes paramount as the number of Internet of Things (IoT) sensor deployments increases. Sensor data can be altered by benign causes or malicious actions. Mechanisms that detect drifts and irregularities can prevent disruptions and data bias in the state of an IoT application. This paper presents LE3D, an ensemble framework of data drift estimators capable of detecting abnormal sensor behaviours. Working collaboratively with surrounding IoT devices, the type of drift (natural/abnormal) can also be identified and reported to the end-user. The proposed framework is a lightweight and unsupervised implementation able to run on resource-constrained IoT devices. Our framework is also generalisable, adapting to new sensor streams and environments with minimal online reconfiguration. We compare our method against state-of-the-art ensemble data drift detection frameworks, evaluating both the real-world detection accuracy as well as the resource utilisation of the implementation. Experimenting with real-world data and emulated drifts, we show the effectiveness of our method, which achieves up to 97% of detection accuracy while requiring minimal resources to run.
△ Less
Submitted 18 November, 2022; v1 submitted 3 November, 2022;
originally announced November 2022.
-
Hybrid Point Cloud Semantic Compression for Automotive Sensors: A Performance Evaluation
Authors:
Andrea Varischio,
Francesco Mandruzzato,
Marcello Bullo,
Marco Giordani,
Paolo Testolina,
Michele Zorzi
Abstract:
In a fully autonomous driving framework, where vehicles operate without human intervention, information sharing plays a fundamental role. In this context, new network solutions have to be designed to handle the large volumes of data generated by the rich sensor suite of the cars in a reliable and efficient way. Among all the possible sensors, Light Detection and Ranging (LiDAR) can produce an accu…
▽ More
In a fully autonomous driving framework, where vehicles operate without human intervention, information sharing plays a fundamental role. In this context, new network solutions have to be designed to handle the large volumes of data generated by the rich sensor suite of the cars in a reliable and efficient way. Among all the possible sensors, Light Detection and Ranging (LiDAR) can produce an accurate 3D point cloud representation of the surrounding environment, which in turn generates high data rates. For this reason, efficient point cloud compression is paramount to alleviate the burden of data transmission over bandwidth-constrained channels and to facilitate real-time communications. In this paper, we propose a pipeline to efficiently compress LiDAR observations in an automotive scenario. First, we leverage the capabilities of RangeNet++, a Deep Neural Network (DNN) used to semantically infer point labels, to reduce the channel load by selecting the most valuable environmental data to be disseminated. Second, we compress the selected points using Draco, a 3D compression algorithm which is able to obtain compression up to the quantization error. Our experiments, validated on the Semantic KITTI dataset, demonstrate that it is possible to compress and send the information at the frame rate of the LiDAR, thus achieving real-time performance.
△ Less
Submitted 5 March, 2021;
originally announced March 2021.
