Showing 1–7 of 7 results for author: Getu, T M

Deep Learning-Enabled Text Semantic Communication under Interference: An Empirical Study

Authors: Tilahun M. Getu, Georges Kaddoum, Mehdi Bennis

Abstract: At the confluence of 6G, deep learning (DL), and natural language processing (NLP), DL-enabled text semantic communication (SemCom) has emerged as a 6G enabler by promising to minimize bandwidth consumption, transmission delay, and power usage. Among text SemCom techniques, \textit{DeepSC} is a popular scheme that leverages advancements in DL and NLP to reliably transmit semantic information in lo… ▽ More At the confluence of 6G, deep learning (DL), and natural language processing (NLP), DL-enabled text semantic communication (SemCom) has emerged as a 6G enabler by promising to minimize bandwidth consumption, transmission delay, and power usage. Among text SemCom techniques, \textit{DeepSC} is a popular scheme that leverages advancements in DL and NLP to reliably transmit semantic information in low signal-to-noise ratio (SNR) regimes. To understand the fundamental limits of such a transmission paradigm, our recently developed theory \cite{Getu'23_Performance_Limits} predicted the performance limits of DeepSC under radio frequency interference (RFI). Although these limits were corroborated by simulations, trained deep networks can defy classical statistical wisdom, and hence extensive computer experiments are needed to validate our theory. Accordingly, this empirical work follows concerning the training and testing of DeepSC using the proceedings of the European Parliament (Europarl) dataset. Employing training, validation, and testing sets \textit{tokenized and vectorized} from Europarl, we train the DeepSC architecture in Keras 2.9 with TensorFlow 2.9 as a backend and test it under Gaussian multi-interferer RFI received over Rayleigh fading channels. Validating our theory, the testing results corroborate that DeepSC produces semantically irrelevant sentences as the number of Gaussian RFI emitters gets very large. Therefore, a fundamental 6G design paradigm for \textit{interference-resistant and robust SemCom} (IR$^2$ SemCom) is needed. △ Less

Submitted 30 October, 2023; originally announced October 2023.

Fundamental Limits of Deep Learning-Based Binary Classifiers Trained with Hinge Loss

Authors: Tilahun M. Getu, Georges Kaddoum

Abstract: Although deep learning (DL) has led to several breakthroughs in many disciplines as diverse as chemistry, computer science, electrical engineering, mathematics, medicine, neuroscience, and physics, a comprehensive understanding of why and how DL is empirically successful remains fundamentally elusive. To attack this fundamental problem and unravel the mysteries behind DL's empirical successes, sig… ▽ More Although deep learning (DL) has led to several breakthroughs in many disciplines as diverse as chemistry, computer science, electrical engineering, mathematics, medicine, neuroscience, and physics, a comprehensive understanding of why and how DL is empirically successful remains fundamentally elusive. To attack this fundamental problem and unravel the mysteries behind DL's empirical successes, significant innovations toward a unified theory of DL have been made. These innovations encompass nearly fundamental advances in optimization, generalization, and approximation. Despite these advances, however, no work to date has offered a way to quantify the testing performance of a DL-based algorithm employed to solve a pattern classification problem. To overcome this fundamental challenge in part, this paper exposes the fundamental testing performance limits of DL-based binary classifiers trained with hinge loss. For binary classifiers that are based on deep rectified linear unit (ReLU) feedforward neural networks (FNNs) and ones that are based on deep FNNs with ReLU and Tanh activation, we derive their respective novel asymptotic testing performance limits. The derived testing performance limits are validated by extensive computer experiments. △ Less

Submitted 13 September, 2023; originally announced September 2023.

Tutorial-Cum-Survey on Semantic and Goal- Oriented Communication: Research Landscape, Challenges, and Future Directions

Authors: Tilahun M. Getu, Georges Kaddoum, Mehdi Bennis

Abstract: SemCom and goal-oriented SemCom are designed to transmit only semantically-relevant information and hence help to minimize power usage, bandwidth consumption, and transmission delay. Consequently, SemCom and goal-oriented SemCom embody a paradigm shift that can change the status quo that wireless connectivity is an opaque data pipe carrying messages whose context-dependent meaning and effectivenes… ▽ More SemCom and goal-oriented SemCom are designed to transmit only semantically-relevant information and hence help to minimize power usage, bandwidth consumption, and transmission delay. Consequently, SemCom and goal-oriented SemCom embody a paradigm shift that can change the status quo that wireless connectivity is an opaque data pipe carrying messages whose context-dependent meaning and effectiveness have been ignored. On the other hand, 6G is critical for the materialization of major SemCom use cases (e.g., machine-to-machine SemCom) and major goal-oriented SemCom use cases (e.g., autonomous transportation). The paradigms of \textit{6G for (goal-oriented) SemCom} and \textit{(goal-oriented) SemCom for 6G} call for the tighter integration and marriage of 6G, SemCom, and goal-oriented SemCom. To facilitate this integration and marriage of 6G, SemCom, and goal-oriented SemCom, this comprehensive tutorial-cum-survey paper first explains the fundamentals of semantics and semantic information, semantic representation, theories of semantic information, and definitions of semantic entropy. It then builds on this understanding and details the state-of-the-art research landscape of SemCom and goal-oriented SemCom in terms of their respective algorithmic, theoretical, and realization research frontiers. This paper also exposes the fundamental and major challenges of SemCom and goal-oriented SemCom, and proposes novel future research directions for them in terms of their aforementioned research frontiers. By presenting novel future research directions for SemCom and goal-oriented SemCom along with their corresponding fundamental and major challenges, this tutorial-cum-survey article duly stimulates major streams of research on SemCom and goal-oriented SemCom theory, algorithm, and implementation for 6G and beyond. △ Less

Submitted 4 July, 2023; originally announced August 2023.

Making Sense of Meaning: A Survey on Metrics for Semantic and Goal-Oriented Communication

Authors: Tilahun M. Getu, Georges Kaddoum, Mehdi Bennis

Abstract: Semantic communication (SemCom) aims to convey the meaning behind a transmitted message by transmitting only semantically-relevant information. This semantic-centric design helps to minimize power usage, bandwidth consumption, and transmission delay. SemCom and goal-oriented SemCom (or effectiveness-level SemCom) are therefore promising enablers of 6G and develo** rapidly. Despite the surge in t… ▽ More Semantic communication (SemCom) aims to convey the meaning behind a transmitted message by transmitting only semantically-relevant information. This semantic-centric design helps to minimize power usage, bandwidth consumption, and transmission delay. SemCom and goal-oriented SemCom (or effectiveness-level SemCom) are therefore promising enablers of 6G and develo** rapidly. Despite the surge in their swift development, the design, analysis, optimization, and realization of robust and intelligent SemCom as well as goal-oriented SemCom are fraught with many fundamental challenges. One of the challenges is that the lack of unified/universal metrics of SemCom and goal-oriented SemCom can stifle research progress on their respective algorithmic, theoretical, and implementation frontiers. Consequently, this survey paper documents the existing metrics -- scattered in many references -- of wireless SemCom, optical SemCom, quantum SemCom, and goal-oriented wireless SemCom. By doing so, this paper aims to inspire the design, analysis, and optimization of a wide variety of SemCom and goal-oriented SemCom systems. This article also stimulates the development of unified/universal performance assessment metrics of SemCom and goal-oriented SemCom, as the existing metrics are purely statistical and hardly applicable to reasoning-type tasks that constitute the heart of 6G and beyond. △ Less

Submitted 24 April, 2023; v1 submitted 20 March, 2023; originally announced March 2023.

Performance Limits of a Deep Learning-Enabled Text Semantic Communication under Interference

Authors: Tilahun M. Getu, Walid Saad, Georges Kaddoum, Mehdi Bennis

Abstract: Although deep learning (DL)-enabled semantic communication (SemCom) has emerged as a 6G enabler by minimizing irrelevant information transmission -- minimizing power usage, bandwidth consumption, and transmission delay, its benefits can be limited by radio frequency interference (RFI) that causes substantial semantic noise. Such semantic noise's impact can be alleviated using an interference-resis… ▽ More Although deep learning (DL)-enabled semantic communication (SemCom) has emerged as a 6G enabler by minimizing irrelevant information transmission -- minimizing power usage, bandwidth consumption, and transmission delay, its benefits can be limited by radio frequency interference (RFI) that causes substantial semantic noise. Such semantic noise's impact can be alleviated using an interference-resistant and robust (IR$^2$) SemCom design, though no such design exists yet. To stimulate fundamental research on IR2 SemCom, the performance limits of a popular text SemCom system named DeepSC are studied in the presence of (multi-interferer) RFI. By introducing a principled probabilistic framework for SemCom, we show that DeepSC produces semantically irrelevant sentences as the power of (multi-interferer) RFI gets very large. We also derive DeepSC's practical limits and a lower bound on its outage probability under multi-interferer RFI, and propose a (generic) lifelong DL-based IR$^2$ SemCom system. We corroborate the derived limits with simulations and computer experiments, which also affirm the vulnerability of DeepSC to a wireless attack using RFI. △ Less

Submitted 23 February, 2024; v1 submitted 15 February, 2023; originally announced February 2023.

Blind Estimation of a Doubly Selective OFDM Channel: A Deep Learning Algorithm and Theory

Authors: Tilahun M. Getu, Nada T. Golmie, David W. Griffith

Abstract: We provide a new generation solution to the fundamental old problem of a doubly selective fading channel estimation for orthogonal frequency division multiplexing (OFDM) systems. For systems based on OFDM, we propose a deep learning (DL)-based blind doubly selective channel estimator. This estimator does require no pilot symbols, unlike the corresponding state-of-the-art estimators, even during th… ▽ More We provide a new generation solution to the fundamental old problem of a doubly selective fading channel estimation for orthogonal frequency division multiplexing (OFDM) systems. For systems based on OFDM, we propose a deep learning (DL)-based blind doubly selective channel estimator. This estimator does require no pilot symbols, unlike the corresponding state-of-the-art estimators, even during the estimation of a deep fading doubly selective channel. We also provide the first of its kind theory on the testing mean squared error (MSE) performance of our investigated blind OFDM channel estimator based on over-parameterized ReLU FNNs. △ Less

Submitted 30 May, 2022; originally announced June 2022.

Error Bounds for a Matrix-Vector Product Approximation with Deep ReLU Neural Networks

Authors: Tilahun M. Getu

Abstract: Among the several paradigms of artificial intelligence (AI) or machine learning (ML), a remarkably successful paradigm is deep learning. Deep learning's phenomenal success has been hoped to be interpreted via fundamental research on the theory of deep learning. Accordingly, applied research on deep learning has spurred the theory of deep learning-oriented depth and breadth of developments. Inspire… ▽ More Among the several paradigms of artificial intelligence (AI) or machine learning (ML), a remarkably successful paradigm is deep learning. Deep learning's phenomenal success has been hoped to be interpreted via fundamental research on the theory of deep learning. Accordingly, applied research on deep learning has spurred the theory of deep learning-oriented depth and breadth of developments. Inspired by such developments, we pose these fundamental questions: can we accurately approximate an arbitrary matrix-vector product using deep rectified linear unit (ReLU) feedforward neural networks (FNNs)? If so, can we bound the resulting approximation error? In light of these questions, we derive error bounds in Lebesgue and Sobolev norms that comprise our developed deep approximation theory. Guided by this theory, we have successfully trained deep ReLU FNNs whose test results justify our developed theory. The developed theory is also applicable for guiding and easing the training of teacher deep ReLU FNNs in view of the emerging teacher-student AI or ML paradigms that are essential for solving several AI or ML problems in wireless communications and signal processing; network science and graph signal processing; and network neuroscience and brain physics. △ Less

Submitted 25 November, 2021; originally announced November 2021.