Showing 1–16 of 16 results for author: Korki, M

Primal-Dual Strategy (PDS) for Composite Optimization Over Directed graphs

Authors: Sajad Zandi, Mehdi Korki

Abstract: We investigate the distributed multi-agent sharing optimization problem in a directed graph, with a composite objective function consisting of a smooth function plus a convex (possibly non-smooth) function shared by all agents. While adhering to the network connectivity structure, the goal is to minimize the sum of smooth local functions plus a non-smooth function. The proposed Primal-Dual algorit… ▽ More We investigate the distributed multi-agent sharing optimization problem in a directed graph, with a composite objective function consisting of a smooth function plus a convex (possibly non-smooth) function shared by all agents. While adhering to the network connectivity structure, the goal is to minimize the sum of smooth local functions plus a non-smooth function. The proposed Primal-Dual algorithm (PD) is similar to a previous algorithm \cite{b27}, but it has additional benefits. To begin, we investigate the problem in directed graphs, where agents can only communicate in one direction and the combination matrix is not symmetric. Furthermore, the combination matrix is changing over time, and the condition coefficient weights are produced using an adaptive approach. The strong convexity assumption, adaptive coefficient weights, and a new upper bound on step-sizes are used to demonstrate that linear convergence is possible. New upper bounds on step-sizes are derived under the strong convexity assumption and adaptive coefficient weights that are time-varying in the presence of both smooth and non-smooth terms. Simulation results show the efficacy of the proposed algorithm compared to some other algorithms. △ Less

Submitted 20 June, 2024; originally announced June 2024.

Markovian Block Sparse Signal Detection Using One Bit Measurements

Authors: Alireza Hariri, Hadi Zayyani, Mehdi Korki

Abstract: This paper presents a novel sparse signal detection scheme designed for a correlated Markovian Bernoulli-Gaussian sparse signal model, which can equivalently be viewed as a block sparse signal model. Despite the inherent complexity of the model, our approach yields a closed-form detection criterion. Theoretical analyses of the proposed detector are provided, including the computation of false alar… ▽ More This paper presents a novel sparse signal detection scheme designed for a correlated Markovian Bernoulli-Gaussian sparse signal model, which can equivalently be viewed as a block sparse signal model. Despite the inherent complexity of the model, our approach yields a closed-form detection criterion. Theoretical analyses of the proposed detector are provided, including the computation of false alarm probability and detection probability through closed-form formulas. Simulation results compellingly demonstrate the advantages of our proposed detector compared to an existing detector in the literature. △ Less

Submitted 16 March, 2024; originally announced March 2024.

Double-Private Distributed Estimation Algorithm Using Differential Privacy and a Key-Like Proportionate Matrix with Its Performance Analysis

Authors: Mehdi Korki, Fatemehsadat Hosseiniamin, Hadi Zayyani, Mehdi Bekrani

Abstract: In this brief, we present an enhanced privacy-preserving distributed estimation algorithm, referred to as the ``Double-Private Algorithm," which combines the principles of both differential privacy (DP) and cryptography. The proposed algorithm enhances privacy by introducing DP noise into the intermediate estimations of neighboring nodes. Additionally, we employ an inverse of a closed-form reprodu… ▽ More In this brief, we present an enhanced privacy-preserving distributed estimation algorithm, referred to as the ``Double-Private Algorithm," which combines the principles of both differential privacy (DP) and cryptography. The proposed algorithm enhances privacy by introducing DP noise into the intermediate estimations of neighboring nodes. Additionally, we employ an inverse of a closed-form reproducible proportionate gain matrix as the cryptographic key matrix to fortify the privacy protection within the proposed double private algorithm. \textcolor{blue}{We improve the algorithm by transmitting alternative variable vectors instead of raw measurements, resulting in enhanced key matrix reconstruction performance. This innovative approach mitigate noise impact, enhancing overall algorithm effectiveness.} We also establish an upper bound for the norm of the error between the non-private Diffusion Least Mean Square (DLMS) algorithm and our double private algorithm. Further, we determine a sufficient condition for the step-size to ensure the mean convergence of the proposed algorithm. Simulation results demonstrate the effectiveness of the proposed algorithm, particularly its ability to attain the final Mean Square Deviation (MSD) comparable to that of the non-private DLMS. △ Less

Submitted 16 March, 2024; originally announced March 2024.

Second-Order Nonlinearity Estimated and Compensated Diffusion LMS Algorithm: Theoretical Upper Bound, Cramer-Rao Lower bound, and Convergence Analysis

Authors: Hadi Zayyani, Mehdi Korki

Abstract: In this paper, an algorithm for estimation and compensation of second-order nonlinearity in wireless sensor setwork (WSN) in distributed estimation framework is proposed. First, the effect of second-order nonlinearity on the performance of Diffusion Least Mean Square (DLMS) algorithm is investigated and an upper bound for $l^2$-norm of the error due to nonlinearity is derived mathematically. Secon… ▽ More In this paper, an algorithm for estimation and compensation of second-order nonlinearity in wireless sensor setwork (WSN) in distributed estimation framework is proposed. First, the effect of second-order nonlinearity on the performance of Diffusion Least Mean Square (DLMS) algorithm is investigated and an upper bound for $l^2$-norm of the error due to nonlinearity is derived mathematically. Second, mean convergence analysis of the DLMS algorithm in presence of second-order nonlinearity is derived. Third, a distributed algorithm is suggested which consists of extra nonlinearity estimation and compensation units. Moreover, considering the second-order nonlinearity, the Cramer-Rao bound (CRB) for estimating both the unknown vector and nonlinearity coefficient vector is calculated, in which the Fisher information matrix is obtained in a closed-form formula. Simulation results demonstrate the effectiveness of the proposed algorithm in improving the performance of distributed estimation in the presence of nonlinear sensors in a WSN. △ Less

Submitted 16 March, 2024; originally announced March 2024.

Diffusion LMS for Distributed Estimation over Wireless Networks with Inter-Node Interference Perturbation

Authors: Mohammadjavad Mirzazadeh Moallem, Mehdi Korki

Abstract: In this paper, we investigate the diffusion least mean square (DLMS) algorithm over fading channel, where in addition to channel noise and path-loss the inter-node-interference (INI) among neighboring nodes of a host node is also taken into account. We also analyze the mean-square convergence behavior of DLMS algorithm, under such condition. In addition, based on an upper bound of the derived netw… ▽ More In this paper, we investigate the diffusion least mean square (DLMS) algorithm over fading channel, where in addition to channel noise and path-loss the inter-node-interference (INI) among neighboring nodes of a host node is also taken into account. We also analyze the mean-square convergence behavior of DLMS algorithm, under such condition. In addition, based on an upper bound of the derived network MSD, an optimization problem is defined to find an optimal combination strategy. Furthermore, the adaptive version of the proposed combination strategy is presented. Simulation results corroborate the theoretical findings and indicate the superiority of the proposed combination methods over some previously reported algorithms. △ Less

Submitted 17 March, 2023; originally announced March 2023.

Proportionate Adaptive Graph Signal Recovery

Authors: Razieh Torkamani, Hadi Zayyani, Mehdi Korki

Abstract: This paper generalizes the proportionate-type adaptive algorithm to the graph signal processing and proposes two proportionate-type adaptive graph signal recovery algorithms. The gain matrix of the proportionate algorithm leads to faster convergence than least mean squares (LMS) algorithm. In this paper, the gain matrix is obtained in a closed-form by minimizing the gradient of the mean-square dev… ▽ More This paper generalizes the proportionate-type adaptive algorithm to the graph signal processing and proposes two proportionate-type adaptive graph signal recovery algorithms. The gain matrix of the proportionate algorithm leads to faster convergence than least mean squares (LMS) algorithm. In this paper, the gain matrix is obtained in a closed-form by minimizing the gradient of the mean-square deviation (GMSD). The first algorithm is the Proportionate-type Graph LMS (Pt-GLMS) algorithm which simply uses a gain matrix in the recursion process of the LMS algorithm and accelerates the convergence of the Pt-GLMS algorithm compared to the LMS algorithm. The second algorithm is the Proportionate-type Graph Extended LMS (Pt-GELMS) algorithm, which uses the previous signal vectors alongside the signal of the current iteration. The Pt-GELMS algorithm utilizes two gain matrices to control the effect of the signal of the previous iterations. The stability analyses of the algorithms are also provided. Simulation results demonstrate the efficacy of the two proposed proportionate-type LMS algorithms. △ Less

Submitted 20 September, 2022; originally announced September 2022.

Offset-Symmetric Gaussians for Differential Privacy

Authors: Parastoo Sadeghi, Mehdi Korki

Abstract: The Gaussian distribution is widely used in mechanism design for differential privacy (DP). Thanks to its sub-Gaussian tail, it significantly reduces the chance of outliers when responding to queries. However, it can only provide approximate $(ε, δ(ε))$-DP. In practice, $δ(ε)$ must be much smaller than the size of the dataset, which may limit the use of the Gaussian mechanism for large datasets wi… ▽ More The Gaussian distribution is widely used in mechanism design for differential privacy (DP). Thanks to its sub-Gaussian tail, it significantly reduces the chance of outliers when responding to queries. However, it can only provide approximate $(ε, δ(ε))$-DP. In practice, $δ(ε)$ must be much smaller than the size of the dataset, which may limit the use of the Gaussian mechanism for large datasets with strong privacy requirements. In this paper, we introduce and analyze a new distribution for use in DP that is based on the Gaussian distribution, but has improved privacy performance. The so-called offset-symmetric Gaussian tail (OSGT) distribution is obtained through using the normalized tails of two symmetric Gaussians around zero. Consequently, it can still have sub-Gaussian tail and lend itself to analytical derivations. We analytically derive the variance of the OSGT random variable and the $δ(ε)$ of the OSGT mechanism. We then numerically show that at the same variance, the OSGT mechanism can offer a lower $δ(ε)$ than the Gaussian mechanism. We extend the OSGT mechanism to $k$-dimensional queries and derive an easy-to-compute analytical upper bound for its zero-concentrated differential privacy (zCDP) performance. We analytically prove that at the same variance, the same global query sensitivity and for sufficiently large concentration orders $α$, the OSGT mechanism performs better than the Gaussian mechanism in terms of zCDP. △ Less

Submitted 12 October, 2021; originally announced October 2021.

One Bit Spectrum Sensing in Cognitive Radio Sensor Networks

Authors: Hadi Zayyani, Farzan Haddadi, Mehdi Korki

Abstract: This paper proposes a spectrum sensing algorithm from one bit measurements in a cognitive radio sensor network. A likelihood ratio test (LRT) for the one bit spectrum sensing problem is derived. Different from the one bit spectrum sensing research work in the literature, the signal is assumed to be a discrete random correlated Gaussian process, where the correlation is only available within immedi… ▽ More This paper proposes a spectrum sensing algorithm from one bit measurements in a cognitive radio sensor network. A likelihood ratio test (LRT) for the one bit spectrum sensing problem is derived. Different from the one bit spectrum sensing research work in the literature, the signal is assumed to be a discrete random correlated Gaussian process, where the correlation is only available within immediate successive samples of the received signal. The employed model facilitates the design of a powerful detection criteria with measurable analytical performance. One bit spectrum sensing criterion is derived for one sensor which is then generalized to multiple sensors. Performance of the detector is analyzed by obtaining closed-form formulas for the probability of false alarm and the probability of detection. Simulation results corroborate the theoretical findings and confirm the efficacy of the proposed detector in the context of highly correlated signals and large number of sensors. △ Less

Submitted 24 March, 2019; originally announced March 2019.

Comments: 11 pages, 2 figures

Weighted diffusion LMP algorithm for distributed estimation in non-uniform noise conditions

Authors: H. Zayyani, M. Korki

Abstract: This letter presents an improved version of diffusion least mean ppower (LMP) algorithm for distributed estimation. Instead of sum of mean square errors, a weighted sum of mean square error is defined as the cost function for global and local cost functions of a network of sensors. The weight coefficients are updated by a simple steepest-descent recursion to minimize the error signal of the global… ▽ More This letter presents an improved version of diffusion least mean ppower (LMP) algorithm for distributed estimation. Instead of sum of mean square errors, a weighted sum of mean square error is defined as the cost function for global and local cost functions of a network of sensors. The weight coefficients are updated by a simple steepest-descent recursion to minimize the error signal of the global and local adaptive algorithm. Simulation results show the advantages of the proposed weighted diffusion LMP over the diffusion LMP algorithm specially in the non-uniform noise conditions in a sensor network. △ Less

Submitted 5 August, 2016; originally announced August 2016.

Comments: 2 pages, 4 figures

Double-detector for Sparse Signal Detection from One Bit Compressed Sensing Measurements

Authors: Hadi Zayyani, Farzan Haddadi, Mehdi Korki

Abstract: This letter presents the sparse vector signal detection from one bit compressed sensing measurements, in contrast to the previous works which deal with scalar signal detection. In this letter, available results are extended to the vector case and the GLRT detector and the optimal quantizer design are obtained. Also, a double-detector scheme is introduced in which a sensor level threshold detector… ▽ More This letter presents the sparse vector signal detection from one bit compressed sensing measurements, in contrast to the previous works which deal with scalar signal detection. In this letter, available results are extended to the vector case and the GLRT detector and the optimal quantizer design are obtained. Also, a double-detector scheme is introduced in which a sensor level threshold detector is integrated into network level GLRT to improve the performance. The detection criteria of oracle and clairvoyant detectors are also derived. Simulation results show that with careful design of the threshold detector, the overall detection performance of double-detector scheme would be better than the sign-GLRT proposed in [1] and close to oracle and clairvoyant detectors. Also, the proposed detector is applied to spectrum sensing and the results are near the well known energy detector which uses the real valued data while the proposed detector only uses the sign of the data. △ Less

Submitted 2 July, 2016; originally announced July 2016.

Comments: 5 pages, 4 figures

Non-Coherent Direction of Arrival Estimation via Frequency Estimation

Authors: Hadi Zayyani, Mehdi Korki

Abstract: This letter investigates the non-coherent Direction of Arrival (DOA) estimation problem dealing with the DOA estimation from magnitude only measurements of the array output. The magnitude squared of the array output is expanded as a superposition of some harmonics. Hence, a frequency estimation approach is used to find some nonlinear relations between DOAs, which results in inherent ambiguities. T… ▽ More This letter investigates the non-coherent Direction of Arrival (DOA) estimation problem dealing with the DOA estimation from magnitude only measurements of the array output. The magnitude squared of the array output is expanded as a superposition of some harmonics. Hence, a frequency estimation approach is used to find some nonlinear relations between DOAs, which results in inherent ambiguities. To solve the nonlinear equations and resolve the ambiguities, we assume a high amplitude reference target at low angles to estimate the true DOA's with no ambiguities. However, the proposed algorithm requires a large number of antenna array elements to accurately estimate the DOA's. To overcome this drawback, and to enhance the estimation accuracy, we suggest two variants of the algorithm. One is to add virtual elements in the array and the second is to integrate multiple snapshots. Simulation results show that the proposed frequency estimation-based algorithm outperforms the non-coherent GESPAR algorithm in the low signal to noise ratio (SNR) regime and it is two orders of magnitude faster than the non-coherent GESPAR algorithm. △ Less

Submitted 21 June, 2016; originally announced June 2016.

Comments: 4 pages, 4 figures

Sparse Diffusion Steepest-Descent for One Bit Compressed Sensing in Wireless Sensor Networks

Authors: Hadi Zayyani, Mehdi Korki, Farrokh Marvasti

Abstract: This letter proposes a sparse diffusion steepest-descent algorithm for one bit compressed sensing in wireless sensor networks. The approach exploits the diffusion strategy from distributed learning in the one bit compressed sensing framework. To estimate a common sparse vector cooperatively from only the sign of measurements, steepest-descent is used to minimize the suitable global and local conve… ▽ More This letter proposes a sparse diffusion steepest-descent algorithm for one bit compressed sensing in wireless sensor networks. The approach exploits the diffusion strategy from distributed learning in the one bit compressed sensing framework. To estimate a common sparse vector cooperatively from only the sign of measurements, steepest-descent is used to minimize the suitable global and local convex cost functions. A diffusion strategy is suggested for distributive learning of the sparse vector. Simulation results show the effectiveness of the proposed distributed algorithm compared to the state-of-the-art non distributive algorithms in the one bit compressed sensing framework. △ Less

Submitted 3 January, 2016; originally announced January 2016.

Comments: 4 pages, 3 figures

Bayesian hypothesis testing for one bit compressed sensing with sensing matrix perturbation

Authors: H. Zayyani, M. Korki, F. Marvasti

Abstract: This letter proposes a low-computational Bayesian algorithm for noisy sparse recovery in the context of one bit compressed sensing with sensing matrix perturbation. The proposed algorithm which is called BHT-MLE comprises a sparse support detector and an amplitude estimator. The support detector utilizes Bayesian hypothesis test, while the amplitude estimator uses an ML estimator which is obtained… ▽ More This letter proposes a low-computational Bayesian algorithm for noisy sparse recovery in the context of one bit compressed sensing with sensing matrix perturbation. The proposed algorithm which is called BHT-MLE comprises a sparse support detector and an amplitude estimator. The support detector utilizes Bayesian hypothesis test, while the amplitude estimator uses an ML estimator which is obtained by solving a convex optimization problem. Simulation results show that BHT-MLE algorithm offers more reconstruction accuracy than that of an ML estimator (MLE) at a low computational cost. △ Less

Submitted 18 November, 2015; originally announced November 2015.

Comments: 2 pages, 1 figure

Dictionary Learning for Blind One Bit Compressed Sensing

Authors: Hadi Zayyani, Mehdi Korki, Farrokh Marvasti

Abstract: This letter proposes a dictionary learning algorithm for blind one bit compressed sensing. In the blind one bit compressed sensing framework, the original signal to be reconstructed from one bit linear random measurements is sparse in an unknown domain. In this context, the multiplication of measurement matrix $\Ab$ and sparse domain matrix $Φ$, \ie $\Db=\AbΦ$, should be learned. Hence, we use dic… ▽ More This letter proposes a dictionary learning algorithm for blind one bit compressed sensing. In the blind one bit compressed sensing framework, the original signal to be reconstructed from one bit linear random measurements is sparse in an unknown domain. In this context, the multiplication of measurement matrix $\Ab$ and sparse domain matrix $Φ$, \ie $\Db=\AbΦ$, should be learned. Hence, we use dictionary learning to train this matrix. Towards that end, an appropriate continuous convex cost function is suggested for one bit compressed sensing and a simple steepest-descent method is exploited to learn the rows of the matrix $\Db$. Experimental results show the effectiveness of the proposed algorithm against the case of no dictionary learning, specially with increasing the number of training signals and the number of sign measurements. △ Less

Submitted 30 August, 2015; originally announced August 2015.

Comments: 5 pages, 3 figures

Bayesian Hypothesis Testing for Block Sparse Signal Recovery

Authors: Mehdi Korki, Hadi Zayyani, **gxin Zhang

Abstract: This letter presents a novel Block Bayesian Hypothesis Testing Algorithm (Block-BHTA) for reconstructing block sparse signals with unknown block structures. The Block-BHTA comprises the detection and recovery of the supports, and the estimation of the amplitudes of the block sparse signal. The support detection and recovery is performed using a Bayesian hypothesis testing. Then, based on the detec… ▽ More This letter presents a novel Block Bayesian Hypothesis Testing Algorithm (Block-BHTA) for reconstructing block sparse signals with unknown block structures. The Block-BHTA comprises the detection and recovery of the supports, and the estimation of the amplitudes of the block sparse signal. The support detection and recovery is performed using a Bayesian hypothesis testing. Then, based on the detected and reconstructed supports, the nonzero amplitudes are estimated by linear MMSE. The effectiveness of Block-BHTA is demonstrated by numerical experiments. △ Less

Submitted 22 August, 2015; originally announced August 2015.

Comments: 5 pages, 2 figures. arXiv admin note: text overlap with arXiv:1412.2316

Iterative Bayesian Reconstruction of Non-IID Block-Sparse Signals

Authors: Mehdi Korki, **gxin Zhang, Cishen Zhang, Hadi Zayyani

Abstract: This paper presents a novel Block Iterative Bayesian Algorithm (Block-IBA) for reconstructing block-sparse signals with unknown block structures. Unlike the existing algorithms for block sparse signal recovery which assume the cluster structure of the nonzero elements of the unknown signal to be independent and identically distributed (i.i.d.), we use a more realistic Bernoulli-Gaussian hidden Mar… ▽ More This paper presents a novel Block Iterative Bayesian Algorithm (Block-IBA) for reconstructing block-sparse signals with unknown block structures. Unlike the existing algorithms for block sparse signal recovery which assume the cluster structure of the nonzero elements of the unknown signal to be independent and identically distributed (i.i.d.), we use a more realistic Bernoulli-Gaussian hidden Markov model (BGHMM) to characterize the non-i.i.d. block-sparse signals commonly encountered in practice. The Block-IBA iteratively estimates the amplitudes and positions of the block-sparse signal using the steepest-ascent based Expectation-Maximization (EM), and optimally selects the nonzero elements of the block-sparse signal by adaptive thresholding. The global convergence of Block-IBA is analyzed and proved, and the effectiveness of Block-IBA is demonstrated by numerical experiments and simulations on synthetic and real-life data. △ Less

Submitted 6 December, 2014; originally announced December 2014.

Comments: 13 pages, 7 figures, Journal