-
Sparse Actuator Scheduling for Discrete-Time Linear Dynamical Systems
Authors:
Krishna Praveen V. S. Kondapi,
Chandrasekhar Sriram,
Geethu Joseph,
Chandra R. Murthy
Abstract:
We consider the control of discrete-time linear dynamical systems using sparse inputs where we limit the number of active actuators at every time step. We develop an algorithm for determining a sparse actuator schedule that ensures the existence of a sparse control input sequence, following the schedule, that takes the system from any given initial state to any desired final state. Since such an a…
▽ More
We consider the control of discrete-time linear dynamical systems using sparse inputs where we limit the number of active actuators at every time step. We develop an algorithm for determining a sparse actuator schedule that ensures the existence of a sparse control input sequence, following the schedule, that takes the system from any given initial state to any desired final state. Since such an actuator schedule is not unique, we look for a schedule that minimizes the energy of sparse inputs. For this, we optimize the trace of the inverse of the resulting controllability Gramian, which is an approximate measure of the average energy of the inputs. We present a greedy algorithm along with its theoretical guarantees. Finally, we empirically show that our greedy algorithm ensures the controllability of the linear system with a small number of active actuators per time step without a significant average energy expenditure compared to the fully actuated system.
△ Less
Submitted 29 June, 2024;
originally announced July 2024.
-
Convergence of Expectation-Maximization Algorithm with Mixed-Integer Optimization
Authors:
Geethu Joseph
Abstract:
The convergence of expectation-maximization (EM)-based algorithms typically requires continuity of the likelihood function with respect to all the unknown parameters (optimization variables). The requirement is not met when parameters comprise both discrete and continuous variables, making the convergence analysis nontrivial. This paper introduces a set of conditions that ensure the convergence of…
▽ More
The convergence of expectation-maximization (EM)-based algorithms typically requires continuity of the likelihood function with respect to all the unknown parameters (optimization variables). The requirement is not met when parameters comprise both discrete and continuous variables, making the convergence analysis nontrivial. This paper introduces a set of conditions that ensure the convergence of a specific class of EM algorithms that estimate a mixture of discrete and continuous parameters. Our results offer a new analysis technique for iterative algorithms that solve mixed-integer non-linear optimization problems. As a concrete example, we prove the convergence of the EM-based sparse Bayesian learning algorithm in [1] that estimates the state of a linear dynamical system with jointly sparse inputs and bursty missing observations. Our results establish that the algorithm in [1] converges to the set of stationary points of the maximum likelihood cost with respect to the continuous optimization variables.
△ Less
Submitted 17 April, 2024; v1 submitted 31 January, 2024;
originally announced January 2024.
-
Joint State and Input Estimation for Linear Dynamical Systems with Sparse Control
Authors:
Rupam Kalyan Chakraborty,
Geethu Joseph,
Chandra R. Murthy
Abstract:
Sparsity constraints on the control inputs of a linear dynamical system naturally arise in several practical applications such as networked control, computer vision, seismic signal processing, and cyber-physical systems. In this work, we consider the problem of jointly estimating the states and sparse inputs of such systems from low-dimensional (compressive) measurements. Due to the low-dimensiona…
▽ More
Sparsity constraints on the control inputs of a linear dynamical system naturally arise in several practical applications such as networked control, computer vision, seismic signal processing, and cyber-physical systems. In this work, we consider the problem of jointly estimating the states and sparse inputs of such systems from low-dimensional (compressive) measurements. Due to the low-dimensional measurements, conventional Kalman filtering and smoothing algorithms fail to accurately estimate the states and inputs. We present a Bayesian approach that exploits the input sparsity to significantly improve estimation accuracy. Sparsity in the input estimates is promoted by using different prior distributions on the input. We investigate two main approaches: regularizer-based MAP, and {Bayesian learning-based estimation}. We also extend the approaches to handle control inputs with common support and analyze the time and memory complexities of the presented algorithms. Finally, using numerical simulations, we show that our algorithms outperform the state-of-the-art methods in terms of accuracy and time/memory complexities, especially in the low-dimensional measurement regime.
△ Less
Submitted 4 December, 2023;
originally announced December 2023.
-
Anomaly Detection via Learning-Based Sequential Controlled Sensing
Authors:
Geethu Joseph,
Chen Zhong,
M. Cenk Gursoy,
Senem Velipasalar,
Pramod K. Varshney
Abstract:
In this paper, we address the problem of detecting anomalies among a given set of binary processes via learning-based controlled sensing. Each process is parameterized by a binary random variable indicating whether the process is anomalous. To identify the anomalies, the decision-making agent is allowed to observe a subset of the processes at each time instant. Also, probing each process has an as…
▽ More
In this paper, we address the problem of detecting anomalies among a given set of binary processes via learning-based controlled sensing. Each process is parameterized by a binary random variable indicating whether the process is anomalous. To identify the anomalies, the decision-making agent is allowed to observe a subset of the processes at each time instant. Also, probing each process has an associated cost. Our objective is to design a sequential selection policy that dynamically determines which processes to observe at each time with the goal to minimize the delay in making the decision and the total sensing cost. We cast this problem as a sequential hypothesis testing problem within the framework of Markov decision processes. This formulation utilizes both a Bayesian log-likelihood ratio-based reward and an entropy-based reward. The problem is then solved using two approaches: 1) a deep reinforcement learning-based approach where we design both deep Q-learning and policy gradient actor-critic algorithms; and 2) a deep active inference-based approach. Using numerical experiments, we demonstrate the efficacy of our algorithms and show that our algorithms adapt to any unknown statistical dependence pattern of the processes.
△ Less
Submitted 30 November, 2023;
originally announced December 2023.
-
Minimal Input Structural Modifications for Strongly Structural Controllability
Authors:
Geethu Joseph,
Shana Moothedath,
Jiabin Lin
Abstract:
This paper studies the problem of modifying the input matrix of a structured system to make the system strongly structurally controllable. We focus on the generalized structured systems that rely on zero/nonzero/arbitrary structure, i.e., some entries of system matrices are zeros, some are nonzero, and the remaining entries can be zero or nonzero (arbitrary). We analyze the feasibility of the prob…
▽ More
This paper studies the problem of modifying the input matrix of a structured system to make the system strongly structurally controllable. We focus on the generalized structured systems that rely on zero/nonzero/arbitrary structure, i.e., some entries of system matrices are zeros, some are nonzero, and the remaining entries can be zero or nonzero (arbitrary). We analyze the feasibility of the problem, and if it is feasible, we reformulate it into another equivalent problem. This new formulation leads to a greedy heuristic algorithm. However, we also show that the greedy algorithm can give arbitrarily poor solutions for some special systems. Our alternative approach is a randomized Markov chain Monte Carlo-based algorithm. Unlike the greedy algorithm, this algorithm is guaranteed to converge to an optimal solution with high probability. Finally, we numerically evaluate the algorithms on random graphs to show that the algorithms perform well.
△ Less
Submitted 17 January, 2024; v1 submitted 8 November, 2023;
originally announced November 2023.
-
Kronecker-structured Sparse Vector Recovery with Application to IRS-MIMO Channel Estimation
Authors:
Yanbin He,
Geethu Joseph
Abstract:
This paper studies the problem of Kronecker-structured sparse vector recovery from an underdetermined linear system with a Kronecker-structured dictionary. Such a problem arises in many real-world applications such as the sparse channel estimation of an intelligent reflecting surface-aided multiple-input multiple-output system. The prior art only exploits the Kronecker structure in the support of…
▽ More
This paper studies the problem of Kronecker-structured sparse vector recovery from an underdetermined linear system with a Kronecker-structured dictionary. Such a problem arises in many real-world applications such as the sparse channel estimation of an intelligent reflecting surface-aided multiple-input multiple-output system. The prior art only exploits the Kronecker structure in the support of the sparse vector and solves the entire linear system together leading to high computational complexity. Instead, we break down the original sparse recovery problem into multiple independent sub-problems and solve them individually. We obtain the sparse vector as the Kronecker product of the individual solutions, retaining its structure in both support and nonzero entries. Our simulations demonstrate the superior performance of our methods in terms of accuracy and run time compared with the existing works, using synthetic data and the channel estimation application. We attribute the low run time to the reduced solution space due to the additional structure and improved accuracy to the denoising effect owing to the decomposition step.
△ Less
Submitted 16 October, 2023; v1 submitted 11 October, 2023;
originally announced October 2023.
-
Sparse Millimeter Wave Channel Estimation From Partially Coherent Measurements
Authors:
Weijia Yi,
Nitin Jonathan Myers,
Geethu Joseph
Abstract:
This paper develops a channel estimation technique for millimeter wave (mmWave) communication systems. Our method exploits the sparse structure in mmWave channels for low training overhead and accounts for the phase errors in the channel measurements due to phase noise at the oscillator. Specifically, in IEEE 802.11ad/ay-based mmWave systems, the phase errors within a beam refinement protocol pack…
▽ More
This paper develops a channel estimation technique for millimeter wave (mmWave) communication systems. Our method exploits the sparse structure in mmWave channels for low training overhead and accounts for the phase errors in the channel measurements due to phase noise at the oscillator. Specifically, in IEEE 802.11ad/ay-based mmWave systems, the phase errors within a beam refinement protocol packet are almost the same, while the errors across different packets are substantially different. Consequently, standard sparsity-aware algorithms, which ignore phase errors, fail when channel measurements are acquired over multiple beam refinement protocol packets. We present a novel algorithm called partially coherent matching pursuit for sparse channel estimation under practical phase noise perturbations. Our method iteratively detects the support of sparse signal and employs alternating minimization to jointly estimate the signal and the phase errors. We numerically show that our algorithm can reconstruct the channel accurately at a lower complexity than the benchmarks.
△ Less
Submitted 11 October, 2023;
originally announced October 2023.
-
Bayesian Algorithms for Kronecker-structured Sparse Vector Recovery With Application to IRS-MIMO Channel Estimation
Authors:
Yanbin He,
Geethu Joseph
Abstract:
We study the sparse recovery problem with an underdetermined linear system characterized by a Kronecker-structured dictionary and a Kronecker-supported sparse vector. We cast this problem into the sparse Bayesian learning (SBL) framework and rely on the expectation-maximization method for a solution. To this end, we model the Kronecker-structured support with a hierarchical Gaussian prior distribu…
▽ More
We study the sparse recovery problem with an underdetermined linear system characterized by a Kronecker-structured dictionary and a Kronecker-supported sparse vector. We cast this problem into the sparse Bayesian learning (SBL) framework and rely on the expectation-maximization method for a solution. To this end, we model the Kronecker-structured support with a hierarchical Gaussian prior distribution parameterized by a Kronecker-structured hyperparameter, leading to a non-convex optimization problem. The optimization problem is solved using the alternating minimization (AM) method and a singular value decomposition (SVD)-based method, resulting in two algorithms. Further, we analytically guarantee that the AM-based method converges to the stationary point of the SBL cost function. The SVD-based method, though it adopts approximations, is empirically shown to be more efficient and accurate. We then apply our algorithm to estimate the uplink wireless channel in an intelligent reflecting surface-aided MIMO system and extend the AM-based algorithm to address block sparsity in the channel. We also study the SBL cost to show that the minima of the cost function are achieved at sparse solutions and that incorporating the Kronecker structure reduces the number of local minima of the SBL cost function. Our numerical results demonstrate the effectiveness of our algorithms compared to the state-of-the-art.
△ Less
Submitted 1 August, 2023; v1 submitted 27 July, 2023;
originally announced July 2023.
-
NeuroBench: A Framework for Benchmarking Neuromorphic Computing Algorithms and Systems
Authors:
Jason Yik,
Korneel Van den Berghe,
Douwe den Blanken,
Younes Bouhadjar,
Maxime Fabre,
Paul Hueber,
Denis Kleyko,
Noah Pacik-Nelson,
Pao-Sheng Vincent Sun,
Guangzhi Tang,
Shenqi Wang,
Biyan Zhou,
Soikat Hasan Ahmed,
George Vathakkattil Joseph,
Benedetto Leto,
Aurora Micheli,
Anurag Kumar Mishra,
Gregor Lenz,
Tao Sun,
Zergham Ahmed,
Mahmoud Akl,
Brian Anderson,
Andreas G. Andreou,
Chiara Bartolozzi,
Arindam Basu
, et al. (73 additional authors not shown)
Abstract:
Neuromorphic computing shows promise for advancing computing efficiency and capabilities of AI applications using brain-inspired principles. However, the neuromorphic research field currently lacks standardized benchmarks, making it difficult to accurately measure technological advancements, compare performance with conventional methods, and identify promising future research directions. Prior neu…
▽ More
Neuromorphic computing shows promise for advancing computing efficiency and capabilities of AI applications using brain-inspired principles. However, the neuromorphic research field currently lacks standardized benchmarks, making it difficult to accurately measure technological advancements, compare performance with conventional methods, and identify promising future research directions. Prior neuromorphic computing benchmark efforts have not seen widespread adoption due to a lack of inclusive, actionable, and iterative benchmark design and guidelines. To address these shortcomings, we present NeuroBench: a benchmark framework for neuromorphic computing algorithms and systems. NeuroBench is a collaboratively-designed effort from an open community of nearly 100 co-authors across over 50 institutions in industry and academia, aiming to provide a representative structure for standardizing the evaluation of neuromorphic approaches. The NeuroBench framework introduces a common set of tools and systematic methodology for inclusive benchmark measurement, delivering an objective reference framework for quantifying neuromorphic approaches in both hardware-independent (algorithm track) and hardware-dependent (system track) settings. In this article, we present initial performance baselines across various model architectures on the algorithm track and outline the system track benchmark tasks and guidelines. NeuroBench is intended to continually expand its benchmarks and features to foster and track the progress made by the research community.
△ Less
Submitted 17 January, 2024; v1 submitted 10 April, 2023;
originally announced April 2023.
-
Structure-aware Sparse Bayesian Learning-based Channel Estimation for Intelligent Reflecting Surface-aided MIMO
Authors:
Yanbin He,
Geethu Joseph
Abstract:
This paper presents novel cascaded channel estimation techniques for an intelligent reflecting surface-aided multiple-input multiple-output system. Motivated by the channel angular sparsity at higher frequency bands, the channel estimation problem is formulated as a sparse vector recovery problem with an inherent Kronecker structure. We solve the problem using the sparse Bayesian learning framewor…
▽ More
This paper presents novel cascaded channel estimation techniques for an intelligent reflecting surface-aided multiple-input multiple-output system. Motivated by the channel angular sparsity at higher frequency bands, the channel estimation problem is formulated as a sparse vector recovery problem with an inherent Kronecker structure. We solve the problem using the sparse Bayesian learning framework which leads to a non-convex optimization problem. We offer two solution techniques to the problem based on alternating minimization and singular value decomposition. Our simulation results illustrate the superior performance of our methods in terms of accuracy and run time compared with the existing works.
△ Less
Submitted 24 October, 2022; v1 submitted 20 October, 2022;
originally announced October 2022.
-
Near-field focusing using phased arrays with dynamic polarization control
Authors:
Nitin Jonathan Myers,
Yanki Aslan,
Geethu Joseph
Abstract:
Phased arrays in near-field communication allow the transmitter to focus wireless signals in a small region around the receiver. Proper focusing is achieved by carefully tuning the phase shifts and the polarization of the signals transmitted from the phased array. In this paper, we study the impact of polarization on near-field focusing and investigate the use of dynamic polarization control (DPC)…
▽ More
Phased arrays in near-field communication allow the transmitter to focus wireless signals in a small region around the receiver. Proper focusing is achieved by carefully tuning the phase shifts and the polarization of the signals transmitted from the phased array. In this paper, we study the impact of polarization on near-field focusing and investigate the use of dynamic polarization control (DPC) phased arrays in this context. Our studies indicate that the optimal polarization configuration for near-field focusing varies spatially across the antenna array. Such a spatial variation motivates the need for DPC phased arrays which allow independent polarization control across different antennas. We show using simulations that DPC phased arrays in the near-field achieve a higher received signal-to-noise ratio than conventional switched- or dual-polarization phased arrays.
△ Less
Submitted 20 May, 2022;
originally announced May 2022.
-
Precise Stock Price Prediction for Robust Portfolio Design from Selected Sectors of the Indian Stock Market
Authors:
Jaydip Sen,
Ashwin Kumar R S,
Geetha Joseph,
Kaushik Muthukrishnan,
Koushik Tulasi,
Praveen Varukolu
Abstract:
Stock price prediction is a challenging task and a lot of propositions exist in the literature in this area. Portfolio construction is a process of choosing a group of stocks and investing in them optimally to maximize the return while minimizing the risk. Since the time when Markowitz proposed the Modern Portfolio Theory, several advancements have happened in the area of building efficient portfo…
▽ More
Stock price prediction is a challenging task and a lot of propositions exist in the literature in this area. Portfolio construction is a process of choosing a group of stocks and investing in them optimally to maximize the return while minimizing the risk. Since the time when Markowitz proposed the Modern Portfolio Theory, several advancements have happened in the area of building efficient portfolios. An investor can get the best benefit out of the stock market if the investor invests in an efficient portfolio and could take the buy or sell decision in advance, by estimating the future asset value of the portfolio with a high level of precision. In this project, we have built an efficient portfolio and to predict the future asset value by means of individual stock price prediction of the stocks in the portfolio. As part of building an efficient portfolio we have studied multiple portfolio optimization methods beginning with the Modern Portfolio theory. We have built the minimum variance portfolio and optimal risk portfolio for all the five chosen sectors by using past daily stock prices over the past five years as the training data, and have also conducted back testing to check the performance of the portfolio. A comparative study of minimum variance portfolio and optimal risk portfolio with equal weight portfolio is done by backtesting.
△ Less
Submitted 14 January, 2022;
originally announced January 2022.
-
Temporal Detection of Anomalies via Actor-Critic Based Controlled Sensing
Authors:
Geethu Joseph,
M. Cenk Gursoy,
Pramod K. Varshney
Abstract:
We address the problem of monitoring a set of binary stochastic processes and generating an alert when the number of anomalies among them exceeds a threshold. For this, the decision-maker selects and probes a subset of the processes to obtain noisy estimates of their states (normal or anomalous). Based on the received observations, the decisionmaker first determines whether to declare that the num…
▽ More
We address the problem of monitoring a set of binary stochastic processes and generating an alert when the number of anomalies among them exceeds a threshold. For this, the decision-maker selects and probes a subset of the processes to obtain noisy estimates of their states (normal or anomalous). Based on the received observations, the decisionmaker first determines whether to declare that the number of anomalies has exceeded the threshold or to continue taking observations. When the decision is to continue, it then decides whether to collect observations at the next time instant or defer it to a later time. If it chooses to collect observations, it further determines the subset of processes to be probed. To devise this three-step sequential decision-making process, we use a Bayesian formulation wherein we learn the posterior probability on the states of the processes. Using the posterior probability, we construct a Markov decision process and solve it using deep actor-critic reinforcement learning. Via numerical experiments, we demonstrate the superior performance of our algorithm compared to the traditional model-based algorithms.
△ Less
Submitted 16 June, 2023; v1 submitted 3 January, 2022;
originally announced January 2022.
-
Scalable and Decentralized Algorithms for Anomaly Detection via Learning-Based Controlled Sensing
Authors:
Geethu Joseph,
Chen Zhong,
M. Cenk Gursoy,
Senem Velipasalar,
Pramod K. Varshney
Abstract:
We address the problem of sequentially selecting and observing processes from a given set to find the anomalies among them. The decision-maker observes a subset of the processes at any given time instant and obtains a noisy binary indicator of whether or not the corresponding process is anomalous. In this setting, we develop an anomaly detection algorithm that chooses the processes to be observed…
▽ More
We address the problem of sequentially selecting and observing processes from a given set to find the anomalies among them. The decision-maker observes a subset of the processes at any given time instant and obtains a noisy binary indicator of whether or not the corresponding process is anomalous. In this setting, we develop an anomaly detection algorithm that chooses the processes to be observed at a given time instant, decides when to stop taking observations, and declares the decision on anomalous processes. The objective of the detection algorithm is to identify the anomalies with an accuracy exceeding the desired value while minimizing the delay in decision making. We devise a centralized algorithm where the processes are jointly selected by a common agent as well as a decentralized algorithm where the decision of whether to select a process is made independently for each process. Our algorithms rely on a Markov decision process defined using the marginal probability of each process being normal or anomalous, conditioned on the observations. We implement the detection algorithms using the deep actor-critic reinforcement learning framework. Unlike prior work on this topic that has exponential complexity in the number of processes, our algorithms have computational and memory requirements that are both polynomial in the number of processes. We demonstrate the efficacy of these algorithms using numerical experiments by comparing them with state-of-the-art methods.
△ Less
Submitted 8 December, 2021;
originally announced December 2021.
-
A Scalable Algorithm for Anomaly Detection via Learning-Based Controlled Sensing
Authors:
Geethu Joseph,
M. Cenk Gursoy,
Pramod K. Varshney
Abstract:
We address the problem of sequentially selecting and observing processes from a given set to find the anomalies among them. The decision-maker observes one process at a time and obtains a noisy binary indicator of whether or not the corresponding process is anomalous. In this setting, we develop an anomaly detection algorithm that chooses the process to be observed at a given time instant, decides…
▽ More
We address the problem of sequentially selecting and observing processes from a given set to find the anomalies among them. The decision-maker observes one process at a time and obtains a noisy binary indicator of whether or not the corresponding process is anomalous. In this setting, we develop an anomaly detection algorithm that chooses the process to be observed at a given time instant, decides when to stop taking observations, and makes a decision regarding the anomalous processes. The objective of the detection algorithm is to arrive at a decision with an accuracy exceeding a desired value while minimizing the delay in decision making. Our algorithm relies on a Markov decision process defined using the marginal probability of each process being normal or anomalous, conditioned on the observations. We implement the detection algorithm using the deep actor-critic reinforcement learning framework. Unlike prior work on this topic that has exponential complexity in the number of processes, our algorithm has computational and memory requirements that are both polynomial in the number of processes. We demonstrate the efficacy of our algorithm using numerical experiments by comparing it with the state-of-the-art methods.
△ Less
Submitted 12 May, 2021;
originally announced May 2021.
-
Anomaly Detection via Controlled Sensing and Deep Active Inference
Authors:
Geethu Joseph,
Chen Zhong,
M. Cenk Gursoy,
Senem Velipasalar,
Pramod K. Varshney
Abstract:
In this paper, we address the anomaly detection problem where the objective is to find the anomalous processes among a given set of processes. To this end, the decision-making agent probes a subset of processes at every time instant and obtains a potentially erroneous estimate of the binary variable which indicates whether or not the corresponding process is anomalous. The agent continues to probe…
▽ More
In this paper, we address the anomaly detection problem where the objective is to find the anomalous processes among a given set of processes. To this end, the decision-making agent probes a subset of processes at every time instant and obtains a potentially erroneous estimate of the binary variable which indicates whether or not the corresponding process is anomalous. The agent continues to probe the processes until it obtains a sufficient number of measurements to reliably identify the anomalous processes. In this context, we develop a sequential selection algorithm that decides which processes to be probed at every instant to detect the anomalies with an accuracy exceeding a desired value while minimizing the delay in making the decision and the total number of measurements taken. Our algorithm is based on active inference which is a general framework to make sequential decisions in order to maximize the notion of free energy. We define the free energy using the objectives of the selection policy and implement the active inference framework using a deep neural network approximation. Using numerical experiments, we compare our algorithm with the state-of-the-art method based on deep actor-critic reinforcement learning and demonstrate the superior performance of our algorithm.
△ Less
Submitted 12 May, 2021;
originally announced May 2021.
-
Cosmology with variable $G$ and nonlinear electrodynamics
Authors:
Gabriel W. Joseph,
Ali Övgün
Abstract:
In a bid to resolve lingering problems in cosmology, more focus is being tilted towards cosmological models in which physical constants of nature are not necessarily real constants but vary with cosmic time. In this paper, we study a cosmological model in nonlinear electrodynamics with Newton's gravitational constant $G$, which is not a constant but varies in terms of a power law of the scale fact…
▽ More
In a bid to resolve lingering problems in cosmology, more focus is being tilted towards cosmological models in which physical constants of nature are not necessarily real constants but vary with cosmic time. In this paper, we study a cosmological model in nonlinear electrodynamics with Newton's gravitational constant $G$, which is not a constant but varies in terms of a power law of the scale factor of the universe. Hence, the evolution of the scale factor $a(t)$ is studied in this model, which depends on a fine-tuning term of nonlinear electrodynamics, $α$. Finally, we verify the stability of the model using the speed of sound.
△ Less
Submitted 21 April, 2021;
originally announced April 2021.
-
Anomaly Detection Under Controlled Sensing Using Actor-Critic Reinforcement Learning
Authors:
Geethu Joseph,
M. Cenk Gursoy,
Pramod K. Varshney
Abstract:
We consider the problem of detecting anomalies among a given set of processes using their noisy binary sensor measurements. The noiseless sensor measurement corresponding to a normal process is 0, and the measurement is 1 if the process is anomalous. The decision-making algorithm is assumed to have no knowledge of the number of anomalous processes. The algorithm is allowed to choose a subset of th…
▽ More
We consider the problem of detecting anomalies among a given set of processes using their noisy binary sensor measurements. The noiseless sensor measurement corresponding to a normal process is 0, and the measurement is 1 if the process is anomalous. The decision-making algorithm is assumed to have no knowledge of the number of anomalous processes. The algorithm is allowed to choose a subset of the sensors at each time instant until the confidence level on the decision exceeds the desired value. Our objective is to design a sequential sensor selection policy that dynamically determines which processes to observe at each time and when to terminate the detection algorithm. The selection policy is designed such that the anomalous processes are detected with the desired confidence level while incurring minimum cost which comprises the delay in detection and the cost of sensing. We cast this problem as a sequential hypothesis testing problem within the framework of Markov decision processes, and solve it using the actor-critic deep reinforcement learning algorithm. This deep neural network-based algorithm offers a low complexity solution with good detection accuracy. We also study the effect of statistical dependence between the processes on the algorithm performance. Through numerical experiments, we show that our algorithm is able to adapt to any unknown statistical dependence pattern of the processes.
△ Less
Submitted 26 May, 2020;
originally announced June 2020.
-
Output Controllability of a Linear Dynamical System with Sparse Controls
Authors:
Geethu Joseph
Abstract:
In this paper, we study the conditions to be satisfied by a discrete-time linear system to ensure output controllability using sparse control inputs. A set of necessary and sufficient conditions can be directly obtained by extending the Kalman rank test for output controllability. However, the verification of these conditions is computationally heavy due to their combinatorial nature. Therefore, w…
▽ More
In this paper, we study the conditions to be satisfied by a discrete-time linear system to ensure output controllability using sparse control inputs. A set of necessary and sufficient conditions can be directly obtained by extending the Kalman rank test for output controllability. However, the verification of these conditions is computationally heavy due to their combinatorial nature. Therefore, we derive non-combinatorial conditions for output sparse controllability which can be verified with polynomial time complexity. Our results also provide bounds on the minimum sparsity level required to ensure output controllability of the system. This additional insight is useful for designing sparse control input that drives the system to any desired output.
△ Less
Submitted 15 January, 2022; v1 submitted 24 May, 2020;
originally announced May 2020.
-
Measurement Bounds for Compressed Sensing in Sensor Networks with Missing Data
Authors:
Geethu Joseph,
Pramod K. Varshney
Abstract:
In this paper, we study the problem of sparse vector recovery at the fusion center of a sensor network from linear sensor measurements when there is missing data. In the presence of missing data, the random sampling approach employed in compressed sensing is known to provide excellent reconstruction accuracy. However, when there is missing data, the theoretical guarantees associated with sparse re…
▽ More
In this paper, we study the problem of sparse vector recovery at the fusion center of a sensor network from linear sensor measurements when there is missing data. In the presence of missing data, the random sampling approach employed in compressed sensing is known to provide excellent reconstruction accuracy. However, when there is missing data, the theoretical guarantees associated with sparse recovery have not been well studied. Therefore, in this paper, we derive an upper bound on the minimum number of measurements required to ensure faithful recovery of a sparse signal when the generation of missing data is modeled using a Bernoulli erasure channel. We analyze three different network topologies, namely, star, (relay aided-)tree, and serial-star topologies. Our analysis establishes how the minimum required number of measurements for recovery scales with the network parameters, the properties of the measurement matrix, and the recovery algorithm. Finally, through numerical simulations, we show the variation of the minimum required number of measurements with different system parameters and validate our theoretical results.
△ Less
Submitted 5 April, 2020;
originally announced April 2020.
-
Controllability of Network Opinion in Erdos-Renyi Graphs using Sparse Control Inputs
Authors:
Geethu Joseph,
Buddhika Nettasinghe,
Vikram Krishnamurthy,
Pramod Varshney
Abstract:
This paper considers a social network modeled as an Erdos Renyi random graph. Each individual in the network updates her opinion using the weighted average of the opinions of her neighbors. We explore how an external manipulative agent can drive the opinions of these individuals to a desired state with a limited additive influence on their innate opinions. We show that the manipulative agent can s…
▽ More
This paper considers a social network modeled as an Erdos Renyi random graph. Each individual in the network updates her opinion using the weighted average of the opinions of her neighbors. We explore how an external manipulative agent can drive the opinions of these individuals to a desired state with a limited additive influence on their innate opinions. We show that the manipulative agent can steer the network opinion to any arbitrary value in finite time (i.e., the system is controllable) almost surely when there is no restriction on her influence. However, when the control input is sparsity constrained, the network opinion is controllable with some probability. We lower bound this probability using the concentration properties of random vectors based on the Levy concentration function and small ball probabilities. Further, through numerical simulations, we compare the probability of controllability in Erdos Renyi graphs with that of power-law graphs to illustrate the key differences between the two models in terms of controllability. Our theoretical and numerical results shed light on how controllability of the network opinion depends on the parameters such as the size and the connectivity of the network, and the sparsity constraints faced by the manipulative agent.
△ Less
Submitted 21 November, 2020; v1 submitted 28 March, 2020;
originally announced March 2020.
-
Controllability of a Linear System with Nonnegative Sparse Controls
Authors:
Geethu Joseph
Abstract:
This paper studies controllability of a discrete-time linear dynamical system using nonnegative and sparse inputs. These constraints on the control input arise naturally in many real-life systems where the external influence on the system is unidirectional, and activating each input node adds to the cost of control. We derive the necessary and sufficient conditions for controllability of the syste…
▽ More
This paper studies controllability of a discrete-time linear dynamical system using nonnegative and sparse inputs. These constraints on the control input arise naturally in many real-life systems where the external influence on the system is unidirectional, and activating each input node adds to the cost of control. We derive the necessary and sufficient conditions for controllability of the system, without imposing any constraints on the system matrices. Unlike the well-known Kalman rank based controllability criteria, the conditions presented in this paper can be verified in polynomial time, and the verification complexity is independent of the sparsity level. The proof of the result is based on the analytical tools concerning the properties of a convex cone. Our results also provide a closed-form expression for the minimum number of control nodes to be activated at every time instant to ensure controllability of the system using positive controls.
△ Less
Submitted 22 April, 2020; v1 submitted 10 February, 2020;
originally announced February 2020.
-
Controllability of Linear Dynamical Systems Under Input Sparsity Constraints
Authors:
Geethu Joseph,
Chandra R. Murthy
Abstract:
In this work, we consider the controllability of a discrete-time linear dynamical system with sparse control inputs. Sparsity constraints on the input arises naturally in networked systems, where activating each input variable adds to the cost of control. We derive algebraic necessary and sufficient conditions for ensuring controllability of a system with an arbitrary transfer matrix. The derived…
▽ More
In this work, we consider the controllability of a discrete-time linear dynamical system with sparse control inputs. Sparsity constraints on the input arises naturally in networked systems, where activating each input variable adds to the cost of control. We derive algebraic necessary and sufficient conditions for ensuring controllability of a system with an arbitrary transfer matrix. The derived conditions can be verified in polynomial time complexity, unlike the more traditional Kalman-type rank tests. Further, we characterize the minimum number of input vectors required to satisfy the derived conditions for controllability. Finally, we present a generalized Kalman decomposition-like procedure that separates the state-space into subspaces corresponding to sparse-controllable and sparse-uncontrollable parts. These results form a theoretical basis for designing networked linear control systems with sparse inputs.
△ Less
Submitted 27 December, 2019;
originally announced December 2019.
-
Effective Bounds on Network-Size for Anti-phase Synchronization
Authors:
George Vathakkattil Joseph,
Vikram Pakrashi
Abstract:
We consider anti-phase synchronization of coupled oscillators using the Stuart-Landau model and explore its relative infrequency in occurrence compared to in-phase synchronization. We report effective limits in number of oscillators which can anti-phase synchronize for general configurations of real-world networks. We link anti-phase synchronization to the Ising model and consequently to combinato…
▽ More
We consider anti-phase synchronization of coupled oscillators using the Stuart-Landau model and explore its relative infrequency in occurrence compared to in-phase synchronization. We report effective limits in number of oscillators which can anti-phase synchronize for general configurations of real-world networks. We link anti-phase synchronization to the Ising model and consequently to combinatorial optimization problems, thereby explaining experimentally observed limits in self-organization of natural systems. We illustrate this using the Steiner-tree problem.
△ Less
Submitted 20 August, 2019;
originally announced August 2019.
-
An Online Prediction Algorithm for Reinforcement Learning with Linear Function Approximation using Cross Entropy Method
Authors:
A** George Joseph,
Shalabh Bhatnagar
Abstract:
In this paper, we provide two new stable online algorithms for the problem of prediction in reinforcement learning, \emph{i.e.}, estimating the value function of a model-free Markov reward process using the linear function approximation architecture and with memory and computation costs scaling quadratically in the size of the feature set. The algorithms employ the multi-timescale stochastic appro…
▽ More
In this paper, we provide two new stable online algorithms for the problem of prediction in reinforcement learning, \emph{i.e.}, estimating the value function of a model-free Markov reward process using the linear function approximation architecture and with memory and computation costs scaling quadratically in the size of the feature set. The algorithms employ the multi-timescale stochastic approximation variant of the very popular cross entropy (CE) optimization method which is a model based search method to find the global optimum of a real-valued function. A proof of convergence of the algorithms using the ODE method is provided. We supplement our theoretical results with experimental comparisons. The algorithms achieve good performance fairly consistently on many RL benchmark problems with regards to computational efficiency, accuracy and stability.
△ Less
Submitted 15 June, 2018;
originally announced June 2018.
-
A Cross Entropy based Optimization Algorithm with Global Convergence Guarantees
Authors:
A** George Joseph,
Shalabh Bhatnagar
Abstract:
The cross entropy (CE) method is a model based search method to solve optimization problems where the objective function has minimal structure. The Monte-Carlo version of the CE method employs the naive sample averaging technique which is inefficient, both computationally and space wise. We provide a novel stochastic approximation version of the CE method, where the sample averaging is replaced wi…
▽ More
The cross entropy (CE) method is a model based search method to solve optimization problems where the objective function has minimal structure. The Monte-Carlo version of the CE method employs the naive sample averaging technique which is inefficient, both computationally and space wise. We provide a novel stochastic approximation version of the CE method, where the sample averaging is replaced with incremental geometric averaging. This approach can save considerable computational and storage costs. Our algorithm is incremental in nature and possesses additional attractive features such as accuracy, stability, robustness and convergence to the global optimum for a particular class of objective functions. We evaluate the algorithm on a variety of global optimization benchmark problems and the results obtained corroborate our theoretical findings.
△ Less
Submitted 30 January, 2018;
originally announced January 2018.
-
An Incremental Off-policy Search in a Model-free Markov Decision Process Using a Single Sample Path
Authors:
A** George Joseph,
Shalabh Bhatnagar
Abstract:
In this paper, we consider a modified version of the control problem in a model free Markov decision process (MDP) setting with large state and action spaces. The control problem most commonly addressed in the contemporary literature is to find an optimal policy which maximizes the value function, i.e., the long run discounted reward of the MDP. The current settings also assume access to a generat…
▽ More
In this paper, we consider a modified version of the control problem in a model free Markov decision process (MDP) setting with large state and action spaces. The control problem most commonly addressed in the contemporary literature is to find an optimal policy which maximizes the value function, i.e., the long run discounted reward of the MDP. The current settings also assume access to a generative model of the MDP with the hidden premise that observations of the system behaviour in the form of sample trajectories can be obtained with ease from the model. In this paper, we consider a modified version, where the cost function is the expectation of a non-convex function of the value function without access to the generative model. Rather, we assume that a sample trajectory generated using a priori chosen behaviour policy is made available. In this restricted setting, we solve the modified control problem in its true sense, i.e., to find the best possible policy given this limited information. We propose a stochastic approximation algorithm based on the well-known cross entropy method which is data (sample trajectory) efficient, stable, robust as well as computationally and storage efficient. We provide a proof of convergence of our algorithm to a policy which is globally optimal relative to the behaviour policy. We also present experimental results to corroborate our claims and we demonstrate the superiority of the solution produced by our algorithm compared to the state-of-the-art algorithms under appropriately chosen behaviour policy.
△ Less
Submitted 30 January, 2018;
originally announced January 2018.
-
Extreme Value Estimates using Vibration Energy Harvesting
Authors:
George Vathakkattil Joseph,
Guangbo Hao,
Vikram Pakrashi
Abstract:
This paper establishes the possibility of utilising energy harvesting from mechanical vibrations to estimate extreme value responses of the host structure and demonstrates the calibration of these estimates for excitation spectra typical to natural systems. For illustrative purposes, a cantilever type energy harvester is considered for wind excitation. The extreme value estimates are established t…
▽ More
This paper establishes the possibility of utilising energy harvesting from mechanical vibrations to estimate extreme value responses of the host structure and demonstrates the calibration of these estimates for excitation spectra typical to natural systems. For illustrative purposes, a cantilever type energy harvester is considered for wind excitation. The extreme value estimates are established through a Generalised Pareto Distribution (GPD). Classically well-known Kaimal and Davenport spectra for wind have been considered in this paper for comparison purposes. The work also demonstrates how return levels can be mapped using energy harvesting levels and indicates that vibration energy harvesting, in its own right has the potential to be used for extreme value analysis and estimates. The work has impact on health monitoring and assessment of built infrastructure in various stages of repair or disrepair and exposed to nature throughout their lifetime.
△ Less
Submitted 7 September, 2017;
originally announced September 2017.
-
A Cross Entropy based Stochastic Approximation Algorithm for Reinforcement Learning with Linear Function Approximation
Authors:
A** George Joseph,
Shalabh Bhatnagar
Abstract:
In this paper, we provide a new algorithm for the problem of prediction in Reinforcement Learning, \emph{i.e.}, estimating the Value Function of a Markov Reward Process (MRP) using the linear function approximation architecture, with memory and computation costs scaling quadratically in the size of the feature set. The algorithm is a multi-timescale variant of the very popular Cross Entropy (CE) m…
▽ More
In this paper, we provide a new algorithm for the problem of prediction in Reinforcement Learning, \emph{i.e.}, estimating the Value Function of a Markov Reward Process (MRP) using the linear function approximation architecture, with memory and computation costs scaling quadratically in the size of the feature set. The algorithm is a multi-timescale variant of the very popular Cross Entropy (CE) method which is a model based search method to find the global optimum of a real-valued function. This is the first time a model based search method is used for the prediction problem. The application of CE to a stochastic setting is a completely unexplored domain. A proof of convergence using the ODE method is provided. The theoretical results are supplemented with experimental comparisons. The algorithm achieves good performance fairly consistently on many RL benchmark problems. This demonstrates the competitiveness of our algorithm against least squares and other state-of-the-art algorithms in terms of computational efficiency, accuracy and stability.
△ Less
Submitted 29 September, 2016;
originally announced September 2016.
-
Fabrication of Flexible Super Capacitor Using Laser Lightscribe Technique
Authors:
Gladson Joseph,
A. Alfred Kirubaraj,
U. Satheesh,
D. Devaprakasam
Abstract:
Super capacitors are promising energy storage devices due to their capability of delivering high peak current and storing high amount of energy in a short time with very low internal power loss. We fabricated the graphene or graphite oxide super-capacitor using laser Lightscribe technique. We prepared graphite oxide by modified hummers method and used PET film as a flexible substrate on which grap…
▽ More
Super capacitors are promising energy storage devices due to their capability of delivering high peak current and storing high amount of energy in a short time with very low internal power loss. We fabricated the graphene or graphite oxide super-capacitor using laser Lightscribe technique. We prepared graphite oxide by modified hummers method and used PET film as a flexible substrate on which graphite oxide (GO) was coated. Using Lightscribe drive and software, the super-capacitor configuration was patterned on the GO coated PET film. During the writing process, the laser converts GO into graphene. We characterized the fabricated flexible super-capacitor which exhibits high resistance of 20KOhm with applied voltage of 10V and further increase of voltage (20V) decreases the resistance to 8KOhm. We also analyzed the frequency response of the capacitor using impedance measurement which shows high frequency response and estimated capacitance is 120nF. We optimized the patterns by running the Lightscribe repeatedly on the GO coated PET substrate.
△ Less
Submitted 22 September, 2014;
originally announced September 2014.
-
Fine structure in the α-decay of odd-even nuclei
Authors:
K. P. Santhosh,
Jayesh George Joseph,
B. Priyanka
Abstract:
Systematic study on α-decay fine structure is presented for the first time in the case of odd-even nuclei in the range 83 \leq Z \leq 101. The model used for the study is the recently proposed Coulomb and proximity potential model for deformed nuclei (CPPMDN), which employs deformed Coulomb potential, deformed two term proximity potential and centrifugal potential. The computed partial half lives,…
▽ More
Systematic study on α-decay fine structure is presented for the first time in the case of odd-even nuclei in the range 83 \leq Z \leq 101. The model used for the study is the recently proposed Coulomb and proximity potential model for deformed nuclei (CPPMDN), which employs deformed Coulomb potential, deformed two term proximity potential and centrifugal potential. The computed partial half lives, total half lives and branching ratios are compared with experimental data and are in good agreement. The standard deviation of partial half-life is 1.08 and that for branching ratio is 1.21. Our formalism is also successful in predicting angular momentum hindered and structure hindered transitions. The present study reveals that CPPMDN is a unified theory which is successful in explaining alpha decay from ground and isomeric state; and alpha fine structure of even-even, even-odd and odd-even nuclei. Our study relights that the differences in the parent and daughter surfaces or the changes in the deformation parameters as well as the shell structure of the parent and daughter nuclei, influences the alpha decay probability.
△ Less
Submitted 4 February, 2012;
originally announced February 2012.
-
Stokes' Cradle: Normal Three-Body Collisions between Wetted Particles
Authors:
C. M. Donahue,
C. M. Hrenya,
R. H. Davis,
K. J. Nakagawa,
A. P. Zelinskaya,
G. G. Joseph
Abstract:
In this work, a combination of experiments and theory is used to investigate three-body, normal collisions between solid particles with a liquid coating (i.e., "wetted" particles). Experiments are carried out using a Stokes' cradle, an apparatus inspired by the Newton's cradle desktop toy except with wetted particles. Unlike previous work on two-body systems, which may either agglomerate or rebo…
▽ More
In this work, a combination of experiments and theory is used to investigate three-body, normal collisions between solid particles with a liquid coating (i.e., "wetted" particles). Experiments are carried out using a Stokes' cradle, an apparatus inspired by the Newton's cradle desktop toy except with wetted particles. Unlike previous work on two-body systems, which may either agglomerate or rebound upon collision, four outcomes are possible in three-body systems: fully agglomerated, Newton's cradle (striker and target particle it strikes agglomerate), reverse Newton's cradle (targets agglomerate while striker separates), and fully separated. Post-collisional velocities are measured over a range of parameters. For all experiments, as the impact velocity increases, the progression of outcomes observed is fully agglomerated, reverse Newton's cradle, and fully separated. Notably, as the viscosity of the oil increases, experiments reveal a decrease in the critical Stokes number (the Stokes number that demarcates a transition from agglomeration to separation) for both sets of adjacent particles. A scaling theory is developed based on lubrication forces and particle deformation and elasticity. Unlike previous work for two-particle systems, two pieces of physics are found to be critical in the prediction of a regime map that is consistent with experiments: (i) an additional resistance upon rebound of the target particles due to the pre-existing liquid bridge between them (which has no counterpart in two-particle collisions), and (ii) the addition of a rebound criterion due to glass transition of the liquid layer at high pressure between colliding particles.
△ Less
Submitted 21 December, 2009; v1 submitted 18 December, 2009;
originally announced December 2009.
