-
Round Robin Active Sequential Change Detection for Dependent Multi-Channel Data
Authors:
Anamitra Chaudhuri,
Georgios Fellouris,
Ali Tajer
Abstract:
This paper considers the problem of sequentially detecting a change in the joint distribution of multiple data sources under a sampling constraint. Specifically, the channels or sources generate observations that are independent over time, but not necessarily independent at any given time instant. The sources follow an initial joint distribution, and at an unknown time instant, the joint distribut…
▽ More
This paper considers the problem of sequentially detecting a change in the joint distribution of multiple data sources under a sampling constraint. Specifically, the channels or sources generate observations that are independent over time, but not necessarily independent at any given time instant. The sources follow an initial joint distribution, and at an unknown time instant, the joint distribution of an unknown subset of sources changes. Importantly, there is a hard constraint that only a fixed number of sources are allowed to be sampled at each time instant. The goal is to sequentially observe the sources according to the constraint, and stop sampling as quickly as possible after the change while controlling the false alarm rate below a user-specified level. The sources can be selected dynamically based on the already collected data, and thus, a policy for this problem consists of a joint sampling and change-detection rule. A non-randomized policy is studied, and an upper bound is established on its worst-case conditional expected detection delay with respect to both the change point and the observations from the affected sources before the change.
△ Less
Submitted 24 March, 2024;
originally announced March 2024.
-
Quickest Change Detection with Controlled Sensing
Authors:
Venugopal V. Veeravalli,
Georgios Fellouris,
George V. Moustakides
Abstract:
In the problem of quickest change detection, a change occurs at some unknown time in the distribution of a sequence of random vectors that are monitored in real time, and the goal is to detect this change as quickly as possible subject to a certain false alarm constraint. In this work we consider this problem in the presence of parametric uncertainty in the post-change regime and controlled sensin…
▽ More
In the problem of quickest change detection, a change occurs at some unknown time in the distribution of a sequence of random vectors that are monitored in real time, and the goal is to detect this change as quickly as possible subject to a certain false alarm constraint. In this work we consider this problem in the presence of parametric uncertainty in the post-change regime and controlled sensing. That is, the post-change distribution contains an unknown parameter, and the distribution of each observation, before and after the change, is affected by a control action. In this context, in addition to a stop** rule that determines the time at which it is declared that the change has occurred, one also needs to determine a sequential control policy, which chooses the control action at each time based on the already collected observations. We formulate this problem mathematically using Lorden's minimax criterion, and assuming that there are finitely many possible actions and post-change parameter values. We then propose a specific procedure for this problem that employs an adaptive CuSum statistic in which (i) the estimate of the parameter is based on a fixed number of the more recent observations, and (ii) each action is selected to maximize the Kullback-Leibler divergence of the next observation based on the current parameter estimate, apart from a small number of exploration times. We show that this procedure, which we call the Windowed Chernoff-CuSum (WCC), is first-order asymptotically optimal under Lorden's minimax criterion, for every possible possible value of the unknown post-change parameter, as the mean time to false alarm goes to infinity. We also provide simulation results to illustrate the performance of the WCC procedure.
△ Less
Submitted 26 October, 2023;
originally announced October 2023.
-
Worst-Case Misidentification Control in Sequential Change Diagnosis using the min-CuSum
Authors:
Austin Warner,
Georgios Fellouris
Abstract:
The problem of sequential change diagnosis is considered, where a sequence of independent random elements is accessed sequentially, there is an abrupt change in its distribution at some unknown time, and there are two main operational goals: to quickly detect the change and, upon stop**, to accurately identify the post-change distribution among a finite set of alternatives. The algorithm that ra…
▽ More
The problem of sequential change diagnosis is considered, where a sequence of independent random elements is accessed sequentially, there is an abrupt change in its distribution at some unknown time, and there are two main operational goals: to quickly detect the change and, upon stop**, to accurately identify the post-change distribution among a finite set of alternatives. The algorithm that raises an alarm as soon as the CuSum statistic that corresponds to one of the post-change alternatives exceeds a certain threshold is studied. When the data are generated over independent channels and the change can occur in only one of them, its worst-case with respect to the change point conditional probability of misidentification, given that there was not a false alarm, is shown to decay exponentially fast in the threshold. As a corollary, in this setup, this algorithm is shown to asymptotically minimize Lorden's detection delay criterion, simultaneously for every possible post-change distribution, within the class of schemes that satisfy prescribed bounds on the false alarm rate and the worst-case conditional probability of misidentification, as the former goes to zero sufficiently faster than the latter. Finally, these theoretical results are also illustrated in simulation studies.
△ Less
Submitted 1 October, 2023;
originally announced October 2023.
-
Asymptotically optimal sequential anomaly identification with ordering sampling rules
Authors:
Aristomenis Tsopelakos,
Georgios Fellouris
Abstract:
The problem of sequential anomaly detection and identification is considered in the presence of a sampling constraint. Specifically, multiple data streams are generated by distinct sources and the goal is to quickly identify those that exhibit ``anomalous'' behavior, when it is not possible to sample every source at each time instant. Thus, in addition to a stop** rule, which determines when to…
▽ More
The problem of sequential anomaly detection and identification is considered in the presence of a sampling constraint. Specifically, multiple data streams are generated by distinct sources and the goal is to quickly identify those that exhibit ``anomalous'' behavior, when it is not possible to sample every source at each time instant. Thus, in addition to a stop** rule, which determines when to stop sampling, and a decision rule, which indicates which sources to identify as anomalous upon stop**, one needs to specify a sampling rule that determines which sources to sample at each time instant. The focus of this work is on ordering sampling rules, which sample the data sources, among those currently estimated as anomalous (resp. non-anomalous), for which the corresponding local test statistics have the smallest (resp. largest) values. It is shown that with an appropriate design, which is specified explicitly, an ordering sampling rule leads to the optimal expected time for stop**, among all policies that satisfy the same sampling and error constraints, to a first-order asymptotic approximation as the false positive and false negative error rates under control both go to zero. This is the first asymptotic optimality result for ordering sampling rules when multiple sources can be sampled per time instant. Moreover, this is established under a general setup where the number of anomalies is not required to be a priori known. A novel proof technique is introduced, which unifies different versions of the problem regarding the homogeneity of the sources and prior information on the number of anomalies.
△ Less
Submitted 25 September, 2023;
originally announced September 2023.
-
Asymptotically Optimal Sequential Multiple Testing with Asynchronous Decisions
Authors:
Yiming Xing,
Georgios Fellouris
Abstract:
The problem of simultaneously testing the marginal distributions of sequentially monitored, independent data streams is considered. The decisions for the various testing problems can be made at different times, using data from all streams, which can be monitored until all decisions have been made. Moreover, arbitrary a priori bounds are assumed on the number of signals, i.e., data streams in which…
▽ More
The problem of simultaneously testing the marginal distributions of sequentially monitored, independent data streams is considered. The decisions for the various testing problems can be made at different times, using data from all streams, which can be monitored until all decisions have been made. Moreover, arbitrary a priori bounds are assumed on the number of signals, i.e., data streams in which the alternative hypothesis is correct. A novel sequential multiple testing procedure is proposed and it is shown to achieve the minimum expected decision time, simultaneously in every data stream and under every signal configuration, asymptotically as certain metrics of global error rates go to zero. This optimality property is established under general parametric composite hypotheses, various error metrics, and weak distributional assumptions that allow for temporal dependence. Furthermore, the limit of the factor by which the expected decision time in a data stream increases when one is limited to synchronous or decentralized procedures is evaluated. Finally, two existing sequential multiple testing procedures in the literature are compared with the proposed one in various simulation studies.
△ Less
Submitted 19 April, 2023;
originally announced April 2023.
-
Sequential Change Diagnosis Revisited and the Adaptive Matrix CuSum
Authors:
Austin Warner,
Georgios Fellouris
Abstract:
The problem of sequential change diagnosis is considered, where observations are obtained on-line, an abrupt change occurs in their distribution, and the goal is to quickly detect the change and accurately identify the post-change distribution, while controlling the false alarm rate. A finite set of alternatives is postulated for the post-change regime, but no prior information is assumed for the…
▽ More
The problem of sequential change diagnosis is considered, where observations are obtained on-line, an abrupt change occurs in their distribution, and the goal is to quickly detect the change and accurately identify the post-change distribution, while controlling the false alarm rate. A finite set of alternatives is postulated for the post-change regime, but no prior information is assumed for the unknown change-point. A drawback of many algorithms that have been proposed for this problem is the implicit use of pre-change data for determining the post-change distribution. This can lead to very large conditional probabilities of misidentification, given that there was no false alarm, unless the change occurs soon after monitoring begins. A novel, recursive algorithm is proposed and shown to resolve this issue without the use of additional tuning parameters and without sacrificing control of the worst-case delay in Lorden's sense. A theoretical analysis is conducted for a general family of sequential change diagnosis procedures, which supports the proposed algorithm and revises certain state-of-the-art results. Additionally, a novel, comprehensive method is proposed for the design and evaluation of sequential change diagnosis algorithms. This method is illustrated with simulation studies, where existing procedures are compared to the proposed.
△ Less
Submitted 23 November, 2022;
originally announced November 2022.
-
Signal Recovery With Multistage Tests And Without Sparsity Constraints
Authors:
Yiming Xing,
Georgios Fellouris
Abstract:
A signal recovery problem is considered, where the same binary testing problem is posed over multiple, independent data streams. The goal is to identify all signals, i.e., streams where the alternative hypothesis is correct, and noises, i.e., streams where the null hypothesis is correct, subject to prescribed bounds on the classical or generalized familywise error probabilities. It is not required…
▽ More
A signal recovery problem is considered, where the same binary testing problem is posed over multiple, independent data streams. The goal is to identify all signals, i.e., streams where the alternative hypothesis is correct, and noises, i.e., streams where the null hypothesis is correct, subject to prescribed bounds on the classical or generalized familywise error probabilities. It is not required that the exact number of signals be a priori known, only upper bounds on the number of signals and noises are assumed instead. A decentralized formulation is adopted, according to which the sample size and the decision for each testing problem must be based only on observations from the corresponding data stream. A novel multistage testing procedure is proposed for this problem and is shown to enjoy a high-dimensional asymptotic optimality property. Specifically, it achieves the optimal, average over all streams, expected sample size, uniformly in the true number of signals, as the maximum possible numbers of signals and noises go to infinity at arbitrary rates, in the class of all sequential tests with the same global error control. In contrast, existing multistage tests in the literature are shown to achieve this high-dimensional asymptotic optimality property only under additional sparsity or symmetry conditions. These results are based on an asymptotic analysis for the fundamental binary testing problem as the two error probabilities go to zero. For this problem, unlike existing multistage tests in the literature, the proposed test achieves the optimal expected sample size under both hypotheses, in the class of all sequential tests with the same error control, as the two error probabilities go to zero at arbitrary rates. These results are further supported by simulation studies and extended to problems with non-iid data and composite hypotheses.
△ Less
Submitted 4 November, 2022;
originally announced November 2022.
-
Joint Sequential Detection and Isolation for Dependent Data Streams
Authors:
Anamitra Chaudhuri,
Georgios Fellouris
Abstract:
The problem of joint sequential detection and isolation is considered in the context of multiple, not necessarily independent, data streams. A multiple testing framework is proposed, where each hypothesis corresponds to a different subset of data streams, the sample size is a stop** time of the observations, and the probabilities of four kinds of error are controlled below distinct, user-specifi…
▽ More
The problem of joint sequential detection and isolation is considered in the context of multiple, not necessarily independent, data streams. A multiple testing framework is proposed, where each hypothesis corresponds to a different subset of data streams, the sample size is a stop** time of the observations, and the probabilities of four kinds of error are controlled below distinct, user-specified levels. Two of these errors reflect the detection component of the formulation, whereas the other two the isolation component. The optimal expected sample size is characterized to a first-order asymptotic approximation as the error probabilities go to 0. Different asymptotic regimes, expressing different prioritizations of the detection and isolation tasks, are considered. A novel, versatile family of testing procedures is proposed, in which two distinct, in general, statistics are computed for each hypothesis, one addressing the detection task and the other the isolation task. Tests in this family, of various computational complexities, are shown to be asymptotically optimal under different setups. The general theory is applied to the detection and isolation of anomalous, not necessarily independent, data streams, as well as to the detection and isolation of an unknown dependence structure.
△ Less
Submitted 30 June, 2022;
originally announced July 2022.
-
3-stage and 4-stage tests with deterministic stage sizes and non-iid data
Authors:
Yiming Xing,
Georgios Fellouris
Abstract:
Given a fixed-sample-size test that controls the error probabilities under two specific, but arbitrary, distributions, a 3-stage and two 4-stage tests are proposed and analyzed. For each of them, a novel, concrete, non-asymptotic, non-conservative design is specified, which guarantees the same error control as the given fixed-sample-size test. Moreover, first-order asymptotic approximation are est…
▽ More
Given a fixed-sample-size test that controls the error probabilities under two specific, but arbitrary, distributions, a 3-stage and two 4-stage tests are proposed and analyzed. For each of them, a novel, concrete, non-asymptotic, non-conservative design is specified, which guarantees the same error control as the given fixed-sample-size test. Moreover, first-order asymptotic approximation are established on their expected sample sizes under the two prescribed distributions as the error probabilities go to zero. As a corollary, it is shown that the proposed multistage tests can achieve, in this asymptotic sense, the optimal expected sample size under these two distributions in the class of all sequential tests with the same error control. Furthermore, they are shown to be much more robust than Wald's SPRT when applied to one-sided testing problems and the error probabilities under control are small enough. These general results are applied to testing problems in the iid setup and beyond, such as testing the correlation coefficient of a first-order autoregression, or the transition matrix of a finite-state Markov chain, and are illustrated in various numerical studies.
△ Less
Submitted 23 June, 2022; v1 submitted 19 June, 2022;
originally announced June 2022.
-
Sequential anomaly detection with sampling constraints
Authors:
Aristomenis Tsopelakos,
Georgios Fellouris
Abstract:
The problem of sequential anomaly detection is considered, where multiple data sources are monitored in real time and the goal is to identify the "anomalous" ones among them, when it is not possible to sample all sources at all times. A detection scheme in this context requires specifying not only when to stop sampling and which sources to identify as anomalous upon stop**, but also which source…
▽ More
The problem of sequential anomaly detection is considered, where multiple data sources are monitored in real time and the goal is to identify the "anomalous" ones among them, when it is not possible to sample all sources at all times. A detection scheme in this context requires specifying not only when to stop sampling and which sources to identify as anomalous upon stop**, but also which sources to sample at each time instance until stop**. A novel formulation for this problem is proposed, in which the number of anomalous sources is not necessarily known in advance and the number of sampled sources per time instance is not necessarily fixed. Instead, an arbitrary lower bound and an arbitrary upper bound are assumed on the number of anomalous sources, and the fraction of the expected number of samples over the expected time until stop** is required to not exceed an arbitrary, user-specified level. In addition to this sampling constraint, the probabilities of at least one false alarm and at least one missed detection are controlled below user-specified tolerance levels. A general criterion is established for a policy to achieve the minimum expected time until stop** to a first-order asymptotic approximation as both familywise error rates go to zero. This criterion is used to prove the asymptotic optimality of a family of policies that sample each source at each time instance with a probability that depends on the past observations only through the current estimate of the subset of anomalous sources. In particular, the asymptotic optimality is established of a policy that requires minimal computation under any setup of the problem.
△ Less
Submitted 20 May, 2022; v1 submitted 18 November, 2021;
originally announced November 2021.
-
Quickest Change Detection under Transient Dynamics: Theory and Asymptotic Analysis
Authors:
Shaofeng Zou,
Georgios Fellouris,
Venugopal V. Veeravalli
Abstract:
The problem of quickest change detection (QCD) under transient dynamics is studied, where the change from the initial distribution to the final persistent distribution does not happen instantaneously, but after a series of transient phases. The observations within the different phases are generated by different distributions. The objective is to detect the change as quickly as possible, while cont…
▽ More
The problem of quickest change detection (QCD) under transient dynamics is studied, where the change from the initial distribution to the final persistent distribution does not happen instantaneously, but after a series of transient phases. The observations within the different phases are generated by different distributions. The objective is to detect the change as quickly as possible, while controlling the average run length (ARL) to false alarm, when the durations of the transient phases are completely unknown. Two algorithms are considered, the dynamic Cumulative Sum (CuSum) algorithm, proposed in earlier work, and a newly constructed weighted dynamic CuSum algorithm. Both algorithms admit recursions that facilitate their practical implementation, and they are adaptive to the unknown transient durations. Specifically, their asymptotic optimality is established with respect to both Lorden's and Pollak's criteria as the ARL to false alarm and the durations of the transient phases go to infinity at any relative rate. Numerical results are provided to demonstrate the adaptivity of the proposed algorithms, and to validate the theoretical results.
△ Less
Submitted 12 December, 2018; v1 submitted 6 November, 2017;
originally announced November 2017.
-
Change Acceleration and Detection
Authors:
Yanglei Song,
Georgios Fellouris
Abstract:
A novel sequential change detection problem is proposed, in which the goal is to not only detect but also accelerate the change. Specifically, it is assumed that the sequentially collected observations are responses to treatments selected in real time. The assigned treatments determine the pre-change and post-change distributions of the responses and also influence when the change happens. The goa…
▽ More
A novel sequential change detection problem is proposed, in which the goal is to not only detect but also accelerate the change. Specifically, it is assumed that the sequentially collected observations are responses to treatments selected in real time. The assigned treatments determine the pre-change and post-change distributions of the responses and also influence when the change happens. The goal is to find a treatment assignment rule and a stop** rule that minimize the expected total number of observations subject to a user-specified bound on the false alarm probability. The optimal solution is obtained under a general Markovian change-point model. Moreover, an alternative procedure is proposed, whose applicability is not restricted to Markovian change-point models and whose design requires minimal computation. For a large class of change-point models, the proposed procedure is shown to achieve the optimal performance in an asymptotic sense. Finally, its performance is found in simulation studies to be comparable to the optimal, uniformly with respect to the error probability.
△ Less
Submitted 21 June, 2024; v1 submitted 2 October, 2017;
originally announced October 2017.
-
Efficient Byzantine Sequential Change Detection
Authors:
Georgios Fellouris,
Erhan Bayraktar,
Lifeng Lai
Abstract:
In the multisensor sequential change detection problem, a disruption occurs in an environment monitored by multiple sensors. This disruption induces a change in the observations of an unknown subset of sensors. In the Byzantine version of this problem, which is the focus of this work, it is further assumed that the postulated change-point model may be misspecified for an unknown subset of sensors.…
▽ More
In the multisensor sequential change detection problem, a disruption occurs in an environment monitored by multiple sensors. This disruption induces a change in the observations of an unknown subset of sensors. In the Byzantine version of this problem, which is the focus of this work, it is further assumed that the postulated change-point model may be misspecified for an unknown subset of sensors. The problem then is to detect the change quickly and reliably, for any possible subset of affected sensors, even if the misspecified sensors are controlled by an adversary. Given a user-specified upper bound on the number of compromised sensors, we propose and study three families of sequential change-detection rules for this problem. These are designed and evaluated under a generalization of Lorden's criterion, where conditional expected detection delay and expected time to false alarm are both computed in the worst-case scenario for the compromised sensors. The first-order asymptotic performance of these procedures is characterized as the worst-case false alarm rate goes to 0. The insights from these theoretical results are corroborated by a simulation study.
△ Less
Submitted 23 August, 2017; v1 submitted 9 September, 2016;
originally announced September 2016.
-
Sequential multiple testing with generalized error control: an asymptotic optimality theory
Authors:
Yanglei Song,
Georgios Fellouris
Abstract:
The sequential multiple testing problem is considered under two generalized error metrics. Under the first one, the probability of at least $k$ mistakes, of any kind, is controlled. Under the second, the probabilities of at least $k_1$ false positives and at least $k_2$ false negatives are simultaneously controlled. For each formulation, the optimal expected sample size is characterized, to a firs…
▽ More
The sequential multiple testing problem is considered under two generalized error metrics. Under the first one, the probability of at least $k$ mistakes, of any kind, is controlled. Under the second, the probabilities of at least $k_1$ false positives and at least $k_2$ false negatives are simultaneously controlled. For each formulation, the optimal expected sample size is characterized, to a first-order asymptotic approximation as the error probabilities go to 0, and a novel multiple testing procedure is proposed and shown to be asymptotically efficient under every signal configuration. These results are established when the data streams for the various hypotheses are independent and each local log-likelihood ratio statistic satisfies a certain Strong Law of Large Numbers. In the special case of i.i.d. observations in each stream, the gains of the proposed sequential procedures over fixed-sample size schemes are quantified.
△ Less
Submitted 18 June, 2018; v1 submitted 25 August, 2016;
originally announced August 2016.
-
Asymptotically optimal, sequential, multiple testing procedures with prior information on the number of signals
Authors:
Yanglei Song,
Georgios Fellouris
Abstract:
Assuming that data are collected sequentially from independent streams, we consider the simultaneous testing of multiple binary hypotheses under two general setups; when the number of signals (correct alternatives) is known in advance, and when we only have a lower and an upper bound for it. In each of these setups, we propose feasible procedures that control, without any distributional assumption…
▽ More
Assuming that data are collected sequentially from independent streams, we consider the simultaneous testing of multiple binary hypotheses under two general setups; when the number of signals (correct alternatives) is known in advance, and when we only have a lower and an upper bound for it. In each of these setups, we propose feasible procedures that control, without any distributional assumptions, the familywise error probabilities of both type I and type II below given, user-specified levels. Then, in the case of i.i.d. observations in each stream, we show that the proposed procedures achieve the optimal expected sample size, under every possible signal configuration, asymptotically as the two error probabilities vanish at arbitrary rates. A simulation study is presented in a completely symmetric case and supports insights obtained from our asymptotic results, such as the fact that knowledge of the exact number of signals roughly halves the expected number of observations compared to the case of no prior information.
△ Less
Submitted 20 July, 2016; v1 submitted 9 March, 2016;
originally announced March 2016.
-
Multichannel Sequential Detection- Part I: Non-i.i.d. Data
Authors:
Georgios Fellouris,
Alexander G. Tartakovsky
Abstract:
We consider the problem of sequential signal detection in a multichannel system where the number and location of signals is a priori unknown. We assume that the data in each channel are sequentially observed and follow a general non-i.i.d. stochastic model. Under the assumption that the local log-likelihood ratio processes in the channels converge r-completely to positive and finite numbers, we es…
▽ More
We consider the problem of sequential signal detection in a multichannel system where the number and location of signals is a priori unknown. We assume that the data in each channel are sequentially observed and follow a general non-i.i.d. stochastic model. Under the assumption that the local log-likelihood ratio processes in the channels converge r-completely to positive and finite numbers, we establish the asymptotic optimality of a generalized sequential likelihood ratio test and a mixture-based sequential likelihood ratio test. Specifically, we show that both tests minimize the first r moments of the stop** time distribution asymptotically as the probabilities of false alarm and missed detection approach zero. Moreover, we show that both tests asymptotically minimize all moments of the stop** time distribution when the local log-likelihood ratio processes have independent increments and simply obey the Strong Law of Large Numbers. This extends a result previously known in the case of i.i.d. observations when only one channel is affected. We illustrate the general detection theory using several practical examples, including the detection of signals in Gaussian hidden Markov models, white Gaussian noises with unknown intensity, and testing of the first-order autoregression's correlation coefficient. Finally, we illustrate the feasibility of both sequential tests when assuming an upper and a lower bound on the number of signals and compare their non-asymptotic performance using a simulation study.
△ Less
Submitted 13 January, 2016;
originally announced January 2016.
-
Sequential Design for Computerized Adaptive Testing that Allows for Response Revision
Authors:
Shiyu Wang,
Georgios Fellouris,
Hua-Hua Chang
Abstract:
In computerized adaptive testing (CAT), items (questions) are selected in real time based on the already observed responses, so that the ability of the examinee can be estimated as accurately as possible. This is typically formulated as a non-linear, sequential, experimental design problem with binary observations that correspond to the true or false responses. However, most items in practice are…
▽ More
In computerized adaptive testing (CAT), items (questions) are selected in real time based on the already observed responses, so that the ability of the examinee can be estimated as accurately as possible. This is typically formulated as a non-linear, sequential, experimental design problem with binary observations that correspond to the true or false responses. However, most items in practice are multiple-choice and dichotomous models do not make full use of the available data. Moreover, CAT has been heavily criticized for not allowing test-takers to review and revise their answers. In this work, we propose a novel CAT design that is based on the polytomous nominal response model and in which test-takers are allowed to revise their responses at any time during the test. We show that as the number of administered items goes to infinity, the proposed estimator is (i) strongly consistent for any item selection and revision strategy and (ii) asymptotically normal when the items are selected to maximize the Fisher information at the current ability estimate and the number of revisions is smaller than the number of items. We also present the findings of a simulation study that supports our asymptotic results.
△ Less
Submitted 6 January, 2015;
originally announced January 2015.
-
Second-Order Asymptotic Optimality in Multisensor Sequential Change Detection
Authors:
Georgios Fellouris,
Grigory Sokolov
Abstract:
A generalized multisensor sequential change detection problem is considered, in which a number of (possibly correlated) sensors monitor an environment in real time, the joint distribution of their observations is determined by a global parameter vector, and at some unknown time there is a change in an unknown subset of components of this parameter vector. In this setup, we consider the problem of…
▽ More
A generalized multisensor sequential change detection problem is considered, in which a number of (possibly correlated) sensors monitor an environment in real time, the joint distribution of their observations is determined by a global parameter vector, and at some unknown time there is a change in an unknown subset of components of this parameter vector. In this setup, we consider the problem of detecting the time of the change as soon as possible, while controlling the rate of false alarms. We establish the second-order asymptotic optimality (with respect to Lorden's criterion) of various generalizations of the CUSUM rule; that is, we show that their additional expected worst-case detection delay (relative to the one that could be achieved if the affected subset was known) remains bounded as the rate of false alarm goes to 0, for any possible subset of affected components. This general framework incorporates the traditional multisensor setup in which only an unknown subset of sensors is affected by the change. The latter problem has a special structure which we exploit in order to obtain feasible representations of the proposed schemes. We present the results of a simulation study where we compare the proposed schemes with scalable detection rules that are only first-order asymptotically optimal. Finally, in the special case that the change affects exactly one sensor, we consider the scheme that runs in parallel the local CUSUM rules and study the problem of specifying the local thresholds.
△ Less
Submitted 10 January, 2016; v1 submitted 14 October, 2014;
originally announced October 2014.
-
Unstructured sequential testing in sensor networks
Authors:
Georgios Fellouris,
Alexander Tartakovsky
Abstract:
We consider the problem of quickly detecting a signal in a sensor network when the subset of sensors in which signal may be present is completely unknown. We formulate this problem as a sequential hypothesis testing problem with a simple null (signal is absent everywhere) and a composite alternative (signal is present somewhere). We introduce a novel class of scalable sequential tests which, for a…
▽ More
We consider the problem of quickly detecting a signal in a sensor network when the subset of sensors in which signal may be present is completely unknown. We formulate this problem as a sequential hypothesis testing problem with a simple null (signal is absent everywhere) and a composite alternative (signal is present somewhere). We introduce a novel class of scalable sequential tests which, for any subset of affected sensors, minimize the expected sample size for a decision asymptotically, that is as the error probabilities go to 0. Moreover, we propose sequential tests that require minimal transmission activity from the sensors to the fusion center, while preserving this asymptotic optimality property.
△ Less
Submitted 10 November, 2013;
originally announced November 2013.
-
Low-rate renewal theory and estimation
Authors:
Georgios Fellouris
Abstract:
Certain renewal theorems are extended to the case that the rate of the renewal process goes to 0 and, more generally, to the case that the drift of the random walk goes to infinity. These extensions are motivated by and applied to the problem of decentralized parameter estimation under severe communication constraints.
Certain renewal theorems are extended to the case that the rate of the renewal process goes to 0 and, more generally, to the case that the drift of the random walk goes to infinity. These extensions are motivated by and applied to the problem of decentralized parameter estimation under severe communication constraints.
△ Less
Submitted 10 November, 2013; v1 submitted 14 February, 2013;
originally announced February 2013.
-
Bandwidth and Energy Efficient Decentralized Sequential Change Detection
Authors:
Georgios Fellouris,
George V. Moustakides
Abstract:
The problem of decentralized sequential change detection is considered, where an abrupt change occurs in an area monitored by a number of sensors; the sensors transmit their data to a fusion center, subject to bandwidth and energy constraints, and the fusion center is responsible for detecting the change as soon as possible. A novel sequential detection rule is proposed that requires communication…
▽ More
The problem of decentralized sequential change detection is considered, where an abrupt change occurs in an area monitored by a number of sensors; the sensors transmit their data to a fusion center, subject to bandwidth and energy constraints, and the fusion center is responsible for detecting the change as soon as possible. A novel sequential detection rule is proposed that requires communication from the sensors at random times and transmission of only low-bit messages, on which the fusion center runs in parallel a CUSUM test. The second-order asymptotic optimality of the proposed scheme is established both in discrete and in continuous time. Specifically, it is shown that the inflicted performance loss (with respect to the optimal detection rule that uses the complete sensor observations) is asymptotically bounded as the rate of false alarms goes to 0, for any fixed rate of communication. When the rate of communication from the sensors is asymptotically low, the proposed scheme remains first-order asymptotically optimal. Finally, simulation experiments illustrate its efficiency and its superiority over a decentralized detection rule that relies on communication at deterministic times.
△ Less
Submitted 10 November, 2013; v1 submitted 7 October, 2012;
originally announced October 2012.
-
Almost optimal sequential tests of discrete composite hypotheses
Authors:
Georgios Fellouris,
Alexander G. Tartakovsky
Abstract:
We consider the problem of sequentially testing a simple null hypothesis versus a composite alternative hypothesis that consists of a finite set of densities. We study sequential tests that are based on thresholding of mixture-based likelihood ratio statistics and weighted generalized likelihood ratio statistics. It is shown that both sequential tests have several asymptotic optimality properties…
▽ More
We consider the problem of sequentially testing a simple null hypothesis versus a composite alternative hypothesis that consists of a finite set of densities. We study sequential tests that are based on thresholding of mixture-based likelihood ratio statistics and weighted generalized likelihood ratio statistics. It is shown that both sequential tests have several asymptotic optimality properties as error probabilities go to zero. First, for any weights, they minimize the expected sample size within a constant term under every scenario in the alternative hypothesis and at least to first order under the null hypothesis. Second, for appropriate weights that are specified up to a prior distribution, they minimize within an asymptotically negligible term a weighted expected sample size in the alternative hypothesis. Third, for a particular prior distribution, they are almost minimax with respect to the expected Kullback-Leibler divergence until stop**. Furthermore, based on high-order asymptotic expansions for the operating characteristics, we propose prior distributions that lead to a robust behavior. Finally, based on asymptotic analysis as well as on simulation experiments, we argue that both tests have the same performance when they are designed with the same weights.
△ Less
Submitted 22 January, 2013; v1 submitted 24 April, 2012;
originally announced April 2012.
-
Nearly Minimax One-Sided Mixture-Based Sequential Tests
Authors:
Georgios Fellouris,
Alexander G. Tartakovsky
Abstract:
We focus on one-sided, mixture-based stop** rules for the problem of sequential testing a simple null hypothesis against a composite alternative. For the latter, we consider two cases---either a discrete alternative or a continuous alternative that can be embedded into an exponential family. For each case, we find a mixture-based stop** rule that is nearly minimax in the sense of minimizing th…
▽ More
We focus on one-sided, mixture-based stop** rules for the problem of sequential testing a simple null hypothesis against a composite alternative. For the latter, we consider two cases---either a discrete alternative or a continuous alternative that can be embedded into an exponential family. For each case, we find a mixture-based stop** rule that is nearly minimax in the sense of minimizing the maximal Kullback-Leibler information. The proof of this result is based on finding an almost Bayes rule for an appropriate sequential decision problem and on high-order asymptotic approximations for the performance characteristics of arbitrary mixture-based stop** times. We also evaluate the asymptotic performance loss of certain intuitive mixture rules and verify the accuracy of our asymptotic approximations with simulation experiments.
△ Less
Submitted 24 April, 2012; v1 submitted 5 October, 2011;
originally announced October 2011.
-
Optimal sequential change-detection for fractional diffusion-type processes
Authors:
Alexandra Chronopoulou,
Georgios Fellouris
Abstract:
We consider the problem of detecting an abrupt change in the distribution of a sequentially observed stochastic process. We establish the optimality of the CUSUM test with respect to a modified version of Lorden's criterion for arbitrary processes with continuous paths and apply this general result to the special case of fractional diffusion-type processes. As a by-product, we show that the CUSUM…
▽ More
We consider the problem of detecting an abrupt change in the distribution of a sequentially observed stochastic process. We establish the optimality of the CUSUM test with respect to a modified version of Lorden's criterion for arbitrary processes with continuous paths and apply this general result to the special case of fractional diffusion-type processes. As a by-product, we show that the CUSUM test optimizes Lorden's original criterion when a fractional Brownian motion with Hurst index H adopts a polynomial drift term with exponent H + 1/2 after the change.
△ Less
Submitted 12 July, 2012; v1 submitted 2 February, 2011;
originally announced February 2011.
-
Asymptotically optimal parameter estimation under communication constraints
Authors:
Georgios Fellouris
Abstract:
A parameter estimation problem is considered, in which dispersed sensors transmit to the statistician partial information regarding their observations. The sensors observe the paths of continuous semimartingales, whose drifts are linear with respect to a common parameter. A novel estimating scheme is suggested, according to which each sensor transmits only one-bit messages at stop** times of its…
▽ More
A parameter estimation problem is considered, in which dispersed sensors transmit to the statistician partial information regarding their observations. The sensors observe the paths of continuous semimartingales, whose drifts are linear with respect to a common parameter. A novel estimating scheme is suggested, according to which each sensor transmits only one-bit messages at stop** times of its local filtration. The proposed estimator is shown to be consistent and, for a large class of processes, asymptotically optimal, in the sense that its asymptotic distribution is the same as the exact distribution of the optimal estimator that has full access to the sensor observations. These properties are established under an asymptotically low rate of communication between the sensors and the statistician. Thus, despite being asymptotically efficient, the proposed estimator requires minimal transmission activity, which is a desirable property in many applications. Finally, the case of discrete sampling at the sensors is studied when their underlying processes are independent Brownian motions.
△ Less
Submitted 31 January, 2013; v1 submitted 2 February, 2011;
originally announced February 2011.
-
Decentralized Sequential Hypothesis Testing using Asynchronous Communication
Authors:
Georgios Fellouris,
George V. Moustakides
Abstract:
We present a test for the problem of decentralized sequential hypothesis testing, which is asymptotically optimum. By selecting a suitable sampling mechanism at each sensor, communication between sensors and fusion center is asynchronous and limited to 1-bit data. The proposed SPRT-like test turns out to be order-2 asymptotically optimum in the case of continuous time and continuous path signals…
▽ More
We present a test for the problem of decentralized sequential hypothesis testing, which is asymptotically optimum. By selecting a suitable sampling mechanism at each sensor, communication between sensors and fusion center is asynchronous and limited to 1-bit data. The proposed SPRT-like test turns out to be order-2 asymptotically optimum in the case of continuous time and continuous path signals, while in discrete time this strong asymptotic optimality property is preserved under proper conditions. If these conditions do not hold, then we can show optimality of order-1. Simulations corroborate the excellent performance characteristics of the test of interest.
△ Less
Submitted 28 August, 2009;
originally announced August 2009.
