-
How to Add Baskets to an Ongoing Basket Trial with Information Borrowing
Authors:
Libby Daniells,
Pavel Mozgunov,
Helen Barnett,
Alun Bedding,
Thomas Jaki
Abstract:
Basket trials test a single therapeutic treatment on several patient populations under one master protocol. A desirable adaptive design feature in these studies may be the incorporation of new baskets to an ongoing study. Limited basket sample sizes can cause issues in power and precision of treatment effect estimates which could be amplified in added baskets due to the shortened recruitment time.…
▽ More
Basket trials test a single therapeutic treatment on several patient populations under one master protocol. A desirable adaptive design feature in these studies may be the incorporation of new baskets to an ongoing study. Limited basket sample sizes can cause issues in power and precision of treatment effect estimates which could be amplified in added baskets due to the shortened recruitment time. While various Bayesian information borrowing techniques have been introduced to tackle the issue of small sample sizes, the impact of including new baskets in the trial and into the borrowing model has yet to be investigated. We explore approaches for adding baskets to an ongoing trial under information borrowing and highlight when it is beneficial to add a basket compared to running a separate investigation for new baskets. We also propose a novel calibration approach for the decision criteria that is more robust to false decision making. Simulation studies are conducted to assess the performance of approaches which is monitored primarily through type I error control and precision of estimates. Results display a substantial improvement in power for a new basket when information borrowing is utilized, however, this comes with potential inflation of error rates which can be shown to be reduced under the proposed calibration procedure.
△ Less
Submitted 8 July, 2024;
originally announced July 2024.
-
Next generation clinical trials: Seamless designs and master protocols
Authors:
Abigail Burdon,
Thomas Jaki,
Xi** Chen,
Pavel Mozgunov,
Haiyan Zheng,
Richard Baird
Abstract:
Background: Drug development is often inefficient, costly and lengthy, yet it is essential for evaluating the safety and efficacy of new interventions. Compared with other disease areas, this is particularly true for Phase II / III cancer clinical trials where high attrition rates and reduced regulatory approvals are being seen. In response to these challenges, seamless clinical trials and master…
▽ More
Background: Drug development is often inefficient, costly and lengthy, yet it is essential for evaluating the safety and efficacy of new interventions. Compared with other disease areas, this is particularly true for Phase II / III cancer clinical trials where high attrition rates and reduced regulatory approvals are being seen. In response to these challenges, seamless clinical trials and master protocols have emerged to streamline the drug development process. Methods: Seamless clinical trials, characterized by their ability to transition seamlessly from one phase to another, can lead to accelerating the development of promising therapies while Master protocols provide a framework for investigating multiple treatment options and patient subgroups within a single trial. Results: We discuss the advantages of these methods through real trial examples and the principals that lead to their success while also acknowledging the associated regulatory considerations and challenges. Conclusion: Seamless designs and Master protocols have the potential to improve confirmatory clinical trials. In the disease area of cancer, this ultimately means that patients can receive life-saving treatments sooner.
△ Less
Submitted 10 May, 2024;
originally announced May 2024.
-
Bayesian Model Averaging for Partial Ordering Continual Reassessment Methods
Authors:
Luka Kovacevic,
Thomas Jaki,
Helen Barnett,
Pavel Mozgunov
Abstract:
Phase I clinical trials are essential to bringing novel therapies from chemical development to widespread use. Traditional approaches to dose-finding in Phase I trials, such as the '3+3' method and the Continual Reassessment Method (CRM), provide a principled approach for escalating across dose levels. However, these methods lack the ability to incorporate uncertainty regarding the dose-toxicity o…
▽ More
Phase I clinical trials are essential to bringing novel therapies from chemical development to widespread use. Traditional approaches to dose-finding in Phase I trials, such as the '3+3' method and the Continual Reassessment Method (CRM), provide a principled approach for escalating across dose levels. However, these methods lack the ability to incorporate uncertainty regarding the dose-toxicity ordering as found in combination drug trials. Under this setting, dose-levels vary across multiple drugs simultaneously, leading to multiple possible dose-toxicity orderings. The Partial Ordering CRM (POCRM) extends to these settings by allowing for multiple dose-toxicity orderings. In this work, it is shown that the POCRM is vulnerable to 'estimation incoherency' whereby toxicity estimates shift in an illogical way, threatening patient safety and undermining clinician trust in dose-finding models. To this end, the Bayesian model averaged POCRM (BMA-POCRM) is proposed. BMA-POCRM uses Bayesian model averaging to take into account all possible orderings simultaneously, reducing the frequency of estimation incoherencies. The effectiveness of BMA-POCRM in drug combination settings is demonstrated through a specific instance of estimate incoherency of POCRM and simulation studies. The results highlight the improved safety, accuracy and reduced occurrence of estimate incoherency in trials applying the BMA-POCRM relative to the POCRM model.
△ Less
Submitted 1 March, 2024;
originally announced March 2024.
-
Design of platform trials with a change in the control treatment arm
Authors:
Peter Greenstreet,
Thomas Jaki,
Alun Bedding,
Pavel Mozgunov
Abstract:
Platform trials are a more efficient way of testing multiple treatments compared to running separate trials. In this paper we consider platform trials where, if a treatment is found to be superior to the control, it will become the new standard of care (and the control in the platform). The remaining treatments are then tested against this new control. In such a setting, one can either keep the in…
▽ More
Platform trials are a more efficient way of testing multiple treatments compared to running separate trials. In this paper we consider platform trials where, if a treatment is found to be superior to the control, it will become the new standard of care (and the control in the platform). The remaining treatments are then tested against this new control. In such a setting, one can either keep the information on both the new standard of care and the other active treatments before the control is changed or one could discard this information when testing for benefit of the remaining treatments. We will show analytically and numerically that retaining the information collected before the change in control can be detrimental to the power of the study. Specifically, we consider the overall power, the probability that the active treatment with the greatest treatment effect is found during the trial. We also consider the conditional power of the active treatments, the probability a given treatment can be found superior against the current control. We prove when, in a multi-arm multi-stage trial where no arms are added, retaining the information is detrimental to both overall and conditional power of the remaining treatments. This loss of power is studied for a motivating example. We then discuss the effect on platform trials in which arms are added later. On the basis of these observations we discuss different aspects to consider when deciding whether to run a continuous platform trial or whether one may be better running a new trial.
△ Less
Submitted 29 November, 2023;
originally announced November 2023.
-
A preplanned multi-stage platform trial for discovering multiple superior treatments with control of FWER and power
Authors:
Peter Greenstreet,
Thomas Jaki,
Alun Bedding,
Pavel Mozgunov
Abstract:
There is a growing interest in the implementation of platform trials, which provide the flexibility to incorporate new treatment arms during the trial and the ability to halt treatments early based on lack of benefit or observed superiority. In such trials, it can be important to ensure that error rates are controlled. This paper introduces a multi-stage design that enables the addition of new tre…
▽ More
There is a growing interest in the implementation of platform trials, which provide the flexibility to incorporate new treatment arms during the trial and the ability to halt treatments early based on lack of benefit or observed superiority. In such trials, it can be important to ensure that error rates are controlled. This paper introduces a multi-stage design that enables the addition of new treatment arms, at any point, in a pre-planned manner within a platform trial, while still maintaining control over the family-wise error rate. This paper focuses on finding the required sample size to achieve a desired level of statistical power when treatments are continued to be tested even after a superior treatment has already been found. This may be of interest if there are other sponsors treatments which are also superior to the current control or multiple doses being tested. The calculations to determine the expected sample size is given. A motivating trial is presented in which the sample size of different configurations is studied. Additionally the approach is compared to running multiple separate trials and it is shown that in many scenarios if family wise error rate control is needed there may not be benefit in using a platform trial when comparing the sample size of the trial.
△ Less
Submitted 24 August, 2023;
originally announced August 2023.
-
Bayesian sample size determination in basket trials borrowing information between subsets
Authors:
Haiyan Zheng,
Michael J. Grayling,
Pavel Mozgunov,
Thomas Jaki,
James M. S. Wason
Abstract:
Basket trials are increasingly used for the simultaneous evaluation of a new treatment in various patient subgroups under one overarching protocol. We propose a Bayesian approach to sample size determination in basket trials that permit borrowing of information between commensurate subsets. Specifically, we consider a randomised basket trial design where patients are randomly assigned to the new t…
▽ More
Basket trials are increasingly used for the simultaneous evaluation of a new treatment in various patient subgroups under one overarching protocol. We propose a Bayesian approach to sample size determination in basket trials that permit borrowing of information between commensurate subsets. Specifically, we consider a randomised basket trial design where patients are randomly assigned to the new treatment or a control within each trial subset (`subtrial' for short). Closed-form sample size formulae are derived to ensure each subtrial has a specified chance of correctly deciding whether the new treatment is superior to or not better than the control by some clinically relevant difference. Given pre-specified levels of pairwise (in)commensurability, the subtrial sample sizes are solved simultaneously. The proposed Bayesian approach resembles the frequentist formulation of the problem in yielding comparable sample sizes for circumstances of no borrowing. When borrowing is enabled between commensurate subtrials, a considerably smaller trial sample size is required compared to the widely implemented approach of no borrowing. We illustrate the use of our sample size formulae with two examples based on real basket trials. A comprehensive simulation study further shows that the proposed methodology can maintain the true positive and false positive rates at desired levels.
△ Less
Submitted 24 May, 2022;
originally announced May 2022.
-
A multi-arm multi-stage platform design that allows pre-planned addition of arms while still controlling the family-wise error
Authors:
Peter Greenstreet,
Thomas Jaki,
Alun Bedding,
Chris Harbron,
Pavel Mozgunov
Abstract:
There is growing interest in platform trials that allow for adding of new treatment arms as the trial progresses as well as being able to stop treatments part way through the trial for either lack of benefit/futility or for superiority. In some situations, platform trials need to guarantee that error rates are controlled. This paper presents a multi-stage design that allows additional arms to be a…
▽ More
There is growing interest in platform trials that allow for adding of new treatment arms as the trial progresses as well as being able to stop treatments part way through the trial for either lack of benefit/futility or for superiority. In some situations, platform trials need to guarantee that error rates are controlled. This paper presents a multi-stage design that allows additional arms to be added in a platform trial in a pre-planned fashion, while still controlling the family wise error rate. A method is given to compute the sample size required to achieve a desired level of power and we show how the distribution of the sample size and the expected sample size can be found. A motivating trial is presented which focuses on two settings, with the first being a set number of stages per active treatment arm and the second being a set total number of stages, with treatments that are added later getting fewer stages. Through this example we show that the proposed method results in a smaller sample size while still controlling the errors compared to running multiple separate trials.
△ Less
Submitted 12 December, 2021;
originally announced December 2021.
-
A Comparison of Various Aggregation Functions in Multi-Criteria Decision Analysis for Drug Benefit-Risk Assessment
Authors:
Tom Menzies,
Gaelle Saint-Hilary,
Pavel Mozgunov
Abstract:
Multi-criteria decision analysis (MCDA) is a quantitative approach to the drug benefit-risk assessment (BRA) which allows for consistent comparisons by summarising all benefits and risks in a single score. The MCDA consists of several components, one of which is the utility (or loss) score function that defines how benefits and risks are aggregated into a single quantity. While a linear utility sc…
▽ More
Multi-criteria decision analysis (MCDA) is a quantitative approach to the drug benefit-risk assessment (BRA) which allows for consistent comparisons by summarising all benefits and risks in a single score. The MCDA consists of several components, one of which is the utility (or loss) score function that defines how benefits and risks are aggregated into a single quantity. While a linear utility score is one of the most widely used approach in BRA, it is recognised that it can result in counter-intuitive decisions, for example, recommending a treatment with extremely low benefits or high risks. To overcome this problem, alternative approaches to the scores construction, namely, product, multi-linear and Scale Loss Score models, were suggested. However, to date, the majority of arguments concerning the differences implied by these models are heuristic. In this work, we consider four models to calculate the aggregated utility/loss scores and compared their performance in an extensive simulation study over many different scenarios, and in a case study. It is found that the product and Scale Loss Score models provide more intuitive treatment recommendation decisions in the majority of scenarios compared to the linear and multi-linear models, and are more robust to the correlation in the criteria.
△ Less
Submitted 26 July, 2021;
originally announced July 2021.
-
A Comparison of Model-Free Phase I Dose Escalation Designs for Dual-Agent Combination Therapies
Authors:
Helen Yvette Barnett,
Matthew George,
Donia Skanji,
Gaelle Saint-Hilary,
Thomas Jaki,
Pavel Mozgunov
Abstract:
It is increasingly common for therapies in oncology to be given in combination. In some cases, patients can benefit from the interaction between two drugs, although often at the risk of higher toxicity. A large number of designs to conduct phase I trials in this setting are available, where the objective is to select the maximum tolerated dose combination (MTC). Recently, a number of model-free (a…
▽ More
It is increasingly common for therapies in oncology to be given in combination. In some cases, patients can benefit from the interaction between two drugs, although often at the risk of higher toxicity. A large number of designs to conduct phase I trials in this setting are available, where the objective is to select the maximum tolerated dose combination (MTC). Recently, a number of model-free (also called model-assisted) designs have provoked interest, providing several practical advantages over the more conventional approaches of rule-based or model-based designs. In this paper, we demonstrate a novel calibration procedure for model-free designs to determine their most desirable parameters. Under the calibration procedure, we compare the behaviour of model-free designs to a model-based approach in a comprehensive simulation study, covering a number of clinically plausible scenarios. It is found that model-free designs are competitive with the model-based design in terms of the proportion of correct selections of the MTC. However, there are a number of scenarios in which model-free designs offer a safer alternative. This is also illustrated in the application of the designs to a case study using data from a phase I oncology trial.
△ Less
Submitted 30 April, 2021;
originally announced April 2021.
-
A Seamless Phase I/II Platform Design with a Time-To-Event Efficacy Endpoint for Potential COVID-19 Therapies
Authors:
Thomas Jaki,
Helen Barnett,
Andrew Titman,
Pavel Mozgunov
Abstract:
In the search for effective treatments for COVID-19, initial emphasis has been on re-purposed treatments. To maximise the chances of finding successful treatments, novel treatments that have been developed for this disease in particular, are needed. In this manuscript we describe and evaluate the statistical design of the AGILE platform, an adaptive randomized seamless Phase I/II trial platform th…
▽ More
In the search for effective treatments for COVID-19, initial emphasis has been on re-purposed treatments. To maximise the chances of finding successful treatments, novel treatments that have been developed for this disease in particular, are needed. In this manuscript we describe and evaluate the statistical design of the AGILE platform, an adaptive randomized seamless Phase I/II trial platform that seeks to quickly establish a safe range of doses and investigates treatments for potential efficacy using a Bayesian sequential trial design. Both single agent and combination treatments are considered. We find that the design can identify potential treatments that are safe and efficacious reliably with small to moderate sample sizes.
△ Less
Submitted 7 October, 2020;
originally announced October 2020.
-
Adding flexibility to clinical trial designs: an example-based guide to the practical use of adaptive designs
Authors:
Thomas Burnett,
Pavel Mozgunov,
Philip Pallmann,
Sofia S. Villar,
Graham M. Wheeler,
Thomas Jaki
Abstract:
Adaptive designs for clinical trials permit alterations to a study in response to accumulating data in order to make trials more flexible, ethical and efficient. These benefits are achieved while preserving the integrity and validity of the trial, through the pre-specification and proper adjustment for the possible alterations during the course of the trial. Despite much research in the statistica…
▽ More
Adaptive designs for clinical trials permit alterations to a study in response to accumulating data in order to make trials more flexible, ethical and efficient. These benefits are achieved while preserving the integrity and validity of the trial, through the pre-specification and proper adjustment for the possible alterations during the course of the trial. Despite much research in the statistical literature highlighting the potential advantages of adaptive designs over traditional fixed designs, the uptake of such methods in clinical research has been slow. One major reason for this is that different adaptations to trial designs, as well as their advantages and limitations, remain unfamiliar to large parts of the clinical community. The aim of this paper is to clarify where adaptive designs can be used to address specific questions of scientific interest; we introduce the main features of adaptive designs and commonly used terminology, highlighting their utility and pitfalls, and illustrate their use through case studies of adaptive trials ranging from early-phase dose escalation to confirmatory Phase III studies.
△ Less
Submitted 23 June, 2020;
originally announced June 2020.
-
Efficient adaptive designs for clinical trials of interventions for COVID-19
Authors:
Nigel Stallard,
Lisa Hampson,
Norbert Benda,
Werner Brannath,
Tom Burnett,
Tim Friede,
Peter K. Kimani,
Franz Koenig,
Johannes Krisam,
Pavel Mozgunov,
Martin Posch,
James Wason,
Gernot Wassmer,
John Whitehead,
S. Faye Williamson,
Sarah Zohar,
Thomas Jaki
Abstract:
The COVID-19 pandemic has led to an unprecedented response in terms of clinical research activity. An important part of this research has been focused on randomized controlled clinical trials to evaluate potential therapies for COVID-19. The results from this research need to be obtained as rapidly as possible. This presents a number of challenges associated with considerable uncertainty over the…
▽ More
The COVID-19 pandemic has led to an unprecedented response in terms of clinical research activity. An important part of this research has been focused on randomized controlled clinical trials to evaluate potential therapies for COVID-19. The results from this research need to be obtained as rapidly as possible. This presents a number of challenges associated with considerable uncertainty over the natural history of the disease and the number and characteristics of patients affected, and the emergence of new potential therapies. These challenges make adaptive designs for clinical trials a particularly attractive option. Such designs allow a trial to be modified on the basis of interim analysis data or stopped as soon as sufficiently strong evidence has been observed to answer the research question, without compromising the trial's scientific validity or integrity. In this paper we describe some of the adaptive design approaches that are available and discuss particular issues and challenges associated with their use in the pandemic setting. Our discussion is illustrated by details of four ongoing COVID-19 trials that have used adaptive designs.
△ Less
Submitted 25 May, 2020;
originally announced May 2020.
-
Improving Safety of the Continual Reassessment Method via a Modified Allocation Rule
Authors:
Pavel Mozgunov,
Thomas Jaki
Abstract:
This paper proposes a novel criterion for the allocation of patients in Phase~I dose-escalation clinical trials aiming to find the maximum tolerated dose (MTD). Conventionally, using a model-based approach the next patient is allocated to the dose with the toxicity estimate closest (in terms of the absolute or squared distance) to the maximum acceptable toxicity. This approach, however, ignores th…
▽ More
This paper proposes a novel criterion for the allocation of patients in Phase~I dose-escalation clinical trials aiming to find the maximum tolerated dose (MTD). Conventionally, using a model-based approach the next patient is allocated to the dose with the toxicity estimate closest (in terms of the absolute or squared distance) to the maximum acceptable toxicity. This approach, however, ignores the uncertainty in point estimates and ethical concerns of assigning a lot of patients to overly toxic doses. Motivated by recent discussions in the theory of estimation in restricted parameter spaces, we propose a criterion which accounts for both of these issues. The criterion requires a specification of one additional parameter only which has a simple and intuitive interpretation. We incorporate the proposed criterion into the one-parameter Bayesian continual reassessment method (CRM) and show, using simulations, that it results in the same proportion of correct selections on average as the original design, but in fewer mean number of toxic responses. A comparison to other model-based dose-escalation designs demonstrates that the proposed design can result in either the same mean accuracy as alternatives but fewer number of toxic responses, or in a higher mean accuracy but the same number of toxic responses. We conclude that the new criterion makes the existing model-based designs more ethical without losing efficiency in the context of Phase I clinical trials.
△ Less
Submitted 16 July, 2018;
originally announced July 2018.
-
An information-theoretic Phase I/II design for molecularly targeted agents that does not require an assumption of monotonicity
Authors:
Pavel Mozgunov,
Thomas Jaki
Abstract:
For many years Phase I and Phase II clinical trials were conducted separately, but there was a recent shift to combine these Phases. While a variety of Phase~I/II model-based designs for cytotoxic agents were proposed in the literature, methods for molecularly targeted agents (TA) are just starting to develop. The main challenge of the TA setting is the unknown dose-efficacy relation that can have…
▽ More
For many years Phase I and Phase II clinical trials were conducted separately, but there was a recent shift to combine these Phases. While a variety of Phase~I/II model-based designs for cytotoxic agents were proposed in the literature, methods for molecularly targeted agents (TA) are just starting to develop. The main challenge of the TA setting is the unknown dose-efficacy relation that can have either an increasing, plateau or umbrella shape. To capture these, approaches with more parameters are needed to model the dose-efficacy relationship or, alternatively, more orderings of the dose-efficacy relationship are required to account for the uncertainty in the curve shape. As a result, designs for more complex clinical trials, for example, trials looking at schedules of a combination treatment involving TA, have not been extensively studied yet. We propose a novel regimen-finding design which is based on a derived efficacy-toxicity trade-off function. Due to its special properties, an accurate regimen selection can be achieved without any parametric or monotonicity assumptions. We illustrate how this design can be applied in the context of a complex combination-schedule clinical trial. We discuss practical and ethical issues such as coherence, delayed and missing efficacy responses, safety and futility constraints.
△ Less
Submitted 18 June, 2018; v1 submitted 12 March, 2018;
originally announced March 2018.
-
A Benchmark for Dose Finding Studies with Continuous Outcomes
Authors:
Pavel Mozgunov,
Thomas Jaki,
Xavier Paoletti
Abstract:
An important tool to evaluate the performance of any design is an optimal benchmark proposed by O'Quigley and others (2002, Biostatistics 3(1), 51-56) that provides an upper bound on the performance of a design under a given scenario. The original benchmark can be applied to dose finding studies with a binary endpoint only. However, there is a growing interest in dose finding studies involving con…
▽ More
An important tool to evaluate the performance of any design is an optimal benchmark proposed by O'Quigley and others (2002, Biostatistics 3(1), 51-56) that provides an upper bound on the performance of a design under a given scenario. The original benchmark can be applied to dose finding studies with a binary endpoint only. However, there is a growing interest in dose finding studies involving continuous outcomes, but no benchmark for such studies has been developed. We show that the original benchmark and its extension by Cheung (2014, Biometrics 70(2), 389-397), when looked at from a different perspective, can be generalised to various settings with several discrete and continuous outcomes. We illustrate and compare the benchmark performance in the setting of a Phase I clinical trial with continuous toxicity endpoint and in the setting of a Phase I/II clinical trial with continuous efficacy outcome. We show that the proposed benchmark provides an accurate upper bound for model-based dose finding methods and serves as a powerful tool for evaluating designs.
△ Less
Submitted 5 March, 2018; v1 submitted 23 December, 2017;
originally announced December 2017.
-
A review of the deterministic and diffusion approximations for stochastic chemical reaction networks
Authors:
Pavel Mozgunov,
Marco Beccuti,
Andras Horvath,
Thomas Jaki,
Roberta Sirovich,
Enrico Bibbona
Abstract:
This work reviews deterministic and diffusion approximations of the stochastic chemical reaction networks and explains their applications. We discuss the added value the diffusion approximation provides for systems with different phenomena, such as a deficiency and a bistability. It is advocated that the diffusion approximation can be considered as an alternative theoretical approach to study the…
▽ More
This work reviews deterministic and diffusion approximations of the stochastic chemical reaction networks and explains their applications. We discuss the added value the diffusion approximation provides for systems with different phenomena, such as a deficiency and a bistability. It is advocated that the diffusion approximation can be considered as an alternative theoretical approach to study the reaction networks rather than a simulation shortcut. We discuss two examples in which the diffusion approximation is able to catch qualitative properties of reaction networks that the deterministic model misses. We provide an explicit construction of the original process and the diffusion approximation such that the distance between their trajectories is controlled and demonstrate this construction for the examples. We also discuss the limitations and potential directions of the developments.
△ Less
Submitted 12 January, 2018; v1 submitted 7 November, 2017;
originally announced November 2017.
-
An information-theoretic approach for selecting arms in clinical trials
Authors:
Pavel Mozgunov,
Thomas Jaki
Abstract:
The question of selecting the "best" amongst different choices is a common problem in statistics. In drug development, our motivating setting, the question becomes, for example: what is the dose that gives me a pre-specified risk of toxicity or which treatment gives the best response rate. Motivated by a recent development in the weighted information measures theory, we propose an experimental des…
▽ More
The question of selecting the "best" amongst different choices is a common problem in statistics. In drug development, our motivating setting, the question becomes, for example: what is the dose that gives me a pre-specified risk of toxicity or which treatment gives the best response rate. Motivated by a recent development in the weighted information measures theory, we propose an experimental design based on a simple and intuitive criterion which governs arm selection in the experiment with multinomial outcomes. The criterion leads to accurate arm selection without any parametric or monotonicity assumption. The asymptotic properties of the design are studied for different allocation rules and the small sample size behaviour is evaluated in simulations in the context of Phase I and Phase II clinical trials with binary endpoints. We compare the proposed design to currently used alternatives and discuss its practical implementation.
△ Less
Submitted 14 March, 2018; v1 submitted 8 August, 2017;
originally announced August 2017.
-
Loss Functions in Restricted Parameter Spaces and Their Bayesian Applications
Authors:
Pavel Mozgunov,
Thomas Jaki,
Mauro Gasparini
Abstract:
Squared error loss remains the most commonly used loss function for constructing a Bayes estimator of the parameter of interest. However, it can lead to sub-optimal solutions when a parameter is defined in a restricted space. It can also be an inappropriate choice in the context when an extreme overestimation and/or underestimation results in severe consequences and a more conservative estimator i…
▽ More
Squared error loss remains the most commonly used loss function for constructing a Bayes estimator of the parameter of interest. However, it can lead to sub-optimal solutions when a parameter is defined in a restricted space. It can also be an inappropriate choice in the context when an extreme overestimation and/or underestimation results in severe consequences and a more conservative estimator is preferred. We advocate a class of loss functions for parameters defined on restricted spaces which infinitely penalize boundary decisions like the squared error loss does on the real line. We also recall several properties of loss functions such as symmetry, convexity, and invariance. We propose generalizations of the squared error loss function for parameters defined on the positive real line and on an interval. We provide explicit solutions for corresponding Bayes estimators and discuss multivariate extensions. {Four} well-known Bayesian estimation problems are used to demonstrate inferential benefits the novel Bayes estimators can provide in the context of restricted estimation.
△ Less
Submitted 22 February, 2019; v1 submitted 7 June, 2017;
originally announced June 2017.
-
Limits of Kalman Filter application in heavy tailed problems
Authors:
Valentin Konakov,
Pavel Mozgunov
Abstract:
In this paper we consider the behavior of Kalman Filter state estimates in the case of distribution with heavy tails .The simulated linear state space models with Gaussian measurement noises were used. Gaussian noises in state equation are replaced by components with alpha-stable distribution with di erent parameters alpha and beta. We consider the case when "all parameters are known" and two meth…
▽ More
In this paper we consider the behavior of Kalman Filter state estimates in the case of distribution with heavy tails .The simulated linear state space models with Gaussian measurement noises were used. Gaussian noises in state equation are replaced by components with alpha-stable distribution with di erent parameters alpha and beta. We consider the case when "all parameters are known" and two methods of parameters estimation are compared: the maximum likelihood estimator (MLE) and the expectation- maximization algorithm (EM). It was shown that in cases of large deviation from Gaussian distribution the total error of states estimation rises dramatically. We conjecture that it can be explained by underestimation of the state equation noises covariance matrix that can be taken into account through the EM parameters estimation and ignored in the case of ML estimation.
△ Less
Submitted 5 December, 2015; v1 submitted 29 May, 2015;
originally announced May 2015.
-
Asymptotic behaviour of weighted differential entropies in a Bayesian problem
Authors:
Mark Kelbert,
Pavel Mozgunov
Abstract:
We consider a Bayesian problem of estimating of probability of success in a series of conditionally independent trials with binary outcomes. We study the asymptotic behaviour of differential entropy for posterior probability density function conditional on $x$ successes after $n$ conditionally independent trials, when $n \to \infty$. It is shown that after an appropriate normalization in cases…
▽ More
We consider a Bayesian problem of estimating of probability of success in a series of conditionally independent trials with binary outcomes. We study the asymptotic behaviour of differential entropy for posterior probability density function conditional on $x$ successes after $n$ conditionally independent trials, when $n \to \infty$. It is shown that after an appropriate normalization in cases $x \sim n$ and $x$ $\sim n^β$ ($0<β<1$) limiting distribution is Gaussian and the differential entropy of standardized RV converges to differential entropy of standard Gaussian random variable. When $x$ or $n-x$ is a constant the limiting distribution in not Gaussian, but still the asymptotic of differential entropy can be found explicitly.
Then suppose that one is interested to know whether the coin is fair or not and for large $n$ is interested in the true frequency. To do so the concept of weighted differential entropy introduced in \cite{Belis1968} is used when the frequency $γ$ is necessary to emphasize. It was found that the weight in suggested form does not change the asymptotic form of Shannon, Renyi, Tsallis and Fisher entropies, but change the constants. The main term in weighted Fisher Information is changed by some constant which depend on distance between the true frequency and the value we want to emphasize.
In third part we derived the weighted versions of Rao-Cramér, Bhattacharyya and Kullback inequalities. This result is applied to the Bayesian problem described above. The asymptotic forms of these inequalities are obtained for a particular class of weight functions.
△ Less
Submitted 29 July, 2015; v1 submitted 7 April, 2015;
originally announced April 2015.
