-
Sharing information across patient subgroups to draw conclusions from sparse treatment networks
Authors:
Theodoros Evrenoglou,
Silvia Metelli,
Johannes-Schneider Thomas,
Spyridon Siafis,
Rebecca M. Turner,
Stefan Leucht,
Anna Chaimani
Abstract:
Network meta-analysis (NMA) usually provides estimates of the relative effects with the highest possible precision. However, sparse networks with few available studies and limited direct evidence can arise, threatening the robustness and reliability of NMA estimates. In these cases, the limited amount of available information can hamper the formal evaluation of the underlying NMA assumptions of tr…
▽ More
Network meta-analysis (NMA) usually provides estimates of the relative effects with the highest possible precision. However, sparse networks with few available studies and limited direct evidence can arise, threatening the robustness and reliability of NMA estimates. In these cases, the limited amount of available information can hamper the formal evaluation of the underlying NMA assumptions of transitivity and consistency. In addition, NMA estimates from sparse networks are expected to be imprecise and possibly biased as they rely on large sample approximations which are invalid in the absence of sufficient data. We propose a Bayesian framework that allows sharing of information between two networks that pertain to different population subgroups. Specifically, we use the results from a subgroup with a lot of direct evidence (a dense network) to construct informative priors for the relative effects in the target subgroup (a sparse network). This is a two-stage approach where at the first stage we extrapolate the results of the dense network to those expected from the sparse network. This takes place by using a modified hierarchical NMA model where we add a location parameter that shifts the distribution of the relative effects to make them applicable to the target population. At the second stage, these extrapolated results are used as prior information for the sparse network. We illustrate our approach through a motivating example of psychiatric patients. Our approach results in more precise and robust estimates of the relative effects and can adequately inform clinical practice in presence of sparse networks.
△ Less
Submitted 23 January, 2023;
originally announced January 2023.
-
Improving clinical trial interpretation with ACCEPT analyses
Authors:
Michelle N. Clements,
Ian R. White,
Andrew J. Copas,
Victoria Cornelius,
Suzie Cro,
David T Dunn,
Matteo Quartagno,
Rebecca M. Turner,
Conor D. Tweed,
A. Sarah Walker
Abstract:
Effective decision making from randomised controlled clinical trials relies on robust interpretation of the numerical results. However, the language we use to describe clinical trials can cause confusion both in trial design and in comparing results across trials. ACceptability Curve Estimation using Probability Above Threshold (ACCEPT) aids comparison between trials (even where of different desig…
▽ More
Effective decision making from randomised controlled clinical trials relies on robust interpretation of the numerical results. However, the language we use to describe clinical trials can cause confusion both in trial design and in comparing results across trials. ACceptability Curve Estimation using Probability Above Threshold (ACCEPT) aids comparison between trials (even where of different designs) by harmonising reporting of results, acknowledging different interpretations of the results may be valid in different situations, and moving the focus from comparison to a pre-specified value to interpretation of the trial data. ACCEPT can be applied to historical trials or incorporated into statistical analysis plans for future analyses. An online tool enables ACCEPT on up to three trials simultaneously.
△ Less
Submitted 15 June, 2022; v1 submitted 21 March, 2022;
originally announced March 2022.
-
Handling an uncertain control group event risk in non-inferiority trials: non-inferiority frontiers and the power-stabilising transformation
Authors:
Matteo Quartagno,
A. Sarah Walker,
Abdel G. Babiker,
Rebecca M. Turner,
Mahesh K. B. Parmar,
Andrew Copas,
Ian R. White
Abstract:
Background. Non-inferiority (NI) trials are increasingly used to evaluate new treatments expected to have secondary advantages over standard of care, but similar efficacy on the primary outcome. When designing a NI trial with a binary primary outcome, the choice of effect measure for the NI margin has an important effect on sample size calculations; furthermore, if the control event risk observed…
▽ More
Background. Non-inferiority (NI) trials are increasingly used to evaluate new treatments expected to have secondary advantages over standard of care, but similar efficacy on the primary outcome. When designing a NI trial with a binary primary outcome, the choice of effect measure for the NI margin has an important effect on sample size calculations; furthermore, if the control event risk observed is markedly different from that assumed, the trial can quickly lose power or the results become difficult to interpret. Methods. We propose a new way of designing NI trials to overcome the issues raised by unexpected control event risks by specifying a NI frontier, i.e. a curve defining the most appropriate non-inferiority margin for each possible value of control event risk. We propose a fixed arcsine difference frontier, the power-stabilising transformation for binary outcomes. We propose and compare three ways of designing a trial using this frontier. Results. Testing and reporting on the arcsine scale leads to results which are challenging to interpret clinically. Working on the arcsine scale generally requires a larger sample size compared to the risk difference scale. Therefore, working on the risk difference scale, modifying the margin after observing the control event risk, might be preferable, as it requires a smaller sample size. However, this approach tends to slightly inflate type I error rate; a solution is to use a lower significance level for testing. When working on the risk ratio scale, the same approach leads to power levels above the nominal one, maintaining type I error under control. Conclusions. Our proposed methods of designing NI trials using power-stabilising frontiers make trial design more resilient to unexpected values of the control event risk, at the only cost of requiring larger sample sizes when the goal is to report results on the risk difference scale.
△ Less
Submitted 1 May, 2019;
originally announced May 2019.
-
MultiBUGS: A parallel implementation of the BUGS modelling framework for faster Bayesian inference
Authors:
Robert J. B. Goudie,
Rebecca M. Turner,
Daniela De Angelis,
Andrew Thomas
Abstract:
MultiBUGS (https://www.multibugs.org) is a new version of the general-purpose Bayesian modelling software BUGS that implements a generic algorithm for parallelising Markov chain Monte Carlo (MCMC) algorithms to speed up posterior inference of Bayesian models. The algorithm parallelises evaluation of the product-form likelihoods formed when a parameter has many children in the directed acyclic grap…
▽ More
MultiBUGS (https://www.multibugs.org) is a new version of the general-purpose Bayesian modelling software BUGS that implements a generic algorithm for parallelising Markov chain Monte Carlo (MCMC) algorithms to speed up posterior inference of Bayesian models. The algorithm parallelises evaluation of the product-form likelihoods formed when a parameter has many children in the directed acyclic graph (DAG) representation; and parallelises sampling of conditionally-independent sets of parameters. A heuristic algorithm is used to decide which approach to use for each parameter and to apportion computation across computational cores. This enables MultiBUGS to automatically parallelise the broad range of statistical models that can be fitted using BUGS-language software, making the dramatic speed-ups of modern multi-core computing accessible to applied statisticians, without requiring any experience of parallel programming. We demonstrate the use of MultiBUGS on simulated data designed to mimic a hierarchical e-health linked-data study of methadone prescriptions including 425,112 observations and 20,426 random effects. Posterior inference for the e-health model takes several hours in existing software, but MultiBUGS can perform inference in only 28 minutes using 48 computational cores.
△ Less
Submitted 29 November, 2018; v1 submitted 11 April, 2017;
originally announced April 2017.
-
Overlap and activity glass transitions in plaquette spin models with hierarchical dynamics
Authors:
Robert M. Turner,
Robert L. Jack,
Juan P. Garrahan
Abstract:
We consider thermodynamic and dynamic phase transitions in plaquette spin models of glasses. The thermodynamic transitions involve coupled (annealed) replicas of the model. We map these coupled-replica systems to a single replica in a magnetic field, which allows us to analyse the resulting phase transitions in detail. For the triangular plaquette model (TPM), we find for the coupled-replica syste…
▽ More
We consider thermodynamic and dynamic phase transitions in plaquette spin models of glasses. The thermodynamic transitions involve coupled (annealed) replicas of the model. We map these coupled-replica systems to a single replica in a magnetic field, which allows us to analyse the resulting phase transitions in detail. For the triangular plaquette model (TPM), we find for the coupled-replica system a phase transition between high- and low-overlap phases, occuring at a coupling eps*(T), which vanishes in the low-temperature limit. Using computational path sampling techniques, we show that a single TPM also displays space-time transitions between active and inactive dynamical phases. These first-order dynamical transitions occur at a critical counting field s_c(T)>=0 that appears to vanish at zero temperature, in a manner reminiscent of the thermodynamic overlap transition. In order to extend the ideas to three dimensions we introduce the square pyramid model which also displays both overlap and activity transitions. We discuss a possible common origin of these various phase transitions, based on long-lived (metastable) glassy states.
△ Less
Submitted 20 April, 2015;
originally announced April 2015.
-
Meta-work and the analogous Jarzynski relation in ensembles of dynamical trajectories
Authors:
Robert M. Turner,
Thomas Speck,
Juan P. Garrahan
Abstract:
Recently there has been growing interest in extending the thermodynamic method from static configurations to dynamical trajectories. In this approach, ensembles of trajectories are treated in an analogous manner to ensembles of configurations in equilibrium statistical mechanics: generating functions of dynamical observables are interpreted as partition sums, and the statistical properties of traj…
▽ More
Recently there has been growing interest in extending the thermodynamic method from static configurations to dynamical trajectories. In this approach, ensembles of trajectories are treated in an analogous manner to ensembles of configurations in equilibrium statistical mechanics: generating functions of dynamical observables are interpreted as partition sums, and the statistical properties of trajectory ensembles are encoded in free-energy functions that can be obtained through large-deviation methods in a suitable large time limit. This establishes what one can call a 'thermodynamics of trajectories'. In this paper we go a step further, and make a first connection to fluctuation theorems by generalising them to this dynamical context. We show that an effective 'meta-dynamics' in the space of trajectories gives rise to the celebrated Jarzynski relation connecting an appropriately defined 'meta-work' with changes in dynamical generating functions. We demonstrate the potential applicability of this result to computer simulations for two open quantum systems, a two-level system and the micromaser. We finally discuss the behavior of the Jarzynski relation across a first-order trajectory phase transition.
△ Less
Submitted 13 May, 2014;
originally announced May 2014.
-
Fluctuating observation time ensembles in the thermodynamics of trajectories
Authors:
Adrián A. Budini,
Robert M. Turner,
Juan P. Garrahan
Abstract:
The dynamics of stochastic systems, both classical and quantum, can be studied by analysing the statistical properties of dynamical trajectories. The properties of ensembles of such trajectories for long, but fixed, times are described by large-deviation (LD) rate functions. These LD functions play the role of dynamical free-energies: they are cumulant generating functions for time-integrated obse…
▽ More
The dynamics of stochastic systems, both classical and quantum, can be studied by analysing the statistical properties of dynamical trajectories. The properties of ensembles of such trajectories for long, but fixed, times are described by large-deviation (LD) rate functions. These LD functions play the role of dynamical free-energies: they are cumulant generating functions for time-integrated observables, and their analytic structure encodes dynamical phase behaviour. This "thermodynamics of trajectories" approach is to trajectories and dynamics what the equilibrium ensemble method of statistical mechanics is to configurations and statics. Here we show that, just like in the static case, there is a variety of alternative ensembles of trajectories, each defined by their global constraints, with that of trajectories of fixed total time being just one of these. We show that an ensemble of trajectories where some time-extensive quantity is constant (and large) but where total observation time fluctuates, is equivalent to the fixed-time ensemble, and the LD functions that describe one ensemble can be obtained from those that describe the other. We discuss how the equivalence between generalised ensembles can be exploited in path sampling schemes for generating rare dynamical trajectories.
△ Less
Submitted 5 November, 2013;
originally announced November 2013.
