-
Producing treatment hierarchies in network meta-analysis using probabilistic models and treatment-choice criteria
Authors:
Theodoros Evrenoglou,
Adriani Nikolakopoulou,
Guido Schwarzer,
Gerta Rücker,
Anna Chaimani
Abstract:
A key output of network meta-analysis (NMA) is the relative ranking of the treatments; nevertheless, it has attracted a lot of criticism. This is mainly due to the fact that ranking is an influential output and prone to over-interpretations even when relative effects imply small differences between treatments. To date, common ranking methods rely on metrics that lack a straightforward interpretati…
▽ More
A key output of network meta-analysis (NMA) is the relative ranking of the treatments; nevertheless, it has attracted a lot of criticism. This is mainly due to the fact that ranking is an influential output and prone to over-interpretations even when relative effects imply small differences between treatments. To date, common ranking methods rely on metrics that lack a straightforward interpretation, while it is still unclear how to measure their uncertainty. We introduce a novel framework for estimating treatment hierarchies in NMA. At first, we formulate a mathematical expression that defines a treatment choice criterion (TCC) based on clinically important values. This TCC is applied to the study treatment effects to generate paired data indicating treatment preferences or ties. Then, we synthesize the paired data across studies using an extension of the so-called "Bradley-Terry" model. We assign to each treatment a latent variable interpreted as the treatment "ability" and we estimate the ability parameters within a regression model. Higher ability estimates correspond to higher positions in the final ranking. We further extend our model to adjust for covariates that may affect treatment selection. We illustrate the proposed approach and compare it with alternatives in two datasets: a network comparing 18 antidepressants for major depression and a network comparing 6 antihypertensives for the incidence of diabetes. Our approach provides a robust and interpretable treatment hierarchy which accounts for clinically important values and is presented alongside with uncertainty measures. Overall, the proposed framework offers a novel approach for ranking in NMA based on concrete criteria and preserves from over-interpretation of unimportant differences between treatments.
△ Less
Submitted 15 June, 2024;
originally announced June 2024.
-
Shortest path or random walks? A framework for path weights in network meta-analysis
Authors:
Gerta Rücker,
Theodoros Papakonstantinou,
Adriani Nikolakopoulou,
Guido Schwarzer,
Tobias Galla,
Annabel L. Davies
Abstract:
Quantifying the contributions, or weights, of comparisons or single studies to the estimates in a network meta-analysis (NMA) is an active area of research. We extend this to the contributions of paths to NMA estimates. We present a general framework, based on the path-design matrix, that describes the problem of finding path contributions as a linear equation. The resulting solutions may have neg…
▽ More
Quantifying the contributions, or weights, of comparisons or single studies to the estimates in a network meta-analysis (NMA) is an active area of research. We extend this to the contributions of paths to NMA estimates. We present a general framework, based on the path-design matrix, that describes the problem of finding path contributions as a linear equation. The resulting solutions may have negative coefficients. We show that two known approaches, called shortestpath and randomwalk, are special solutions of this equation, and both meet an optimization criterion, as they minimize the sum of absolute path contributions. In general, there is an infinite space of solutions, which can be identified using the generalized inverse (Moore-Penrose pseudoinverse). We consider two further special approaches. For complex networks we find that shortestpath is superior with respect to run time and variability, compared to the other approaches, and is thus recommended in practice. The path-weights framework also has the potential to answer more general research questions in network meta-analysis.
△ Less
Submitted 10 August, 2023;
originally announced August 2023.
-
Model selection for component network meta-analysis in connected and disconnected networks: a simulation study
Authors:
Maria Petropoulou,
Gerta Rücker,
Stephanie Weibel,
Peter Kranke,
Guido Schwarzer
Abstract:
Network meta-analysis (NMA) is widely used in evidence synthesis to estimate the effects of several competing interventions for a given clinical condition. One of the challenges is that it is not possible in disconnected networks. Component network meta-analysis (CNMA) allows technically 'reconnecting' a disconnected network with multicomponent interventions. The additive CNMA model assumes that t…
▽ More
Network meta-analysis (NMA) is widely used in evidence synthesis to estimate the effects of several competing interventions for a given clinical condition. One of the challenges is that it is not possible in disconnected networks. Component network meta-analysis (CNMA) allows technically 'reconnecting' a disconnected network with multicomponent interventions. The additive CNMA model assumes that the effect of any multicomponent intervention is the additive sum of its components. This assumption can be relaxed by adding interaction component terms, which improves the goodness of fit but decreases the network connectivity. Model selection aims at finding the model with a reasonable balance between the goodness of fit and connectivity (selected CNMA model). We aim to introduce a forward model selection strategy for CNMA models and to investigate the performance of CNMA models for connected and disconnected networks. We applied the methods to a real Cochrane review dataset and simulated data with additive, mildly, or strongly violated intervention effects. We started with connected networks, and we artificially constructed disconnected networks. We compared the results of the additive and the selected CNMAs from each connected and disconnected network with the NMA using the mean squared error and coverage probability. CNMA models provide good performance for connected networks and can be an alternative to standard NMA if additivity holds. On the contrary, model selection does not perform well for disconnected networks, and we recommend conducting separate analyses of subnetworks.
△ Less
Submitted 23 May, 2022;
originally announced May 2022.
-
Network meta-analysis and random walks
Authors:
Annabel L. Davies,
Theodoros Papakonstantinou,
Adriani Nikolakopoulou,
Gerta Rücker,
Tobias Galla
Abstract:
Network meta-analysis (NMA) is a central tool for evidence synthesis in clinical research. The results of an NMA depend critically on the quality of evidence being pooled. In assessing the validity of an NMA, it is therefore important to know the proportion contributions of each direct treatment comparison to each network treatment effect. The construction of proportion contributions is based on t…
▽ More
Network meta-analysis (NMA) is a central tool for evidence synthesis in clinical research. The results of an NMA depend critically on the quality of evidence being pooled. In assessing the validity of an NMA, it is therefore important to know the proportion contributions of each direct treatment comparison to each network treatment effect. The construction of proportion contributions is based on the observation that each row of the hat matrix represents a so-called 'evidence flow network' for each treatment comparison. However, the existing algorithm used to calculate these values is associated with ambiguity according to the selection of paths. In this work we present a novel analogy between NMA and random walks. We use this analogy to derive closed-form expressions for the proportion contributions. A random walk on a graph is a stochastic process that describes a succession of random 'hops' between vertices which are connected by an edge. The weight of an edge relates to the probability that the walker moves along that edge. We use the graph representation of NMA to construct the transition matrix for a random walk on the network of evidence. We show that the net number of times a walker crosses each edge of the network is related to the evidence flow network. By then defining a random walk on the directed evidence flow network, we derive analytically the matrix of proportion contributions. The random-walk approach, in addition to being computationally more efficient, has none of the associated ambiguity of the existing algorithm.
△ Less
Submitted 14 June, 2021;
originally announced July 2021.
-
Comment on `Open is not forever: a study of vanished open access journals'
Authors:
Gerta Rücker
Abstract:
This is a comment to an article by Laakso, Matthias and Jahn (arXiv:2008.11933).
This is a comment to an article by Laakso, Matthias and Jahn (arXiv:2008.11933).
△ Less
Submitted 6 November, 2020; v1 submitted 3 November, 2020;
originally announced November 2020.
-
Clamp cell with $in$ $situ$ pressure monitoring for low-temperature neutron scattering measurements
Authors:
A. Podlesnyak,
M. Loguillo,
G. M. Rucker,
B. Haberl,
R. Boehler,
G. Ehlers,
L. L. Daemen,
D. Armitage,
M. D. Frontzek,
M. Lumsden
Abstract:
A clamp pressure cell for neutron scattering experiments at low temperatures and in external magnetic fields under pressure up to 2~GPa has been fabricated and tested. The cell provides optical access to the sample space that allows instantaneous pressure determination during sample loading, cooling and measuring using ruby and/or samarium doped strontium tetraborate fluorescence monitoring. A new…
▽ More
A clamp pressure cell for neutron scattering experiments at low temperatures and in external magnetic fields under pressure up to 2~GPa has been fabricated and tested. The cell provides optical access to the sample space that allows instantaneous pressure determination during sample loading, cooling and measuring using ruby and/or samarium doped strontium tetraborate fluorescence monitoring. A new calibration curve of the pressure-induced shift of the $^7D_0 - ^5F_0$ (0-0) line in the fluorescent spectrum of SrB$_4$O$_7$:Sm$^{2+}$ for moderate pressures, $P\leqslant{2}$ GPa, is given.
△ Less
Submitted 25 April, 2019;
originally announced April 2019.