-
Practical challenges in mediation analysis: A guide for applied researchers
Authors:
Megan S. Schuler,
Donna L. Coffman,
Elizabeth A. Stuart,
Trang Q. Nguyen,
Brian Vegetabile,
Daniel F. McCaffrey
Abstract:
Mediation analysis is a statistical approach that can provide insights regarding the intermediary processes by which an intervention or exposure affects a given outcome. Mediation analyses rose to prominence, particularly in social science research, with the publication of the seminal paper by Baron and Kenny and is now commonly applied in many research disciplines, including health services resea…
▽ More
Mediation analysis is a statistical approach that can provide insights regarding the intermediary processes by which an intervention or exposure affects a given outcome. Mediation analyses rose to prominence, particularly in social science research, with the publication of the seminal paper by Baron and Kenny and is now commonly applied in many research disciplines, including health services research. Despite the growth in popularity, applied researchers may still encounter challenges in terms of conducting mediation analyses in practice. In this paper, we provide an overview of conceptual and methodological challenges that researchers face when conducting mediation analyses. Specifically, we discuss the following key challenges: (1) Conceptually differentiating mediators from other third variables, (2) Extending beyond the single mediator context, (3) Identifying appropriate datasets in which measurement and temporal ordering supports the hypothesized mediation model, (4) Selecting mediation effects that reflect the scientific question of interest, (5) Assessing the validity of underlying assumptions of no omitted confounders, (6) Addressing measurement error regarding the mediator, and (7) Clearly reporting results from mediation analyses. We discuss each challenge and highlight ways in which the applied researcher can approach these challenges.
△ Less
Submitted 1 February, 2024;
originally announced February 2024.
-
A tutorial for using propensity score weighting for moderation analysis: an application to smoking disparities among sexual minority adults
Authors:
Beth Ann Griffin,
Megan S. Schuler,
Matt Cefalu,
Lynsay Ayer,
Mark Godley,
Noah Greifer,
Donna L. Coffman,
Daniel McCaffrey
Abstract:
Objective. To provide step-by-step guidance and STATA and R code for using propensity score (PS) weighting to estimate moderation effects. Research Design. Tutorial illustrating the key steps for estimating and testing moderation using observational data. Steps include (1) examining covariate overlap across treatment groups within levels of the moderator, (2) estimating the PS weights, (3) evaluat…
▽ More
Objective. To provide step-by-step guidance and STATA and R code for using propensity score (PS) weighting to estimate moderation effects. Research Design. Tutorial illustrating the key steps for estimating and testing moderation using observational data. Steps include (1) examining covariate overlap across treatment groups within levels of the moderator, (2) estimating the PS weights, (3) evaluating whether PS weights improved covariate balance, (4) estimating moderated treatment effects, and (5) assessing sensitivity of findings to unobserved confounding. Our illustrative case study uses data from 41,832 adults from the 2019 National Survey on Drug Use and Health to examine if gender moderates the association between sexual minority status (e.g., lesbian, gay, or bisexual [LGB] identity) and adult smoking prevalence. Results. For our case study, there were no noted concerns about covariate overlap and we were able to successfully estimate the PS weights within each level of the moderator. Moreover, balance criteria indicated that PS weights successfully achieved covariate balance for both moderator groups. PS weighted results indicated there was significant evidence of moderation for the case study and sensitivity analyses demonstrated that results were highly robust for one level of the moderator but not the other. Conclusions. When conducting moderation analyses, covariate imbalances across levels of the moderator can cause biased estimates. As demonstrated in this tutorial, PS weighting within each level of the moderator can improve the estimated moderation effects by minimizing bias from imbalance within the moderator subgroups.
△ Less
Submitted 9 May, 2023; v1 submitted 7 April, 2022;
originally announced April 2022.
-
A causal approach to functional mediation analysis with application to a smoking cessation intervention
Authors:
Donna L. Coffman,
John J. Dziak,
Kaylee Litson,
Yajnaseni Chakraborti,
Megan E. Piper,
Runze Li
Abstract:
The increase in the use of mobile and wearable devices now allows dense assessment of mediating processes over time. For example, a pharmacological intervention may have an effect on smoking cessation via reductions in momentary withdrawal symptoms. We define and identify the causal direct and indirect effects in terms of potential outcomes on the mean difference and odds ratio scales, and present…
▽ More
The increase in the use of mobile and wearable devices now allows dense assessment of mediating processes over time. For example, a pharmacological intervention may have an effect on smoking cessation via reductions in momentary withdrawal symptoms. We define and identify the causal direct and indirect effects in terms of potential outcomes on the mean difference and odds ratio scales, and present a method for estimating and testing the indirect effect of a randomized treatment on a distal binary variable as mediated by the nonparametric trajectory of an intensively measured longitudinal variable (e.g., from ecological momentary assessment). Coverage of a bootstrap test for the indirect effect is demonstrated via simulation. An empirical example is presented based on estimating later smoking abstinence from patterns of craving during smoking cessation treatment. We provide an R package, funmediation, available on CRAN, to conveniently apply this technique. We conclude by discussing possible extensions to multiple mediators and directions for future research.
△ Less
Submitted 17 November, 2022; v1 submitted 7 December, 2021;
originally announced December 2021.
-
Estimation and Inference for the Mediation Effect in a Time-varying Mediation Model
Authors:
Xizhen Cai,
Donna L. Coffman,
Megan E. Piper,
Runze Li
Abstract:
Traditional mediation analysis typically examines the relations among an intervention, a time-invariant mediator, and a time-invariant outcome variable. Although there may be a direct effect of the intervention on the outcome, there is a need to understand the process by which the intervention affects the outcome (i.e. the indirect effect through the mediator). This indirect effect is frequently a…
▽ More
Traditional mediation analysis typically examines the relations among an intervention, a time-invariant mediator, and a time-invariant outcome variable. Although there may be a direct effect of the intervention on the outcome, there is a need to understand the process by which the intervention affects the outcome (i.e. the indirect effect through the mediator). This indirect effect is frequently assumed to be time-invariant. With improvements in data collection technology, it is possible to obtain repeated assessments over time resulting in intensive longitudinal data. This calls for an extension of traditional mediation analysis to incorporate time-varying variables as well as time-varying effects. In this paper, we focus on estimation and inference for the time-varying mediation model, which allows mediation effects to vary as a function of time. We propose a two-step approach to estimate the time-varying mediation effect. Moreover, we use a simulation based approach to derive the corresponding point-wise confidence band for the time-varying mediation effect. Simulation studies show that the proposed procedures perform well when comparing the confidence band and the true underlying model. We further apply the proposed model and the statistical inference procedure to real-world data collected from a smoking cessation study.
△ Less
Submitted 26 August, 2020;
originally announced August 2020.
-
Nonparametric Estimation of Population Average Dose-Response Curves using Entropy Balancing Weights for Continuous Exposures
Authors:
Brian G. Vegetabile,
Beth Ann Griffin,
Donna L. Coffman,
Matthew Cefalu,
Daniel F. McCaffrey
Abstract:
Weighted estimators are commonly used for estimating exposure effects in observational settings to establish causal relations. These estimators have a long history of development when the exposure of interest is binary and where the weights are typically functions of an estimated propensity score. Recent developments in optimization-based estimators for constructing weights in binary exposure sett…
▽ More
Weighted estimators are commonly used for estimating exposure effects in observational settings to establish causal relations. These estimators have a long history of development when the exposure of interest is binary and where the weights are typically functions of an estimated propensity score. Recent developments in optimization-based estimators for constructing weights in binary exposure settings, such as those based on entropy balancing, have shown more promise in estimating treatment effects than those methods that focus on the direct estimation of the propensity score using likelihood-based methods. This paper explores recent developments of entropy balancing methods to continuous exposure settings and the estimation of population dose-response curves using nonparametric estimation combined with entropy balancing weights, focusing on factors that would be important to applied researchers in medical or health services research. The methods developed here are applied to data from a study assessing the effect of non-randomized components of an evidence-based substance use treatment program on emotional and substance use clinical outcomes.
△ Less
Submitted 5 March, 2020;
originally announced March 2020.
