Showing 1–9 of 9 results for author: Scharfstein, D O

Sensitivity analysis for principal ignorability violation in estimating complier and noncomplier average causal effects

Authors: Trang Quynh Nguyen, Elizabeth A. Stuart, Daniel O. Scharfstein, Elizabeth L. Ogburn

Abstract: An important strategy for identifying principal causal effects, which are often used in settings with noncompliance, is to invoke the principal ignorability (PI) assumption. As PI is untestable, it is important to gauge how sensitive effect estimates are to its violation. We focus on this task for the common one-sided noncompliance setting where there are two principal strata, compliers and noncom… ▽ More An important strategy for identifying principal causal effects, which are often used in settings with noncompliance, is to invoke the principal ignorability (PI) assumption. As PI is untestable, it is important to gauge how sensitive effect estimates are to its violation. We focus on this task for the common one-sided noncompliance setting where there are two principal strata, compliers and noncompliers. Under PI, compliers and noncompliers share the same outcome-mean-given-covariates function under the control condition. For sensitivity analysis, we allow this function to differ between compliers and noncompliers in several ways, indexed by an odds ratio, a generalized odds ratio, a mean ratio, or a standardized mean difference sensitivity parameter. We tailor sensitivity analysis techniques (with any sensitivity parameter choice) to several types of PI-based main analysis methods, including outcome regression, influence function (IF) based and weighting methods. We illustrate the proposed sensitivity analyses using several outcome types from the JOBS II study. This application estimates nuisance functions parametrically -- for simplicity and accessibility. In addition, we establish rate conditions on nonparametric nuisance estimation for IF-based estimators to be asymptotically normal -- with a view to inform nonparametric inference. △ Less

Submitted 28 March, 2024; v1 submitted 8 March, 2023; originally announced March 2023.

Semi-Parametric Sensitivity Analysis for Trials with Irregular and Informative Assessment Times

Authors: Bonnie B. Smith, Yu**g Gao, Shu Yang, Ravi Varadhan, Andrea J. Apter, Daniel O. Scharfstein

Abstract: Many trials are designed to collect outcomes at or around pre-specified times after randomization. In practice, there can be substantial variability in the times when participants are actually assessed. Such irregular assessment times pose a challenge to learning the effect of treatment since not all participants have outcome assessments at the times of interest. Furthermore, observed outcome valu… ▽ More Many trials are designed to collect outcomes at or around pre-specified times after randomization. In practice, there can be substantial variability in the times when participants are actually assessed. Such irregular assessment times pose a challenge to learning the effect of treatment since not all participants have outcome assessments at the times of interest. Furthermore, observed outcome values may not be representative of all participants' outcomes at a given time. This problem, known as informative assessment times, can arise if participants tend to have assessments when their outcomes are better (or worse) than at other times, or if participants with better outcomes tend to have more (or fewer) assessments. Methods have been developed that account for some types of informative assessment; however, since these methods rely on untestable assumptions, sensitivity analyses are needed. We develop a sensitivity analysis methodology by extending existing weighting methods. Our method accounts for the possibility that participants with worse outcomes at a given time are more (or less) likely than other participants to have an assessment at that time, even after controlling for variables observed earlier in the study. We apply our method to a randomized trial of low-income individuals with uncontrolled asthma. We illustrate implementation of our influence-function based estimation procedure in detail, and we derive the large-sample distribution of our estimator and evaluate its finite-sample performance. △ Less

Submitted 5 November, 2023; v1 submitted 25 April, 2022; originally announced April 2022.

Comments: Revised to include more implementation details, including a tutorial implementing our estimator, and using a more flexible outcome modeling approach in the data analysis

Markov-Restricted Analysis of Randomized Trials with Non-Monotone Missing Binary Outcomes: Sensitivity Analysis and Identification Results

Authors: Daniel O. Scharfstein, Jaron J. R. Lee, Aidan McDermott, Aimee Campbell, Edward Nunes, Abigail G. Matthews, Ilya Shpitser

Abstract: Scharfstein et al. (2021) developed a sensitivity analysis model for analyzing randomized trials with repeatedly measured binary outcomes that are subject to nonmonotone missingness. Their approach becomes computationally intractable when the number of repeated measured is large (e.g., greater than 15). In this paper, we repair this problem by introducing an $m$th-order Markovian restriction. We e… ▽ More Scharfstein et al. (2021) developed a sensitivity analysis model for analyzing randomized trials with repeatedly measured binary outcomes that are subject to nonmonotone missingness. Their approach becomes computationally intractable when the number of repeated measured is large (e.g., greater than 15). In this paper, we repair this problem by introducing an $m$th-order Markovian restriction. We establish an identification by representing the model as a directed acyclic graph (DAG). We illustrate our methodology in the context of a randomized trial designed to evaluate a web-delivered psychosocial intervention to reduce substance use, assessed by testing urine samples twice weekly for 12 weeks, among patients entering outpatient addiction treatment. We evaluate the finite sample properties of our method in a realistic simulation study. Our methods have been integrated into the R package entitled slabm. △ Less

Submitted 18 May, 2021; originally announced May 2021.

Semiparametric Sensitivity Analysis: Unmeasured Confounding In Observational Studies

Authors: Daniel O. Scharfstein, Razieh Nabi, Edward H. Kennedy, Ming-Yueh Huang, Matteo Bonvini, Marcela Smid

Abstract: Establishing cause-effect relationships from observational data often relies on untestable assumptions. It is crucial to know whether, and to what extent, the conclusions drawn from non-experimental studies are robust to potential unmeasured confounding. In this paper, we focus on the average causal effect (ACE) as our target of inference. We generalize the sensitivity analysis approach developed… ▽ More Establishing cause-effect relationships from observational data often relies on untestable assumptions. It is crucial to know whether, and to what extent, the conclusions drawn from non-experimental studies are robust to potential unmeasured confounding. In this paper, we focus on the average causal effect (ACE) as our target of inference. We generalize the sensitivity analysis approach developed by Robins et al. (2000), Franks et al. (2020) and Zhou and Yao (2023. We use semiparametric theory to derive the non-parametric efficient influence function of the ACE, for fixed sensitivity parameters. We use this influence function to construct a one-step bias-corrected estimator of the ACE. Our estimator depends on semiparametric models for the distribution of the observed data; importantly, these models do not impose any restrictions on the values of sensitivity analysis parameters. We establish sufficient conditions ensuring that our estimator has root-n asymptotics. We use our methodology to evaluate the causal effect of smoking during pregnancy on birth weight. We also evaluate the performance of estimation procedure in a simulation study. △ Less

Submitted 3 November, 2023; v1 submitted 16 April, 2021; originally announced April 2021.

Causal Effects in Twin Studies: the Role of Interference

Authors: Bonnie Smith, Elizabeth L. Ogburn, Matt McGue, Saonli Basu, Daniel O. Scharfstein

Abstract: The use of twins designs to address causal questions is becoming increasingly popular. A standard assumption is that there is no interference between twins---that is, no twin's exposure has a causal impact on their co-twin's outcome. However, there may be settings in which this assumption would not hold, and this would (1) impact the causal interpretation of parameters obtained by commonly used ex… ▽ More The use of twins designs to address causal questions is becoming increasingly popular. A standard assumption is that there is no interference between twins---that is, no twin's exposure has a causal impact on their co-twin's outcome. However, there may be settings in which this assumption would not hold, and this would (1) impact the causal interpretation of parameters obtained by commonly used existing methods; (2) change which effects are of greatest interest; and (3) impact the conditions under which we may estimate these effects. We explore these issues, and we derive semi-parametric efficient estimators for causal effects in the presence of interference between twins. Using data from the Minnesota Twin Family Study, we apply our estimators to assess whether twins' consumption of alcohol in early adolescence may have a causal impact on their co-twins' substance use later in life. △ Less

Submitted 8 July, 2020; originally announced July 2020.

Causal Inference for Comprehensive Cohort Studies

Authors: Yi Lu, Daniel O. Scharfstein, Maria M. Brooks, Kevin Quach, Edward H. Kennedy

Abstract: In a comprehensive cohort study of two competing treatments (say, A and B), clinically eligible individuals are first asked to enroll in a randomized trial and, if they refuse, are then asked to enroll in a parallel observational study in which they can choose treatment according to their own preference. We consider estimation of two estimands: (1) comprehensive cohort causal effect -- the differe… ▽ More In a comprehensive cohort study of two competing treatments (say, A and B), clinically eligible individuals are first asked to enroll in a randomized trial and, if they refuse, are then asked to enroll in a parallel observational study in which they can choose treatment according to their own preference. We consider estimation of two estimands: (1) comprehensive cohort causal effect -- the difference in mean potential outcomes had all patients in the comprehensive cohort received treatment A vs. treatment B and (2) randomized trial causal effect -- the difference in mean potential outcomes had all patients enrolled in the randomized trial received treatment A vs. treatment B. For each estimand, we consider inference under various sets of unconfoundedness assumptions and construct semiparametric efficient and robust estimators. These estimators depend on nuisance functions, which we estimate, for illustrative purposes, using generalized additive models. Using the theory of sample splitting, we establish the asymptotic properties of our proposed estimators. We also illustrate our methodology using data from the Bypass Angioplasty Revascularization Investigation (BARI) randomized trial and observational registry to evaluate the effect of percutaneous transluminal coronary balloon angioplasty versus coronary artery bypass grafting on 5-year mortality. To evaluate the finite sample performance of our estimators, we use the BARI dataset as the basis of a realistic simulation study. △ Less

Submitted 8 October, 2019; originally announced October 2019.

Comments: 34 pages, 1 figure, 3 tables

Brand vs. Generic: Addressing Non-Adherence, Secular Trends, and Non-Overlap

Authors: Lamar Hunt III, Irene B. Murimi, Jodi B. Segal, Marissa J. Seamans, Daniel O. Scharfstein, Ravi Varadhan

Abstract: While generic drugs offer a cost-effective alternative to brand name drugs, regulators need a method to assess therapeutic equivalence in a post market setting. We develop such a method in the context of assessing the therapeutic equivalence of immediate release (IM) venlafaxine, based on a large insurance claims dataset provided by OptumLabs\textsuperscript{\textregistered}. To properly address t… ▽ More While generic drugs offer a cost-effective alternative to brand name drugs, regulators need a method to assess therapeutic equivalence in a post market setting. We develop such a method in the context of assessing the therapeutic equivalence of immediate release (IM) venlafaxine, based on a large insurance claims dataset provided by OptumLabs\textsuperscript{\textregistered}. To properly address this question, our methodology must deal with issues of non-adherence, secular trends in health outcomes, and lack of treatment overlap due to sharp uptake of the generic once it becomes available. We define, identify (under assumptions) and estimate (using G-computation) a causal effect for a time-to-event outcome by extending regression discontinuity to survival curves. We do not find evidence for a lack of therapeutic equivalence of brand and generic IM venlafaxine. △ Less

Submitted 7 July, 2019; originally announced July 2019.

Bayesian inference for a principal stratum estimand to assess the treatment effect in a subgroup characterized by post-randomization events

Authors: Baldur P. Magnusson, Heinz Schmidli, Nicolas Rouyrre, Daniel O. Scharfstein

Abstract: The treatment effect in a specific subgroup is often of interest in randomized clinical trials. When the subgroup is characterized by the absence of certain post-randomization events, a naive analysis on the subset of patients without these events may be misleading. The principal stratification framework allows one to define an appropriate causal estimand in such settings. Statistical inference fo… ▽ More The treatment effect in a specific subgroup is often of interest in randomized clinical trials. When the subgroup is characterized by the absence of certain post-randomization events, a naive analysis on the subset of patients without these events may be misleading. The principal stratification framework allows one to define an appropriate causal estimand in such settings. Statistical inference for the principal stratum estimand hinges on scientifically justified assumptions, which can be included with Bayesian methods through prior distributions. Our motivating example is a large randomized placebo-controlled trial of siponimod in patients with secondary progressive multiple sclerosis. The primary objective of this trial was to demonstrate the efficacy of siponimod relative to placebo in delaying disability progression for the whole study population. However, the treatment effect in the subgroup of patients who would not relapse during the trial is relevant from both a scientific and regulatory perspective. Assessing this subgroup treatment effect is challenging as there is strong evidence that siponimod reduces relapses. Aligned with the draft regulatory guidance ICH E9(R1), we describe in detail the scientific question of interest, the principal stratum estimand, the corresponding analysis method for binary endpoints and sensitivity analyses. △ Less

Submitted 11 September, 2018; originally announced September 2018.

Comments: 16 pages, 2 figures

Estimation of Treatment Effects in Matched-Pair Cluster Randomized Trials by Calibrating Covariate Imbalance between Clusters

Authors: Zhenke Wu, Constantine E. Frangakis, Thomas A. Louis, Daniel O. Scharfstein

Abstract: We address estimation of intervention effects in experimental designs in which (a) interventions are assigned at the cluster level; (b) clusters are selected to form pairs, matched on observed characteristics; and (c) intervention is assigned to one cluster at random within each pair. One goal of policy interest is to estimate the average outcome if all clusters in all pairs are assigned control v… ▽ More We address estimation of intervention effects in experimental designs in which (a) interventions are assigned at the cluster level; (b) clusters are selected to form pairs, matched on observed characteristics; and (c) intervention is assigned to one cluster at random within each pair. One goal of policy interest is to estimate the average outcome if all clusters in all pairs are assigned control versus if all clusters in all pairs are assigned to intervention. In such designs, inference that ignores individual level covariates can be imprecise because cluster-level assignment can leave substantial imbalance in the covariate distribution between experimental arms within each pair. However, most existing methods that adjust for covariates have estimands that are not of policy interest. We propose a methodology that explicitly balances the observed covariates among clusters in a pair, and retains the original estimand of interest. We demonstrate our approach through the evaluation of the Guided Care program. △ Less

Submitted 21 November, 2014; originally announced November 2014.

Comments: 27 pages, 3 figures, 3 tables