Combining Doubly Robust Methods and Machine Learning for Estimating Average Treatment Effects for Observational Real-world Data
Authors:
Xiaoqing Tan,
Shu Yang,
Wenyu Ye,
Douglas E. Faries,
Ilya Lipkovich,
Zbigniew Kadziola
Abstract:
Observational cohort studies are increasingly being used for comparative effectiveness research to assess the safety of therapeutics. Recently, various doubly robust methods have been proposed for average treatment effect estimation by combining the treatment model and the outcome model via different vehicles, such as matching, weighting, and regression. The key advantage of doubly robust estimato…
▽ More
Observational cohort studies are increasingly being used for comparative effectiveness research to assess the safety of therapeutics. Recently, various doubly robust methods have been proposed for average treatment effect estimation by combining the treatment model and the outcome model via different vehicles, such as matching, weighting, and regression. The key advantage of doubly robust estimators is that they require either the treatment model or the outcome model to be correctly specified to obtain a consistent estimator of average treatment effects, and therefore lead to a more accurate and often more precise inference. However, little work has been done to understand how doubly robust estimators differ due to their unique strategies of using the treatment and outcome models and how machine learning techniques can be combined to boost their performance. Here we examine multiple popular doubly robust methods and compare their performance using different treatment and outcome modeling via extensive simulations and a real-world application. We found that incorporating machine learning with doubly robust estimators such as the targeted maximum likelihood estimator gives the best overall performance. Practical guidance on how to apply doubly robust estimators is provided.
△ Less
Submitted 9 January, 2024; v1 submitted 22 April, 2022;
originally announced April 2022.
Propensity Score Matching and Subclassification in Observational Studies with Multi-level Treatments
Authors:
Shu Yang,
Guido W. Imbens,
Zhanglin Cui,
Douglas Faries,
Zbigniew Kadziola
Abstract:
In this paper, we develop new methods for estimating average treatment effects in observational studies, focusing on settings with more than two treatment levels under unconfoundedness given pre-treatment variables. We emphasize subclassification and matching methods which have been found to be effective in the binary treatment literature and which are among the most popular methods in that settin…
▽ More
In this paper, we develop new methods for estimating average treatment effects in observational studies, focusing on settings with more than two treatment levels under unconfoundedness given pre-treatment variables. We emphasize subclassification and matching methods which have been found to be effective in the binary treatment literature and which are among the most popular methods in that setting. Whereas the literature has suggested that these particular propensity-based methods do not naturally extend to the multi-level treatment case, we show, using the concept of weak unconfoundedness, that adjusting for or matching on a scalar function of the pre-treatment variables removes all biases associated with observed pre-treatment variables. We apply the proposed methods to an analysis of the effect of treatments for fibromyalgia. We also carry out a simulation study to assess the finite sample performance of the methods relative to previously proposed methods.
△ Less
Submitted 14 December, 2015; v1 submitted 27 August, 2015;
originally announced August 2015.
