A tutorial on individual participant data meta-analysis using Bayesian multilevel modeling to estimate alcohol intervention effects across heterogeneous studies

David Huh, Eun-Young Mun, Scott T. Walters, Zhengyang Zhou, David C. Atkins

Research output: Contribution to journalArticle

1 Citation (Scopus)

Abstract

This paper provides a tutorial companion for the methodological approach implemented in Huh et al. (2015)that overcame two major challenges for individual participant data (IPD)meta-analysis. Specifically, we show how to validly combine data from heterogeneous studies with varying numbers of treatment arms, and how to analyze highly-skewed count outcomes with many zeroes (e.g., alcohol and substance use outcomes)to estimate overall effect sizes. These issues have important implications for the feasibility, applicability, and interpretation of IPD meta-analysis but have received little attention thus far in the applied research literature. We present a Bayesian multilevel modeling approach for combining multi-arm trials (i.e., those with two or more treatment groups)in a distribution-appropriate IPD analysis. Illustrative data come from Project INTEGRATE, an IPD meta-analysis study of brief motivational interventions to reduce excessive alcohol use and related harm among college students. Our approach preserves the original random allocation within studies, combines within-study estimates across all studies, overcomes between-study heterogeneity in trial design (i.e., number of treatment arms)and/or study-level missing data, and derives two related treatment outcomes in a multivariate IPD meta-analysis. This methodological approach is a favorable alternative to collapsing or excluding intervention groups within multi-arm trials, making it possible to directly compare multiple treatment arms in a one-step IPD meta-analysis. To facilitate application of the method, we provide annotated computer code in R along with the example data used in this tutorial.

Original languageEnglish
Pages (from-to)162-170
Number of pages9
JournalAddictive Behaviors
Volume94
DOIs
StatePublished - 1 Jul 2019

Fingerprint

Metadata
Meta-Analysis
Alcohols
Therapeutics
Random Allocation
Students
Research

Keywords

  • Bayesian multilevel modeling
  • Brief motivational intervention
  • College drinking
  • Individual participant data
  • Meta-analysis
  • Multivariate meta-analysis

Cite this

@article{fef9c11fe5804f8f9599e40688263467,
title = "A tutorial on individual participant data meta-analysis using Bayesian multilevel modeling to estimate alcohol intervention effects across heterogeneous studies",
abstract = "This paper provides a tutorial companion for the methodological approach implemented in Huh et al. (2015)that overcame two major challenges for individual participant data (IPD)meta-analysis. Specifically, we show how to validly combine data from heterogeneous studies with varying numbers of treatment arms, and how to analyze highly-skewed count outcomes with many zeroes (e.g., alcohol and substance use outcomes)to estimate overall effect sizes. These issues have important implications for the feasibility, applicability, and interpretation of IPD meta-analysis but have received little attention thus far in the applied research literature. We present a Bayesian multilevel modeling approach for combining multi-arm trials (i.e., those with two or more treatment groups)in a distribution-appropriate IPD analysis. Illustrative data come from Project INTEGRATE, an IPD meta-analysis study of brief motivational interventions to reduce excessive alcohol use and related harm among college students. Our approach preserves the original random allocation within studies, combines within-study estimates across all studies, overcomes between-study heterogeneity in trial design (i.e., number of treatment arms)and/or study-level missing data, and derives two related treatment outcomes in a multivariate IPD meta-analysis. This methodological approach is a favorable alternative to collapsing or excluding intervention groups within multi-arm trials, making it possible to directly compare multiple treatment arms in a one-step IPD meta-analysis. To facilitate application of the method, we provide annotated computer code in R along with the example data used in this tutorial.",
keywords = "Bayesian multilevel modeling, Brief motivational intervention, College drinking, Individual participant data, Meta-analysis, Multivariate meta-analysis",
author = "David Huh and Eun-Young Mun and Walters, {Scott T.} and Zhengyang Zhou and Atkins, {David C.}",
year = "2019",
month = "7",
day = "1",
doi = "10.1016/j.addbeh.2019.01.032",
language = "English",
volume = "94",
pages = "162--170",
journal = "Addictive Behaviors",
issn = "0306-4603",
publisher = "Elsevier Ltd",

}

TY - JOUR

T1 - A tutorial on individual participant data meta-analysis using Bayesian multilevel modeling to estimate alcohol intervention effects across heterogeneous studies

AU - Huh, David

AU - Mun, Eun-Young

AU - Walters, Scott T.

AU - Zhou, Zhengyang

AU - Atkins, David C.

PY - 2019/7/1

Y1 - 2019/7/1

N2 - This paper provides a tutorial companion for the methodological approach implemented in Huh et al. (2015)that overcame two major challenges for individual participant data (IPD)meta-analysis. Specifically, we show how to validly combine data from heterogeneous studies with varying numbers of treatment arms, and how to analyze highly-skewed count outcomes with many zeroes (e.g., alcohol and substance use outcomes)to estimate overall effect sizes. These issues have important implications for the feasibility, applicability, and interpretation of IPD meta-analysis but have received little attention thus far in the applied research literature. We present a Bayesian multilevel modeling approach for combining multi-arm trials (i.e., those with two or more treatment groups)in a distribution-appropriate IPD analysis. Illustrative data come from Project INTEGRATE, an IPD meta-analysis study of brief motivational interventions to reduce excessive alcohol use and related harm among college students. Our approach preserves the original random allocation within studies, combines within-study estimates across all studies, overcomes between-study heterogeneity in trial design (i.e., number of treatment arms)and/or study-level missing data, and derives two related treatment outcomes in a multivariate IPD meta-analysis. This methodological approach is a favorable alternative to collapsing or excluding intervention groups within multi-arm trials, making it possible to directly compare multiple treatment arms in a one-step IPD meta-analysis. To facilitate application of the method, we provide annotated computer code in R along with the example data used in this tutorial.

AB - This paper provides a tutorial companion for the methodological approach implemented in Huh et al. (2015)that overcame two major challenges for individual participant data (IPD)meta-analysis. Specifically, we show how to validly combine data from heterogeneous studies with varying numbers of treatment arms, and how to analyze highly-skewed count outcomes with many zeroes (e.g., alcohol and substance use outcomes)to estimate overall effect sizes. These issues have important implications for the feasibility, applicability, and interpretation of IPD meta-analysis but have received little attention thus far in the applied research literature. We present a Bayesian multilevel modeling approach for combining multi-arm trials (i.e., those with two or more treatment groups)in a distribution-appropriate IPD analysis. Illustrative data come from Project INTEGRATE, an IPD meta-analysis study of brief motivational interventions to reduce excessive alcohol use and related harm among college students. Our approach preserves the original random allocation within studies, combines within-study estimates across all studies, overcomes between-study heterogeneity in trial design (i.e., number of treatment arms)and/or study-level missing data, and derives two related treatment outcomes in a multivariate IPD meta-analysis. This methodological approach is a favorable alternative to collapsing or excluding intervention groups within multi-arm trials, making it possible to directly compare multiple treatment arms in a one-step IPD meta-analysis. To facilitate application of the method, we provide annotated computer code in R along with the example data used in this tutorial.

KW - Bayesian multilevel modeling

KW - Brief motivational intervention

KW - College drinking

KW - Individual participant data

KW - Meta-analysis

KW - Multivariate meta-analysis

UR - http://www.scopus.com/inward/record.url?scp=85061664259&partnerID=8YFLogxK

U2 - 10.1016/j.addbeh.2019.01.032

DO - 10.1016/j.addbeh.2019.01.032

M3 - Article

C2 - 30791977

AN - SCOPUS:85061664259

VL - 94

SP - 162

EP - 170

JO - Addictive Behaviors

JF - Addictive Behaviors

SN - 0306-4603

ER -