Article Version of Record

How large must an associational mean difference be to support a causal effect?

Author(s) / Creator(s)

Höfler, Michael
Pronizius, Ekaterina
Buchanan, Erin

Abstract / Description

An observational study might support a causal claim if the association found cannot be explained by bias due to unconsidered confounders. This bias depends on how strongly the common predisposition, a summary of unconsidered confounders, is related to the factor and the outcome. For a positive effect to be supported, the product of these two relations must be smaller than the left boundary of the confidence interval for, e.g., a standardised mean difference (d). We suggest means to derive heuristics for how large this product must be to serve as a confirmatory threshold. We also provide non-technical, visual means to express researchers’ assumptions on the two relations to assess whether a finding on d is explainable by omitted confounders. The ViSe tool, available as an R package and Shiny application, allows users to choose between various effect sizes and apply it to their own data or published summary results.

Keyword(s)

causality confirmation observational studies effect size visualisation software

Persistent Identifier

Date of first publication

2024-12-23

Journal title

Methodology

Volume

20

Issue

4

Page numbers

318–335

Publisher

PsychOpen GOLD

Publication status

publishedVersion

Review status

peerReviewed

Is version of

Citation

Höfler, M., Pronizius, E., & Buchanan, E. (2024). How large must an associational mean difference be to support a causal effect?. Methodology, 20(4), 318-335. https://doi.org/10.5964/meth.14579
  • Author(s) / Creator(s)
    Höfler, Michael
  • Author(s) / Creator(s)
    Pronizius, Ekaterina
  • Author(s) / Creator(s)
    Buchanan, Erin
  • PsychArchives acquisition timestamp
    2025-04-25T11:32:58Z
  • Made available on
    2025-04-25T11:32:58Z
  • Date of first publication
    2024-12-23
  • Abstract / Description
    An observational study might support a causal claim if the association found cannot be explained by bias due to unconsidered confounders. This bias depends on how strongly the common predisposition, a summary of unconsidered confounders, is related to the factor and the outcome. For a positive effect to be supported, the product of these two relations must be smaller than the left boundary of the confidence interval for, e.g., a standardised mean difference (d). We suggest means to derive heuristics for how large this product must be to serve as a confirmatory threshold. We also provide non-technical, visual means to express researchers’ assumptions on the two relations to assess whether a finding on d is explainable by omitted confounders. The ViSe tool, available as an R package and Shiny application, allows users to choose between various effect sizes and apply it to their own data or published summary results.
    en_US
  • Publication status
    publishedVersion
  • Review status
    peerReviewed
  • Citation
    Höfler, M., Pronizius, E., & Buchanan, E. (2024). How large must an associational mean difference be to support a causal effect?. Methodology, 20(4), 318-335. https://doi.org/10.5964/meth.14579
  • ISSN
    1614-2241
  • Persistent Identifier
    https://hdl.handle.net/20.500.12034/11697
  • Persistent Identifier
    https://doi.org/10.23668/psycharchives.16285
  • Language of content
    eng
  • Publisher
    PsychOpen GOLD
  • Is version of
    https://doi.org/10.5964/meth.14579
  • Keyword(s)
    causality
    en_US
  • Keyword(s)
    confirmation
    en_US
  • Keyword(s)
    observational studies
    en_US
  • Keyword(s)
    effect size
    en_US
  • Keyword(s)
    visualisation
    en_US
  • Keyword(s)
    software
    en_US
  • Dewey Decimal Classification number(s)
    150
  • Title
    How large must an associational mean difference be to support a causal effect?
    en_US
  • DRO type
    article
  • Issue
    4
  • Journal title
    Methodology
  • Page numbers
    318–335
  • Volume
    20
  • Visible tag(s)
    Version of Record