Preprint

Digital Warmth but not Digital Hope? How AI- vs. Therapist Guidance shape Common Factors in Digital Mental Health Interventions

This article is a preprint and has not been certified by peer review [What does this mean?].

Author(s) / Creator(s)

Schaeuffele, Carmen
Heinrich, Manuel
Aulenkamp, Jana
Heim, Phileas
Kalhorn, Hugo
Klein, Martin
Knaevelsrud, Christine
Meyer, Tessa
Zagorscak, Pavle

Abstract / Description

Background: Human guidance is one of the most effective components of digital mental health interventions (DMHIs). The emergence of artifical intelligence (AI) capable of generating empathic, contextually relevant responses raises the question of whether AI-generated feedback can replicate the therapeutic mechanisms that make human guidance effective, and whether users would accept it. Methods: In a preregistered 2×2 vignette experiment, N = 116 participants rated feedback responses generated either by a human therapist or an AI on five common factors of psychotherapy (therapeutic alliance, empathy, expectations, congruence, and competence) as well as their acceptance of DMHIs. Feedback source (human vs. AI) and transparency (disclosed vs. undisclosed) were manipulated between participants. Results: Contrary to our hypothesis, AI-generated feedback did not outperform therapist-written feedback on the five common factors. Therapist feedback was perceived as more effective at instilling hope and belief in improvement, regardless of the transparency condition. Disclosure of AI authorship did not significantly affect common factor ratings. Participants in the AI disclosed condition reported lower expected helpfulness of AI-based DMHIs than undisclosed participants. Conclusions: AI-generated feedback can mimic most therapeutic common factors but falls short on expectation enhancement. Transparency about AI involvement does not undermine perceived feedback quality but may reduce openness to DMHIs.

Keyword(s)

large language models artificial intelligence empathy expectations common factors guidance digital mental health intervention

Persistent Identifier

Date of first publication

2026-09-06

Publisher

PsychArchives

Citation

  • Author(s) / Creator(s)
    Schaeuffele, Carmen
  • Author(s) / Creator(s)
    Heinrich, Manuel
  • Author(s) / Creator(s)
    Aulenkamp, Jana
  • Author(s) / Creator(s)
    Heim, Phileas
  • Author(s) / Creator(s)
    Kalhorn, Hugo
  • Author(s) / Creator(s)
    Klein, Martin
  • Author(s) / Creator(s)
    Knaevelsrud, Christine
  • Author(s) / Creator(s)
    Meyer, Tessa
  • Author(s) / Creator(s)
    Zagorscak, Pavle
  • PsychArchives acquisition timestamp
    2026-09-06T18:56:32Z
  • Made available on
    2026-09-06T18:56:32Z
  • Date of first publication
    2026-09-06
  • Abstract / Description
    Background: Human guidance is one of the most effective components of digital mental health interventions (DMHIs). The emergence of artifical intelligence (AI) capable of generating empathic, contextually relevant responses raises the question of whether AI-generated feedback can replicate the therapeutic mechanisms that make human guidance effective, and whether users would accept it. Methods: In a preregistered 2×2 vignette experiment, N = 116 participants rated feedback responses generated either by a human therapist or an AI on five common factors of psychotherapy (therapeutic alliance, empathy, expectations, congruence, and competence) as well as their acceptance of DMHIs. Feedback source (human vs. AI) and transparency (disclosed vs. undisclosed) were manipulated between participants. Results: Contrary to our hypothesis, AI-generated feedback did not outperform therapist-written feedback on the five common factors. Therapist feedback was perceived as more effective at instilling hope and belief in improvement, regardless of the transparency condition. Disclosure of AI authorship did not significantly affect common factor ratings. Participants in the AI disclosed condition reported lower expected helpfulness of AI-based DMHIs than undisclosed participants. Conclusions: AI-generated feedback can mimic most therapeutic common factors but falls short on expectation enhancement. Transparency about AI involvement does not undermine perceived feedback quality but may reduce openness to DMHIs.
    en
  • Publication status
    other
  • Review status
    notReviewed
  • Persistent Identifier
    https://hdl.handle.net/20.500.12034/17806
  • Persistent Identifier
    https://doi.org/10.23668/psycharchives.22456
  • Language of content
    eng
  • Publisher
    PsychArchives
  • Keyword(s)
    large language models
  • Keyword(s)
    artificial intelligence
  • Keyword(s)
    empathy
  • Keyword(s)
    expectations
  • Keyword(s)
    common factors
  • Keyword(s)
    guidance
  • Keyword(s)
    digital mental health intervention
  • Dewey Decimal Classification number(s)
    150
  • Title
    Digital Warmth but not Digital Hope? How AI- vs. Therapist Guidance shape Common Factors in Digital Mental Health Interventions
    en
  • DRO type
    preprint