Digital Warmth but not Digital Hope? How AI- vs. Therapist Guidance shape Common Factors in Digital Mental Health Interventions
This article is a preprint and has not been certified by peer review [What does this mean?].
Author(s) / Creator(s)
Schaeuffele, Carmen
Heinrich, Manuel
Aulenkamp, Jana
Heim, Phileas
Kalhorn, Hugo
Klein, Martin
Knaevelsrud, Christine
Meyer, Tessa
Zagorscak, Pavle
Abstract / Description
Background: Human guidance is one of the most effective components of digital mental health interventions (DMHIs). The emergence of artifical intelligence (AI) capable of generating empathic, contextually relevant responses raises the question of whether AI-generated feedback can replicate the therapeutic mechanisms that make human guidance effective, and whether users would accept it.
Methods: In a preregistered 2×2 vignette experiment, N = 116 participants rated feedback responses generated either by a human therapist or an AI on five common factors of psychotherapy (therapeutic alliance, empathy, expectations, congruence, and competence) as well as their acceptance of DMHIs. Feedback source (human vs. AI) and transparency (disclosed vs. undisclosed) were manipulated between participants.
Results: Contrary to our hypothesis, AI-generated feedback did not outperform therapist-written feedback on the five common factors. Therapist feedback was perceived as more effective at instilling hope and belief in improvement, regardless of the transparency condition. Disclosure of AI authorship did not significantly affect common factor ratings. Participants in the AI disclosed condition reported lower expected helpfulness of AI-based DMHIs than undisclosed participants.
Conclusions: AI-generated feedback can mimic most therapeutic common factors but falls short on expectation enhancement. Transparency about AI involvement does not undermine perceived feedback quality but may reduce openness to DMHIs.
Keyword(s)
large language models artificial intelligence empathy expectations common factors guidance digital mental health interventionPersistent Identifier
Date of first publication
2026-09-06
Publisher
PsychArchives
Citation
-
digital_warmth_preprint.pdfAdobe PDF - 697.07KBMD5 : f675b9ce6b743a400278b513f5374684
-
There are no other versions of this object.
-
Author(s) / Creator(s)Schaeuffele, Carmen
-
Author(s) / Creator(s)Heinrich, Manuel
-
Author(s) / Creator(s)Aulenkamp, Jana
-
Author(s) / Creator(s)Heim, Phileas
-
Author(s) / Creator(s)Kalhorn, Hugo
-
Author(s) / Creator(s)Klein, Martin
-
Author(s) / Creator(s)Knaevelsrud, Christine
-
Author(s) / Creator(s)Meyer, Tessa
-
Author(s) / Creator(s)Zagorscak, Pavle
-
PsychArchives acquisition timestamp2026-09-06T18:56:32Z
-
Made available on2026-09-06T18:56:32Z
-
Date of first publication2026-09-06
-
Abstract / DescriptionBackground: Human guidance is one of the most effective components of digital mental health interventions (DMHIs). The emergence of artifical intelligence (AI) capable of generating empathic, contextually relevant responses raises the question of whether AI-generated feedback can replicate the therapeutic mechanisms that make human guidance effective, and whether users would accept it. Methods: In a preregistered 2×2 vignette experiment, N = 116 participants rated feedback responses generated either by a human therapist or an AI on five common factors of psychotherapy (therapeutic alliance, empathy, expectations, congruence, and competence) as well as their acceptance of DMHIs. Feedback source (human vs. AI) and transparency (disclosed vs. undisclosed) were manipulated between participants. Results: Contrary to our hypothesis, AI-generated feedback did not outperform therapist-written feedback on the five common factors. Therapist feedback was perceived as more effective at instilling hope and belief in improvement, regardless of the transparency condition. Disclosure of AI authorship did not significantly affect common factor ratings. Participants in the AI disclosed condition reported lower expected helpfulness of AI-based DMHIs than undisclosed participants. Conclusions: AI-generated feedback can mimic most therapeutic common factors but falls short on expectation enhancement. Transparency about AI involvement does not undermine perceived feedback quality but may reduce openness to DMHIs.en
-
Publication statusother
-
Review statusnotReviewed
-
Persistent Identifierhttps://hdl.handle.net/20.500.12034/17806
-
Persistent Identifierhttps://doi.org/10.23668/psycharchives.22456
-
Language of contenteng
-
PublisherPsychArchives
-
Keyword(s)large language models
-
Keyword(s)artificial intelligence
-
Keyword(s)empathy
-
Keyword(s)expectations
-
Keyword(s)common factors
-
Keyword(s)guidance
-
Keyword(s)digital mental health intervention
-
Dewey Decimal Classification number(s)150
-
TitleDigital Warmth but not Digital Hope? How AI- vs. Therapist Guidance shape Common Factors in Digital Mental Health Interventionsen
-
DRO typepreprint