Acceptance and motivational effect of AI-driven feedback in the workplace: an experimental study with direct replication

Artificial intelligence (AI) is increasingly taking over leadership tasks in companies, including the provision of feedback. However, the effect of AI-driven feedback on employees and its theoretical foundations are poorly understood. We aimed to close this research gap by comparing perceptions of A...

Full description

Saved in:
Bibliographic Details
Main Authors: Ilka Hein, Julia Cecil, Eva Lermer
Format: Article
Language:English
Published: Frontiers Media S.A. 2024-12-01
Series:Frontiers in Organizational Psychology
Subjects:
Online Access:https://www.frontiersin.org/articles/10.3389/forgp.2024.1468907/full
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1846111692848627712
author Ilka Hein
Julia Cecil
Eva Lermer
Eva Lermer
author_facet Ilka Hein
Julia Cecil
Eva Lermer
Eva Lermer
author_sort Ilka Hein
collection DOAJ
description Artificial intelligence (AI) is increasingly taking over leadership tasks in companies, including the provision of feedback. However, the effect of AI-driven feedback on employees and its theoretical foundations are poorly understood. We aimed to close this research gap by comparing perceptions of AI and human feedback based on construal level theory and the feedback process model. Using these theories, our objective was also to investigate the moderating role of feedback valence and the mediating effect of social distance. A 2 × 2 between-subjects design was applied to manipulate feedback source (human vs. AI) and valence (negative vs. positive) via vignettes. In a preregistered experimental study (S1) and subsequent direct replication (S2), responses from NS1 = 263 and NS2 = 449 participants were studied who completed a German online questionnaire asking for feedback acceptance, performance motivation, social distance, acceptance of the feedback source itself, and intention to seek further feedback. Regression analyses showed that AI feedback was rated as less accurate and led to lower performance motivation, acceptance of the feedback provider, and intention to seek further feedback. These effects were mediated by perceived social distance. Moreover, for feedback acceptance and performance motivation, the differences were only found for positive but not for negative feedback in the first study. This implies that AI feedback may not inherently be perceived as more negatively than human feedback as it depends on the feedback's valence. Furthermore, the mediation effects indicate that the shown negative evaluations of the AI can be explained by higher social distance and that increased social closeness to feedback providers may improve appraisals of them and of their feedback. Theoretical contributions of the studies and implications for the use of AI for providing feedback in the workplace are discussed, emphasizing the influence of effects related to construal level theory.
format Article
id doaj-art-6cf1e5b853794d5c8e835ff6af3d7985
institution Kabale University
issn 2813-771X
language English
publishDate 2024-12-01
publisher Frontiers Media S.A.
record_format Article
series Frontiers in Organizational Psychology
spelling doaj-art-6cf1e5b853794d5c8e835ff6af3d79852024-12-23T06:38:38ZengFrontiers Media S.A.Frontiers in Organizational Psychology2813-771X2024-12-01210.3389/forgp.2024.14689071468907Acceptance and motivational effect of AI-driven feedback in the workplace: an experimental study with direct replicationIlka Hein0Julia Cecil1Eva Lermer2Eva Lermer3Department of Psychology, Ludwig-Maximilians-Universität München, Munich, GermanyDepartment of Psychology, Ludwig-Maximilians-Universität München, Munich, GermanyDepartment of Psychology, Ludwig-Maximilians-Universität München, Munich, GermanyDepartment of Business Psychology, Technical University of Applied Sciences Augsburg, Augsburg, GermanyArtificial intelligence (AI) is increasingly taking over leadership tasks in companies, including the provision of feedback. However, the effect of AI-driven feedback on employees and its theoretical foundations are poorly understood. We aimed to close this research gap by comparing perceptions of AI and human feedback based on construal level theory and the feedback process model. Using these theories, our objective was also to investigate the moderating role of feedback valence and the mediating effect of social distance. A 2 × 2 between-subjects design was applied to manipulate feedback source (human vs. AI) and valence (negative vs. positive) via vignettes. In a preregistered experimental study (S1) and subsequent direct replication (S2), responses from NS1 = 263 and NS2 = 449 participants were studied who completed a German online questionnaire asking for feedback acceptance, performance motivation, social distance, acceptance of the feedback source itself, and intention to seek further feedback. Regression analyses showed that AI feedback was rated as less accurate and led to lower performance motivation, acceptance of the feedback provider, and intention to seek further feedback. These effects were mediated by perceived social distance. Moreover, for feedback acceptance and performance motivation, the differences were only found for positive but not for negative feedback in the first study. This implies that AI feedback may not inherently be perceived as more negatively than human feedback as it depends on the feedback's valence. Furthermore, the mediation effects indicate that the shown negative evaluations of the AI can be explained by higher social distance and that increased social closeness to feedback providers may improve appraisals of them and of their feedback. Theoretical contributions of the studies and implications for the use of AI for providing feedback in the workplace are discussed, emphasizing the influence of effects related to construal level theory.https://www.frontiersin.org/articles/10.3389/forgp.2024.1468907/fullartificial intelligenceleadershipautomated leadershipfeedbackconstrual level theoryfeedback process model
spellingShingle Ilka Hein
Julia Cecil
Eva Lermer
Eva Lermer
Acceptance and motivational effect of AI-driven feedback in the workplace: an experimental study with direct replication
Frontiers in Organizational Psychology
artificial intelligence
leadership
automated leadership
feedback
construal level theory
feedback process model
title Acceptance and motivational effect of AI-driven feedback in the workplace: an experimental study with direct replication
title_full Acceptance and motivational effect of AI-driven feedback in the workplace: an experimental study with direct replication
title_fullStr Acceptance and motivational effect of AI-driven feedback in the workplace: an experimental study with direct replication
title_full_unstemmed Acceptance and motivational effect of AI-driven feedback in the workplace: an experimental study with direct replication
title_short Acceptance and motivational effect of AI-driven feedback in the workplace: an experimental study with direct replication
title_sort acceptance and motivational effect of ai driven feedback in the workplace an experimental study with direct replication
topic artificial intelligence
leadership
automated leadership
feedback
construal level theory
feedback process model
url https://www.frontiersin.org/articles/10.3389/forgp.2024.1468907/full
work_keys_str_mv AT ilkahein acceptanceandmotivationaleffectofaidrivenfeedbackintheworkplaceanexperimentalstudywithdirectreplication
AT juliacecil acceptanceandmotivationaleffectofaidrivenfeedbackintheworkplaceanexperimentalstudywithdirectreplication
AT evalermer acceptanceandmotivationaleffectofaidrivenfeedbackintheworkplaceanexperimentalstudywithdirectreplication
AT evalermer acceptanceandmotivationaleffectofaidrivenfeedbackintheworkplaceanexperimentalstudywithdirectreplication