A comparison of the persuasiveness of human and ChatGPT generated pro-vaccine messages for HPV

IntroductionPublic health messaging is crucial for promoting beneficial health outcomes, and the latest advancements in artificial intelligence offer new opportunities in this field. This study aimed to evaluate the effectiveness of ChatGPT-4 in generating pro-vaccine messages on different topics fo...

Full description

Saved in:
Bibliographic Details
Main Authors: Dengke Xia, Mengyao Song, Tingshao Zhu
Format: Article
Language:English
Published: Frontiers Media S.A. 2025-01-01
Series:Frontiers in Public Health
Subjects:
Online Access:https://www.frontiersin.org/articles/10.3389/fpubh.2024.1515871/full
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1841526822953549824
author Dengke Xia
Dengke Xia
Mengyao Song
Mengyao Song
Tingshao Zhu
Tingshao Zhu
author_facet Dengke Xia
Dengke Xia
Mengyao Song
Mengyao Song
Tingshao Zhu
Tingshao Zhu
author_sort Dengke Xia
collection DOAJ
description IntroductionPublic health messaging is crucial for promoting beneficial health outcomes, and the latest advancements in artificial intelligence offer new opportunities in this field. This study aimed to evaluate the effectiveness of ChatGPT-4 in generating pro-vaccine messages on different topics for Human Papillomavirus (HPV) vaccination.MethodsIn this study (N = 60), we examined the persuasive effect of pro-vaccine messages generated by GPT-4 and humans, which were constructed based on 17 factors impacting HPV vaccination. Paired-samples t-tests were used to compare the persuasiveness of these messages.ResultsGPT-generated messages were reported as more persuasive than human-generated messages on some influencing factors (e.g., untoward effect, stigmatized perception). Human-generated messages performed better on the message regarding convenience of vaccination.DiscussionThis study provides evidence for the viability of ChatGPT, in generating persuasive pro-vaccine messages to influence people’s vaccine attitudes. It is indicated that the feasibility and efficiency of using AI for public health communication.
format Article
id doaj-art-bb6bc2427ba8441eb1d8a000d8aa57d4
institution Kabale University
issn 2296-2565
language English
publishDate 2025-01-01
publisher Frontiers Media S.A.
record_format Article
series Frontiers in Public Health
spelling doaj-art-bb6bc2427ba8441eb1d8a000d8aa57d42025-01-16T11:07:14ZengFrontiers Media S.A.Frontiers in Public Health2296-25652025-01-011210.3389/fpubh.2024.15158711515871A comparison of the persuasiveness of human and ChatGPT generated pro-vaccine messages for HPVDengke Xia0Dengke Xia1Mengyao Song2Mengyao Song3Tingshao Zhu4Tingshao Zhu5Department of Psychology, Shandong Second Medical University, Weifang, ChinaCAS Key Laboratory of Behavioral Science, Institute of Psychology, Chinese Academy of Sciences, Beijing, ChinaCAS Key Laboratory of Behavioral Science, Institute of Psychology, Chinese Academy of Sciences, Beijing, ChinaDepartment of Psychology, University of Chinese Academy of Sciences, Beijing, ChinaCAS Key Laboratory of Behavioral Science, Institute of Psychology, Chinese Academy of Sciences, Beijing, ChinaDepartment of Psychology, University of Chinese Academy of Sciences, Beijing, ChinaIntroductionPublic health messaging is crucial for promoting beneficial health outcomes, and the latest advancements in artificial intelligence offer new opportunities in this field. This study aimed to evaluate the effectiveness of ChatGPT-4 in generating pro-vaccine messages on different topics for Human Papillomavirus (HPV) vaccination.MethodsIn this study (N = 60), we examined the persuasive effect of pro-vaccine messages generated by GPT-4 and humans, which were constructed based on 17 factors impacting HPV vaccination. Paired-samples t-tests were used to compare the persuasiveness of these messages.ResultsGPT-generated messages were reported as more persuasive than human-generated messages on some influencing factors (e.g., untoward effect, stigmatized perception). Human-generated messages performed better on the message regarding convenience of vaccination.DiscussionThis study provides evidence for the viability of ChatGPT, in generating persuasive pro-vaccine messages to influence people’s vaccine attitudes. It is indicated that the feasibility and efficiency of using AI for public health communication.https://www.frontiersin.org/articles/10.3389/fpubh.2024.1515871/fulllarge language modelsAI-mediated communicationpersuasionpublic health messagesmessage factors
spellingShingle Dengke Xia
Dengke Xia
Mengyao Song
Mengyao Song
Tingshao Zhu
Tingshao Zhu
A comparison of the persuasiveness of human and ChatGPT generated pro-vaccine messages for HPV
Frontiers in Public Health
large language models
AI-mediated communication
persuasion
public health messages
message factors
title A comparison of the persuasiveness of human and ChatGPT generated pro-vaccine messages for HPV
title_full A comparison of the persuasiveness of human and ChatGPT generated pro-vaccine messages for HPV
title_fullStr A comparison of the persuasiveness of human and ChatGPT generated pro-vaccine messages for HPV
title_full_unstemmed A comparison of the persuasiveness of human and ChatGPT generated pro-vaccine messages for HPV
title_short A comparison of the persuasiveness of human and ChatGPT generated pro-vaccine messages for HPV
title_sort comparison of the persuasiveness of human and chatgpt generated pro vaccine messages for hpv
topic large language models
AI-mediated communication
persuasion
public health messages
message factors
url https://www.frontiersin.org/articles/10.3389/fpubh.2024.1515871/full
work_keys_str_mv AT dengkexia acomparisonofthepersuasivenessofhumanandchatgptgeneratedprovaccinemessagesforhpv
AT dengkexia acomparisonofthepersuasivenessofhumanandchatgptgeneratedprovaccinemessagesforhpv
AT mengyaosong acomparisonofthepersuasivenessofhumanandchatgptgeneratedprovaccinemessagesforhpv
AT mengyaosong acomparisonofthepersuasivenessofhumanandchatgptgeneratedprovaccinemessagesforhpv
AT tingshaozhu acomparisonofthepersuasivenessofhumanandchatgptgeneratedprovaccinemessagesforhpv
AT tingshaozhu acomparisonofthepersuasivenessofhumanandchatgptgeneratedprovaccinemessagesforhpv
AT dengkexia comparisonofthepersuasivenessofhumanandchatgptgeneratedprovaccinemessagesforhpv
AT dengkexia comparisonofthepersuasivenessofhumanandchatgptgeneratedprovaccinemessagesforhpv
AT mengyaosong comparisonofthepersuasivenessofhumanandchatgptgeneratedprovaccinemessagesforhpv
AT mengyaosong comparisonofthepersuasivenessofhumanandchatgptgeneratedprovaccinemessagesforhpv
AT tingshaozhu comparisonofthepersuasivenessofhumanandchatgptgeneratedprovaccinemessagesforhpv
AT tingshaozhu comparisonofthepersuasivenessofhumanandchatgptgeneratedprovaccinemessagesforhpv