Applying language models for suicide prevention: evaluating news article adherence to WHO reporting guidelines

Abstract The responsible reporting of suicide in media is crucial for public health, as irresponsible coverage can potentially promote suicidal behaviors. This study examined the capability of generative artificial intelligence, specifically large language models, to evaluate news articles on suicid...

Full description

Saved in:
Bibliographic Details
Main Authors: Zohar Elyoseph, Inbar Levkovich, Eyal Rabin, Gal Shemo, Tal Szpiler, Dorit Hadar Shoval, Yossi Levi Belz
Format: Article
Language:English
Published: Nature Portfolio 2025-06-01
Series:npj Mental Health Research
Online Access:https://doi.org/10.1038/s44184-025-00139-5
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Abstract The responsible reporting of suicide in media is crucial for public health, as irresponsible coverage can potentially promote suicidal behaviors. This study examined the capability of generative artificial intelligence, specifically large language models, to evaluate news articles on suicide according to World Health Organization (WHO) guidelines, potentially offering a scalable solution to this critical issue. The research compared assessments of 40 suicide-related articles by two human reviewers and two large language models (ChatGPT-4 and Claude Opus). Results showed strong agreement between ChatGPT-4 and human reviewers (ICC = 0.81–0.87), with no significant differences in overall evaluations. Claude Opus demonstrated good agreement with human reviewers (ICC = 0.73–0.78) but tended to estimate lower compliance. These findings suggest large language models’ potential in promoting responsible suicide reporting, with significant implications for public health. The technology could provide immediate feedback to journalists, encouraging adherence to best practices and potentially transforming public narratives around suicide.
ISSN:2731-4251