Prioritizing attributes of approaches to analyzing patient-centered outcomes that are truncated due to death in critical care clinical trials: a Delphi study

Abstract Background A key challenge for many critical care clinical trials is that some patients will die before their outcome is fully measured. This is referred to as “truncation due to death” and must be accounted for in both the treatment effect definition (i.e. the estimand), as well as the sta...

Full description

Saved in:
Bibliographic Details
Main Authors: Melanie Bahti, Brennan C. Kahan, Fan Li, Michael O. Harhay, Catherine L. Auriemma
Format: Article
Language:English
Published: BMC 2025-01-01
Series:Trials
Subjects:
Online Access:https://doi.org/10.1186/s13063-024-08673-x
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1841544280193105920
author Melanie Bahti
Brennan C. Kahan
Fan Li
Michael O. Harhay
Catherine L. Auriemma
author_facet Melanie Bahti
Brennan C. Kahan
Fan Li
Michael O. Harhay
Catherine L. Auriemma
author_sort Melanie Bahti
collection DOAJ
description Abstract Background A key challenge for many critical care clinical trials is that some patients will die before their outcome is fully measured. This is referred to as “truncation due to death” and must be accounted for in both the treatment effect definition (i.e. the estimand), as well as the statistical analysis approach. It is unknown which analytic approaches to this challenge are most relevant to stakeholders. Methods Using a modified Delphi process, we sought to identify critical attributes of analytic methods used to account for truncation due to death in critical care clinical trials. The Delphi panel included stakeholders with diverse professional or personal experience in critical care-focused clinical trials. The research team generated an initial list of attributes and associated definitions. The attribute list and definitions were refined through two Delphi rounds. Panelists ranked and scored attributes and provided open-ended rationales for responses. A consensus threshold was set as ≥ 70% of respondents rating an attribute as “Critical” (i.e., score ≥ 7 on a 9-point Likert scale) and ≤ 15% of respondents rating the measure as “Not Important” (i.e., a score of ≤ 3). Results Thirty-one (91%) of 34 invited individuals participated in one or both rounds. The response rate was 82% in Round 1 and 85% in Round 2. Participants included eight (26%) personal experience experts and 26 (84%) professional experience experts. After two Delphi rounds, four attributes met the criteria for consensus: accuracy (the approach will identify effects if they exist, but will not if they do not), interpretability (the approach enables a straightforward interpretation of the intervention’s effect), clinical relevance (the approach can directly inform patient care), and patient-centeredness (the approach is relevant to patients and/or their families). Attributes that did not meet the consensus threshold included sensitivity, comparability, familiarity, mechanistic plausibility, and statistical simplicity. Conclusions We found that methods used to account for truncation due to death in the treatment effect definition and statistical approach in critical care trials should meet at least four defined criteria: accuracy, interpretability, clinical relevance, and patient-centeredness. Future work is needed to derive objective criteria to quantify how well existing estimands and analytic approaches encompass these attributes.
format Article
id doaj-art-5c1fbf0261424e4c9ecbf0585e79e010
institution Kabale University
issn 1745-6215
language English
publishDate 2025-01-01
publisher BMC
record_format Article
series Trials
spelling doaj-art-5c1fbf0261424e4c9ecbf0585e79e0102025-01-12T12:38:27ZengBMCTrials1745-62152025-01-012611910.1186/s13063-024-08673-xPrioritizing attributes of approaches to analyzing patient-centered outcomes that are truncated due to death in critical care clinical trials: a Delphi studyMelanie Bahti0Brennan C. Kahan1Fan Li2Michael O. Harhay3Catherine L. Auriemma4Palliative and Advanced Illness Research (PAIR) Center, Perelman School of Medicine, University of PennsylvaniaMRC Clinical Trials Unit at UCL, Institute of Clinical Trials and Methodology, University College LondonDepartment of Biostatistics, Yale University School of Public HealthPalliative and Advanced Illness Research (PAIR) Center, Perelman School of Medicine, University of PennsylvaniaPalliative and Advanced Illness Research (PAIR) Center, Perelman School of Medicine, University of PennsylvaniaAbstract Background A key challenge for many critical care clinical trials is that some patients will die before their outcome is fully measured. This is referred to as “truncation due to death” and must be accounted for in both the treatment effect definition (i.e. the estimand), as well as the statistical analysis approach. It is unknown which analytic approaches to this challenge are most relevant to stakeholders. Methods Using a modified Delphi process, we sought to identify critical attributes of analytic methods used to account for truncation due to death in critical care clinical trials. The Delphi panel included stakeholders with diverse professional or personal experience in critical care-focused clinical trials. The research team generated an initial list of attributes and associated definitions. The attribute list and definitions were refined through two Delphi rounds. Panelists ranked and scored attributes and provided open-ended rationales for responses. A consensus threshold was set as ≥ 70% of respondents rating an attribute as “Critical” (i.e., score ≥ 7 on a 9-point Likert scale) and ≤ 15% of respondents rating the measure as “Not Important” (i.e., a score of ≤ 3). Results Thirty-one (91%) of 34 invited individuals participated in one or both rounds. The response rate was 82% in Round 1 and 85% in Round 2. Participants included eight (26%) personal experience experts and 26 (84%) professional experience experts. After two Delphi rounds, four attributes met the criteria for consensus: accuracy (the approach will identify effects if they exist, but will not if they do not), interpretability (the approach enables a straightforward interpretation of the intervention’s effect), clinical relevance (the approach can directly inform patient care), and patient-centeredness (the approach is relevant to patients and/or their families). Attributes that did not meet the consensus threshold included sensitivity, comparability, familiarity, mechanistic plausibility, and statistical simplicity. Conclusions We found that methods used to account for truncation due to death in the treatment effect definition and statistical approach in critical care trials should meet at least four defined criteria: accuracy, interpretability, clinical relevance, and patient-centeredness. Future work is needed to derive objective criteria to quantify how well existing estimands and analytic approaches encompass these attributes.https://doi.org/10.1186/s13063-024-08673-xPatient-centered outcomesTruncation due to deathDelphi studyConsensusComposite outcomesStatistical approaches
spellingShingle Melanie Bahti
Brennan C. Kahan
Fan Li
Michael O. Harhay
Catherine L. Auriemma
Prioritizing attributes of approaches to analyzing patient-centered outcomes that are truncated due to death in critical care clinical trials: a Delphi study
Trials
Patient-centered outcomes
Truncation due to death
Delphi study
Consensus
Composite outcomes
Statistical approaches
title Prioritizing attributes of approaches to analyzing patient-centered outcomes that are truncated due to death in critical care clinical trials: a Delphi study
title_full Prioritizing attributes of approaches to analyzing patient-centered outcomes that are truncated due to death in critical care clinical trials: a Delphi study
title_fullStr Prioritizing attributes of approaches to analyzing patient-centered outcomes that are truncated due to death in critical care clinical trials: a Delphi study
title_full_unstemmed Prioritizing attributes of approaches to analyzing patient-centered outcomes that are truncated due to death in critical care clinical trials: a Delphi study
title_short Prioritizing attributes of approaches to analyzing patient-centered outcomes that are truncated due to death in critical care clinical trials: a Delphi study
title_sort prioritizing attributes of approaches to analyzing patient centered outcomes that are truncated due to death in critical care clinical trials a delphi study
topic Patient-centered outcomes
Truncation due to death
Delphi study
Consensus
Composite outcomes
Statistical approaches
url https://doi.org/10.1186/s13063-024-08673-x
work_keys_str_mv AT melaniebahti prioritizingattributesofapproachestoanalyzingpatientcenteredoutcomesthataretruncatedduetodeathincriticalcareclinicaltrialsadelphistudy
AT brennanckahan prioritizingattributesofapproachestoanalyzingpatientcenteredoutcomesthataretruncatedduetodeathincriticalcareclinicaltrialsadelphistudy
AT fanli prioritizingattributesofapproachestoanalyzingpatientcenteredoutcomesthataretruncatedduetodeathincriticalcareclinicaltrialsadelphistudy
AT michaeloharhay prioritizingattributesofapproachestoanalyzingpatientcenteredoutcomesthataretruncatedduetodeathincriticalcareclinicaltrialsadelphistudy
AT catherinelauriemma prioritizingattributesofapproachestoanalyzingpatientcenteredoutcomesthataretruncatedduetodeathincriticalcareclinicaltrialsadelphistudy