Summary measures in non-inferiority clinical trials with a time-to-event outcome: an empirical comparison of power
Abstract Background Time-to-event data is commonly used in non-inferiority clinical trials. While the hazard ratio is a popular summary measure in this context, the difference in restricted mean survival time has been theoretically shown to increase power and interpretability. This study aimed to em...
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
BMC
2025-05-01
|
| Series: | BMC Medical Research Methodology |
| Subjects: | |
| Online Access: | https://doi.org/10.1186/s12874-025-02576-4 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1849325981937958912 |
|---|---|
| author | S. D. Lana Broer Ian R. White Tim P. Morris Isabelle R. Weir Marta Fiocco Matteo Quartagno |
| author_facet | S. D. Lana Broer Ian R. White Tim P. Morris Isabelle R. Weir Marta Fiocco Matteo Quartagno |
| author_sort | S. D. Lana Broer |
| collection | DOAJ |
| description | Abstract Background Time-to-event data is commonly used in non-inferiority clinical trials. While the hazard ratio is a popular summary measure in this context, the difference in restricted mean survival time has been theoretically shown to increase power and interpretability. This study aimed to empirically compare the power of the hazard ratio, difference in survival and difference in restricted mean survival time for non-inferiority clinical trials with a time-to-event outcome recently published in key clinical journals. Methods Sixty-five non-inferiority trials with a time-to-event outcome were included from two literature searches. Individual patient data were reconstructed and reanalysed. The hazard ratio, difference in survival and difference in restricted mean survival time were estimated under proportional hazards, using a Cox model for the hazard ratio and a flexible parametric survival model for the latter two summary measures. The latter measures were additionally estimated non-parametrically. Margin conversion was done using observed data in the control arm. Empirical power was defined as the proportion of trials that rejected the null hypothesis. Results Difference in restricted mean survival time gave a potential power advantage over the hazard ratio with an empirical power increase of $$7.7\,(-5.4, 20.7)$$ 7.7 ( - 5.4 , 20.7 ) percentage points, and consistently outperformed difference in survival. Difference in survival was more powerful than the hazard ratio, but while difference in restricted mean survival time showed an empirical power advantage even when estimated non-parametrically, this was not generally true for difference in survival. Sub-group analyses consistently showed similar results. Results were more variable when converting margins under an exponential distribution, highlighting the importance of correct margin conversion. Conclusion Our results empirically corroborate the theoretical advantage of difference in restricted mean survival time over the hazard ratio and difference in survival in non-inferiority clinical trials. This advantage is most apparent when estimation is done under proportional hazards. Choosing a relevant time point at which to evaluate the survival-based summary measures is an important aspect that should be carefully considered. We recommend incorporation of the difference in restricted mean survival time in the design and analysis of non-inferiority clinical trials when clinically justifiable. If appropriate, estimation under proportional hazards is preferable. |
| format | Article |
| id | doaj-art-a0a4be0b9ce24ed0996a3769e398b9a6 |
| institution | Kabale University |
| issn | 1471-2288 |
| language | English |
| publishDate | 2025-05-01 |
| publisher | BMC |
| record_format | Article |
| series | BMC Medical Research Methodology |
| spelling | doaj-art-a0a4be0b9ce24ed0996a3769e398b9a62025-08-20T03:48:15ZengBMCBMC Medical Research Methodology1471-22882025-05-0125112510.1186/s12874-025-02576-4Summary measures in non-inferiority clinical trials with a time-to-event outcome: an empirical comparison of powerS. D. Lana Broer0Ian R. White1Tim P. Morris2Isabelle R. Weir3Marta Fiocco4Matteo Quartagno5Leiden UniversityMRC Clinical Trials Unit, Institute of Clinical Trials and Methodology, University College LondonMRC Clinical Trials Unit, Institute of Clinical Trials and Methodology, University College LondonEdwards LifesciencesDepartment of Medical Statistics and Bioinformatics, Leiden University Medical CenterMRC Clinical Trials Unit, Institute of Clinical Trials and Methodology, University College LondonAbstract Background Time-to-event data is commonly used in non-inferiority clinical trials. While the hazard ratio is a popular summary measure in this context, the difference in restricted mean survival time has been theoretically shown to increase power and interpretability. This study aimed to empirically compare the power of the hazard ratio, difference in survival and difference in restricted mean survival time for non-inferiority clinical trials with a time-to-event outcome recently published in key clinical journals. Methods Sixty-five non-inferiority trials with a time-to-event outcome were included from two literature searches. Individual patient data were reconstructed and reanalysed. The hazard ratio, difference in survival and difference in restricted mean survival time were estimated under proportional hazards, using a Cox model for the hazard ratio and a flexible parametric survival model for the latter two summary measures. The latter measures were additionally estimated non-parametrically. Margin conversion was done using observed data in the control arm. Empirical power was defined as the proportion of trials that rejected the null hypothesis. Results Difference in restricted mean survival time gave a potential power advantage over the hazard ratio with an empirical power increase of $$7.7\,(-5.4, 20.7)$$ 7.7 ( - 5.4 , 20.7 ) percentage points, and consistently outperformed difference in survival. Difference in survival was more powerful than the hazard ratio, but while difference in restricted mean survival time showed an empirical power advantage even when estimated non-parametrically, this was not generally true for difference in survival. Sub-group analyses consistently showed similar results. Results were more variable when converting margins under an exponential distribution, highlighting the importance of correct margin conversion. Conclusion Our results empirically corroborate the theoretical advantage of difference in restricted mean survival time over the hazard ratio and difference in survival in non-inferiority clinical trials. This advantage is most apparent when estimation is done under proportional hazards. Choosing a relevant time point at which to evaluate the survival-based summary measures is an important aspect that should be carefully considered. We recommend incorporation of the difference in restricted mean survival time in the design and analysis of non-inferiority clinical trials when clinically justifiable. If appropriate, estimation under proportional hazards is preferable.https://doi.org/10.1186/s12874-025-02576-4PowerNon-inferiorityTime-to-event dataProportional hazardsHazard ratioDifference in survival |
| spellingShingle | S. D. Lana Broer Ian R. White Tim P. Morris Isabelle R. Weir Marta Fiocco Matteo Quartagno Summary measures in non-inferiority clinical trials with a time-to-event outcome: an empirical comparison of power BMC Medical Research Methodology Power Non-inferiority Time-to-event data Proportional hazards Hazard ratio Difference in survival |
| title | Summary measures in non-inferiority clinical trials with a time-to-event outcome: an empirical comparison of power |
| title_full | Summary measures in non-inferiority clinical trials with a time-to-event outcome: an empirical comparison of power |
| title_fullStr | Summary measures in non-inferiority clinical trials with a time-to-event outcome: an empirical comparison of power |
| title_full_unstemmed | Summary measures in non-inferiority clinical trials with a time-to-event outcome: an empirical comparison of power |
| title_short | Summary measures in non-inferiority clinical trials with a time-to-event outcome: an empirical comparison of power |
| title_sort | summary measures in non inferiority clinical trials with a time to event outcome an empirical comparison of power |
| topic | Power Non-inferiority Time-to-event data Proportional hazards Hazard ratio Difference in survival |
| url | https://doi.org/10.1186/s12874-025-02576-4 |
| work_keys_str_mv | AT sdlanabroer summarymeasuresinnoninferiorityclinicaltrialswithatimetoeventoutcomeanempiricalcomparisonofpower AT ianrwhite summarymeasuresinnoninferiorityclinicaltrialswithatimetoeventoutcomeanempiricalcomparisonofpower AT timpmorris summarymeasuresinnoninferiorityclinicaltrialswithatimetoeventoutcomeanempiricalcomparisonofpower AT isabellerweir summarymeasuresinnoninferiorityclinicaltrialswithatimetoeventoutcomeanempiricalcomparisonofpower AT martafiocco summarymeasuresinnoninferiorityclinicaltrialswithatimetoeventoutcomeanempiricalcomparisonofpower AT matteoquartagno summarymeasuresinnoninferiorityclinicaltrialswithatimetoeventoutcomeanempiricalcomparisonofpower |