A Digital Tool for Clinical Evidence–Driven Guideline Development by Studying Properties of Trial Eligible and Ineligible Populations: Development and Usability Study
BackgroundClinical guideline development preferentially relies on evidence from randomized controlled trials (RCTs). RCTs are gold-standard methods to evaluate the efficacy of treatments with the highest internal validity but limited external validity, in the sense that their...
Saved in:
| Main Authors: | , , , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
JMIR Publications
2025-01-01
|
| Series: | Journal of Medical Internet Research |
| Online Access: | https://www.jmir.org/2025/1/e52385 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1841526637790756864 |
|---|---|
| author | Shahzad Mumtaz Megan McMinn Christian Cole Chuang Gao Christopher Hall Magalie Guignard-Duff Huayi Huang David A McAllister Daniel R Morales Emily Jefferson Bruce Guthrie |
| author_facet | Shahzad Mumtaz Megan McMinn Christian Cole Chuang Gao Christopher Hall Magalie Guignard-Duff Huayi Huang David A McAllister Daniel R Morales Emily Jefferson Bruce Guthrie |
| author_sort | Shahzad Mumtaz |
| collection | DOAJ |
| description |
BackgroundClinical guideline development preferentially relies on evidence from randomized controlled trials (RCTs). RCTs are gold-standard methods to evaluate the efficacy of treatments with the highest internal validity but limited external validity, in the sense that their findings may not always be applicable to or generalizable to clinical populations or population characteristics. The external validity of RCTs for the clinical population is constrained by the lack of tailored epidemiological data analysis designed for this purpose due to data governance, consistency of disease or condition definitions, and reduplicated effort in analysis code.
ObjectiveThis study aims to develop a digital tool that characterizes the overall population and differences between clinical trial eligible and ineligible populations from the clinical populations of a disease or condition regarding demography (eg, age, gender, ethnicity), comorbidity, coprescription, hospitalization, and mortality. Currently, the process is complex, onerous, and time-consuming, whereas a real-time tool may be used to rapidly inform a guideline developer’s judgment about the applicability of evidence.
MethodsThe National Institute for Health and Care Excellence—particularly the gout guideline development group—and the Scottish Intercollegiate Guidelines Network guideline developers were consulted to gather their requirements and evidential data needs when developing guidelines. An R Shiny (R Foundation for Statistical Computing) tool was designed and developed using electronic primary health care data linked with hospitalization and mortality data built upon an optimized data architecture. Disclosure control mechanisms were built into the tool to ensure data confidentiality. The tool was deployed within a Trusted Research Environment, allowing only trusted preapproved researchers to conduct analysis.
ResultsThe tool supports 128 chronic health conditions as index conditions and 161 conditions as comorbidities (33 in addition to the 128 index conditions). It enables 2 types of analyses via the graphic interface: overall population and stratified by user-defined eligibility criteria. The analyses produce an overview of statistical tables (eg, age, gender) of the index condition population and, within the overview groupings, produce details on, for example, electronic frailty index, comorbidities, and coprescriptions. The disclosure control mechanism is integral to the tool, limiting tabular counts to meet local governance needs. An exemplary result for gout as an index condition is presented to demonstrate the tool’s functionality. Guideline developers from the National Institute for Health and Care Excellence and the Scottish Intercollegiate Guidelines Network provided positive feedback on the tool.
ConclusionsThe tool is a proof-of-concept, and the user feedback has demonstrated that this is a step toward computer-interpretable guideline development. Using the digital tool can potentially improve evidence-driven guideline development through the availability of real-world data in real time. |
| format | Article |
| id | doaj-art-43c84b3e466d43b199ba1a5e023ae31d |
| institution | Kabale University |
| issn | 1438-8871 |
| language | English |
| publishDate | 2025-01-01 |
| publisher | JMIR Publications |
| record_format | Article |
| series | Journal of Medical Internet Research |
| spelling | doaj-art-43c84b3e466d43b199ba1a5e023ae31d2025-01-16T15:30:34ZengJMIR PublicationsJournal of Medical Internet Research1438-88712025-01-0127e5238510.2196/52385A Digital Tool for Clinical Evidence–Driven Guideline Development by Studying Properties of Trial Eligible and Ineligible Populations: Development and Usability StudyShahzad Mumtazhttps://orcid.org/0000-0003-2606-2405Megan McMinnhttps://orcid.org/0000-0001-8398-2633Christian Colehttps://orcid.org/0000-0002-2560-2484Chuang Gaohttps://orcid.org/0000-0002-6456-0301Christopher Hallhttps://orcid.org/0000-0003-1368-4619Magalie Guignard-Duffhttps://orcid.org/0009-0008-3109-2098Huayi Huanghttps://orcid.org/0000-0003-1166-485XDavid A McAllisterhttps://orcid.org/0000-0003-3550-1764Daniel R Moraleshttps://orcid.org/0000-0002-0063-8069Emily Jeffersonhttps://orcid.org/0000-0003-2992-7582Bruce Guthriehttps://orcid.org/0000-0003-4191-4880 BackgroundClinical guideline development preferentially relies on evidence from randomized controlled trials (RCTs). RCTs are gold-standard methods to evaluate the efficacy of treatments with the highest internal validity but limited external validity, in the sense that their findings may not always be applicable to or generalizable to clinical populations or population characteristics. The external validity of RCTs for the clinical population is constrained by the lack of tailored epidemiological data analysis designed for this purpose due to data governance, consistency of disease or condition definitions, and reduplicated effort in analysis code. ObjectiveThis study aims to develop a digital tool that characterizes the overall population and differences between clinical trial eligible and ineligible populations from the clinical populations of a disease or condition regarding demography (eg, age, gender, ethnicity), comorbidity, coprescription, hospitalization, and mortality. Currently, the process is complex, onerous, and time-consuming, whereas a real-time tool may be used to rapidly inform a guideline developer’s judgment about the applicability of evidence. MethodsThe National Institute for Health and Care Excellence—particularly the gout guideline development group—and the Scottish Intercollegiate Guidelines Network guideline developers were consulted to gather their requirements and evidential data needs when developing guidelines. An R Shiny (R Foundation for Statistical Computing) tool was designed and developed using electronic primary health care data linked with hospitalization and mortality data built upon an optimized data architecture. Disclosure control mechanisms were built into the tool to ensure data confidentiality. The tool was deployed within a Trusted Research Environment, allowing only trusted preapproved researchers to conduct analysis. ResultsThe tool supports 128 chronic health conditions as index conditions and 161 conditions as comorbidities (33 in addition to the 128 index conditions). It enables 2 types of analyses via the graphic interface: overall population and stratified by user-defined eligibility criteria. The analyses produce an overview of statistical tables (eg, age, gender) of the index condition population and, within the overview groupings, produce details on, for example, electronic frailty index, comorbidities, and coprescriptions. The disclosure control mechanism is integral to the tool, limiting tabular counts to meet local governance needs. An exemplary result for gout as an index condition is presented to demonstrate the tool’s functionality. Guideline developers from the National Institute for Health and Care Excellence and the Scottish Intercollegiate Guidelines Network provided positive feedback on the tool. ConclusionsThe tool is a proof-of-concept, and the user feedback has demonstrated that this is a step toward computer-interpretable guideline development. Using the digital tool can potentially improve evidence-driven guideline development through the availability of real-world data in real time.https://www.jmir.org/2025/1/e52385 |
| spellingShingle | Shahzad Mumtaz Megan McMinn Christian Cole Chuang Gao Christopher Hall Magalie Guignard-Duff Huayi Huang David A McAllister Daniel R Morales Emily Jefferson Bruce Guthrie A Digital Tool for Clinical Evidence–Driven Guideline Development by Studying Properties of Trial Eligible and Ineligible Populations: Development and Usability Study Journal of Medical Internet Research |
| title | A Digital Tool for Clinical Evidence–Driven Guideline Development by Studying Properties of Trial Eligible and Ineligible Populations: Development and Usability Study |
| title_full | A Digital Tool for Clinical Evidence–Driven Guideline Development by Studying Properties of Trial Eligible and Ineligible Populations: Development and Usability Study |
| title_fullStr | A Digital Tool for Clinical Evidence–Driven Guideline Development by Studying Properties of Trial Eligible and Ineligible Populations: Development and Usability Study |
| title_full_unstemmed | A Digital Tool for Clinical Evidence–Driven Guideline Development by Studying Properties of Trial Eligible and Ineligible Populations: Development and Usability Study |
| title_short | A Digital Tool for Clinical Evidence–Driven Guideline Development by Studying Properties of Trial Eligible and Ineligible Populations: Development and Usability Study |
| title_sort | digital tool for clinical evidence driven guideline development by studying properties of trial eligible and ineligible populations development and usability study |
| url | https://www.jmir.org/2025/1/e52385 |
| work_keys_str_mv | AT shahzadmumtaz adigitaltoolforclinicalevidencedrivenguidelinedevelopmentbystudyingpropertiesoftrialeligibleandineligiblepopulationsdevelopmentandusabilitystudy AT meganmcminn adigitaltoolforclinicalevidencedrivenguidelinedevelopmentbystudyingpropertiesoftrialeligibleandineligiblepopulationsdevelopmentandusabilitystudy AT christiancole adigitaltoolforclinicalevidencedrivenguidelinedevelopmentbystudyingpropertiesoftrialeligibleandineligiblepopulationsdevelopmentandusabilitystudy AT chuanggao adigitaltoolforclinicalevidencedrivenguidelinedevelopmentbystudyingpropertiesoftrialeligibleandineligiblepopulationsdevelopmentandusabilitystudy AT christopherhall adigitaltoolforclinicalevidencedrivenguidelinedevelopmentbystudyingpropertiesoftrialeligibleandineligiblepopulationsdevelopmentandusabilitystudy AT magalieguignardduff adigitaltoolforclinicalevidencedrivenguidelinedevelopmentbystudyingpropertiesoftrialeligibleandineligiblepopulationsdevelopmentandusabilitystudy AT huayihuang adigitaltoolforclinicalevidencedrivenguidelinedevelopmentbystudyingpropertiesoftrialeligibleandineligiblepopulationsdevelopmentandusabilitystudy AT davidamcallister adigitaltoolforclinicalevidencedrivenguidelinedevelopmentbystudyingpropertiesoftrialeligibleandineligiblepopulationsdevelopmentandusabilitystudy AT danielrmorales adigitaltoolforclinicalevidencedrivenguidelinedevelopmentbystudyingpropertiesoftrialeligibleandineligiblepopulationsdevelopmentandusabilitystudy AT emilyjefferson adigitaltoolforclinicalevidencedrivenguidelinedevelopmentbystudyingpropertiesoftrialeligibleandineligiblepopulationsdevelopmentandusabilitystudy AT bruceguthrie adigitaltoolforclinicalevidencedrivenguidelinedevelopmentbystudyingpropertiesoftrialeligibleandineligiblepopulationsdevelopmentandusabilitystudy AT shahzadmumtaz digitaltoolforclinicalevidencedrivenguidelinedevelopmentbystudyingpropertiesoftrialeligibleandineligiblepopulationsdevelopmentandusabilitystudy AT meganmcminn digitaltoolforclinicalevidencedrivenguidelinedevelopmentbystudyingpropertiesoftrialeligibleandineligiblepopulationsdevelopmentandusabilitystudy AT christiancole digitaltoolforclinicalevidencedrivenguidelinedevelopmentbystudyingpropertiesoftrialeligibleandineligiblepopulationsdevelopmentandusabilitystudy AT chuanggao digitaltoolforclinicalevidencedrivenguidelinedevelopmentbystudyingpropertiesoftrialeligibleandineligiblepopulationsdevelopmentandusabilitystudy AT christopherhall digitaltoolforclinicalevidencedrivenguidelinedevelopmentbystudyingpropertiesoftrialeligibleandineligiblepopulationsdevelopmentandusabilitystudy AT magalieguignardduff digitaltoolforclinicalevidencedrivenguidelinedevelopmentbystudyingpropertiesoftrialeligibleandineligiblepopulationsdevelopmentandusabilitystudy AT huayihuang digitaltoolforclinicalevidencedrivenguidelinedevelopmentbystudyingpropertiesoftrialeligibleandineligiblepopulationsdevelopmentandusabilitystudy AT davidamcallister digitaltoolforclinicalevidencedrivenguidelinedevelopmentbystudyingpropertiesoftrialeligibleandineligiblepopulationsdevelopmentandusabilitystudy AT danielrmorales digitaltoolforclinicalevidencedrivenguidelinedevelopmentbystudyingpropertiesoftrialeligibleandineligiblepopulationsdevelopmentandusabilitystudy AT emilyjefferson digitaltoolforclinicalevidencedrivenguidelinedevelopmentbystudyingpropertiesoftrialeligibleandineligiblepopulationsdevelopmentandusabilitystudy AT bruceguthrie digitaltoolforclinicalevidencedrivenguidelinedevelopmentbystudyingpropertiesoftrialeligibleandineligiblepopulationsdevelopmentandusabilitystudy |