Enhancing patient education on the role of tibial osteotomy in the management of knee osteoarthritis using a customized ChatGPT: a readability and quality assessment
IntroductionKnee osteoarthritis (OA) significantly impacts the quality of life of those afflicted, with many patients eventually requiring surgical intervention. While Total Knee Arthroplasty (TKA) is common, it may not be suitable for younger patients with unicompartmental OA, who might benefit mor...
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Frontiers Media S.A.
2025-01-01
|
| Series: | Frontiers in Digital Health |
| Subjects: | |
| Online Access: | https://www.frontiersin.org/articles/10.3389/fdgth.2024.1480381/full |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1841561222993936384 |
|---|---|
| author | Stephen Fahy Stephan Oehme Danko Dan Milinkovic Benjamin Bartek |
| author_facet | Stephen Fahy Stephan Oehme Danko Dan Milinkovic Benjamin Bartek |
| author_sort | Stephen Fahy |
| collection | DOAJ |
| description | IntroductionKnee osteoarthritis (OA) significantly impacts the quality of life of those afflicted, with many patients eventually requiring surgical intervention. While Total Knee Arthroplasty (TKA) is common, it may not be suitable for younger patients with unicompartmental OA, who might benefit more from High Tibial Osteotomy (HTO). Effective patient education is crucial for informed decision-making, yet most online health information has been found to be too complex for the average patient to understand. AI tools like ChatGPT may offer a solution, but their outputs often exceed the public's literacy level. This study assessed whether a customised ChatGPT could be utilized to improve readability and source accuracy in patient education on Knee OA and tibial osteotomy.MethodsCommonly asked questions about HTO were gathered using Google's “People Also Asked” feature and formatted to an 8th-grade reading level. Two ChatGPT-4 models were compared: a native version and a fine-tuned model (“The Knee Guide”) optimized for readability and source citation through Instruction-Based Fine-Tuning (IBFT) and Reinforcement Learning from Human Feedback (RLHF). The responses were evaluated for quality using the DISCERN criteria and readability using the Flesch Reading Ease Score (FRES) and Flesch-Kincaid Grade Level (FKGL).ResultsThe native ChatGPT-4 model scored a mean DISCERN score of 38.41 (range 25–46), indicating poor quality, while “The Knee Guide” scored 45.9 (range 33–66), indicating moderate quality. Cronbach's Alpha was 0.86, indicating good interrater reliability. “The Knee Guide” achieved better readability with a mean FKGL of 8.2 (range 5–10.7, ±1.42) and a mean FRES of 60 (range 47–76, ±7.83), compared to the native model's FKGL of 13.9 (range 11–16, ±1.39) and FRES of 32 (range 14–47, ±8.3). These differences were statistically significant (p < 0.001).ConclusionsFine-tuning ChatGPT significantly improved the readability and quality of HTO-related information. “The Knee Guide” demonstrated the potential of customized AI tools in enhancing patient education by making complex medical information more accessible and understandable. |
| format | Article |
| id | doaj-art-dfc01a8df95842ed8009d304e6e82341 |
| institution | Kabale University |
| issn | 2673-253X |
| language | English |
| publishDate | 2025-01-01 |
| publisher | Frontiers Media S.A. |
| record_format | Article |
| series | Frontiers in Digital Health |
| spelling | doaj-art-dfc01a8df95842ed8009d304e6e823412025-01-03T05:10:12ZengFrontiers Media S.A.Frontiers in Digital Health2673-253X2025-01-01610.3389/fdgth.2024.14803811480381Enhancing patient education on the role of tibial osteotomy in the management of knee osteoarthritis using a customized ChatGPT: a readability and quality assessmentStephen FahyStephan OehmeDanko Dan MilinkovicBenjamin BartekIntroductionKnee osteoarthritis (OA) significantly impacts the quality of life of those afflicted, with many patients eventually requiring surgical intervention. While Total Knee Arthroplasty (TKA) is common, it may not be suitable for younger patients with unicompartmental OA, who might benefit more from High Tibial Osteotomy (HTO). Effective patient education is crucial for informed decision-making, yet most online health information has been found to be too complex for the average patient to understand. AI tools like ChatGPT may offer a solution, but their outputs often exceed the public's literacy level. This study assessed whether a customised ChatGPT could be utilized to improve readability and source accuracy in patient education on Knee OA and tibial osteotomy.MethodsCommonly asked questions about HTO were gathered using Google's “People Also Asked” feature and formatted to an 8th-grade reading level. Two ChatGPT-4 models were compared: a native version and a fine-tuned model (“The Knee Guide”) optimized for readability and source citation through Instruction-Based Fine-Tuning (IBFT) and Reinforcement Learning from Human Feedback (RLHF). The responses were evaluated for quality using the DISCERN criteria and readability using the Flesch Reading Ease Score (FRES) and Flesch-Kincaid Grade Level (FKGL).ResultsThe native ChatGPT-4 model scored a mean DISCERN score of 38.41 (range 25–46), indicating poor quality, while “The Knee Guide” scored 45.9 (range 33–66), indicating moderate quality. Cronbach's Alpha was 0.86, indicating good interrater reliability. “The Knee Guide” achieved better readability with a mean FKGL of 8.2 (range 5–10.7, ±1.42) and a mean FRES of 60 (range 47–76, ±7.83), compared to the native model's FKGL of 13.9 (range 11–16, ±1.39) and FRES of 32 (range 14–47, ±8.3). These differences were statistically significant (p < 0.001).ConclusionsFine-tuning ChatGPT significantly improved the readability and quality of HTO-related information. “The Knee Guide” demonstrated the potential of customized AI tools in enhancing patient education by making complex medical information more accessible and understandable.https://www.frontiersin.org/articles/10.3389/fdgth.2024.1480381/fullknee osteoarthritishigh tibial osteotomypatient educationChatGPTreadabilityDISCERN criteria |
| spellingShingle | Stephen Fahy Stephan Oehme Danko Dan Milinkovic Benjamin Bartek Enhancing patient education on the role of tibial osteotomy in the management of knee osteoarthritis using a customized ChatGPT: a readability and quality assessment Frontiers in Digital Health knee osteoarthritis high tibial osteotomy patient education ChatGPT readability DISCERN criteria |
| title | Enhancing patient education on the role of tibial osteotomy in the management of knee osteoarthritis using a customized ChatGPT: a readability and quality assessment |
| title_full | Enhancing patient education on the role of tibial osteotomy in the management of knee osteoarthritis using a customized ChatGPT: a readability and quality assessment |
| title_fullStr | Enhancing patient education on the role of tibial osteotomy in the management of knee osteoarthritis using a customized ChatGPT: a readability and quality assessment |
| title_full_unstemmed | Enhancing patient education on the role of tibial osteotomy in the management of knee osteoarthritis using a customized ChatGPT: a readability and quality assessment |
| title_short | Enhancing patient education on the role of tibial osteotomy in the management of knee osteoarthritis using a customized ChatGPT: a readability and quality assessment |
| title_sort | enhancing patient education on the role of tibial osteotomy in the management of knee osteoarthritis using a customized chatgpt a readability and quality assessment |
| topic | knee osteoarthritis high tibial osteotomy patient education ChatGPT readability DISCERN criteria |
| url | https://www.frontiersin.org/articles/10.3389/fdgth.2024.1480381/full |
| work_keys_str_mv | AT stephenfahy enhancingpatienteducationontheroleoftibialosteotomyinthemanagementofkneeosteoarthritisusingacustomizedchatgptareadabilityandqualityassessment AT stephanoehme enhancingpatienteducationontheroleoftibialosteotomyinthemanagementofkneeosteoarthritisusingacustomizedchatgptareadabilityandqualityassessment AT dankodanmilinkovic enhancingpatienteducationontheroleoftibialosteotomyinthemanagementofkneeosteoarthritisusingacustomizedchatgptareadabilityandqualityassessment AT benjaminbartek enhancingpatienteducationontheroleoftibialosteotomyinthemanagementofkneeosteoarthritisusingacustomizedchatgptareadabilityandqualityassessment |