Enhancing communication and clinical reasoning in medical education: Building virtual patients with generative AI
Introduction: Generative AI describes any form of artificial intelligence (AI) that can produce new text, images, video or other content. Large language models (LLMs) are a form of generative AI which can generate human-like text. They are trained on large amounts of text data and have been made pop...
Saved in:
| Main Authors: | , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Elsevier
2024-04-01
|
| Series: | Future Healthcare Journal |
| Online Access: | http://www.sciencedirect.com/science/article/pii/S2514664524001553 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1846161643211325440 |
|---|---|
| author | Lewis Potter Chris Jefferies |
| author_facet | Lewis Potter Chris Jefferies |
| author_sort | Lewis Potter |
| collection | DOAJ |
| description | Introduction: Generative AI describes any form of artificial intelligence (AI) that can produce new text, images, video or other content. Large language models (LLMs) are a form of generative AI which can generate human-like text. They are trained on large amounts of text data and have been made popular by the launch of publicly available chatbots, including ChatGPT and Google Bard.1 Virtual patients simulate real-life clinical scenarios and can be used to teach knowledge, communication skills and clinical reasoning.2Given the challenges learners can face in accessing opportunities to practice communication skills in person, particularly in busy healthcare environments, we aimed to develop a collection of realistic virtual patients using LLM technology. The virtual patients enable learners to practise their communication and clinical reasoning skills using a chatbot interface hosted on the Geeky Medics platform. Materials and methods: A database of patient scripts was created, reflecting common patient presentations (e.g. chest pain, breathlessness). Each script consisted of a condensed summary of the patient's presentation, including relevant past medical and psychosocial history. Utilising OpenAI's GPT-3.5 and GPT-4 large language models, we developed an interactive chat interface that allows learners to engage with virtual patients generated from the patient scripts. Users can interact with the virtual patient via text or voice. This interaction mimics a real clinical encounter, facilitating natural conversation with the patient.After the consultation, learners can request an immediate AI-powered review of their transcript, which assesses the breadth and depth of their questioning to provide actionable feedback. Examples of feedback include commending areas covered well and highlighting important missed sections of the patient's history. Results and discussion: Since their introduction on the Geeky Medics platform, learners have conducted over 45,000 consultations with virtual patients. Implementation challenges included user feedback about occasional 'hallucinations' and off-topic responses from the virtual patients. User feedback has generally been favourable, highlighting the independent aspect of the interactions and the opportunity for deliberate, repeated practice of complex communication skills, such as taking a sexual history.Our findings demonstrate the viability of using LLM technology, specifically GPT-3.5 and GPT-4, to create realistic virtual patients. Despite challenges like 'hallucinations' and off-topic responses, the high volume of consultations indicates strong engagement and potential for this tool to enhance communication and clinical reasoning skills. Conclusion: This approach offers a scalable, accessible way to supplement traditional clinical training, especially in environments with limited direct patient contact. |
| format | Article |
| id | doaj-art-e9c83e5b1bc949d3a401ef22054939dc |
| institution | Kabale University |
| issn | 2514-6645 |
| language | English |
| publishDate | 2024-04-01 |
| publisher | Elsevier |
| record_format | Article |
| series | Future Healthcare Journal |
| spelling | doaj-art-e9c83e5b1bc949d3a401ef22054939dc2024-11-21T06:04:33ZengElsevierFuture Healthcare Journal2514-66452024-04-0111100043Enhancing communication and clinical reasoning in medical education: Building virtual patients with generative AILewis Potter0Chris Jefferies1Geeky MedicsGeeky MedicsIntroduction: Generative AI describes any form of artificial intelligence (AI) that can produce new text, images, video or other content. Large language models (LLMs) are a form of generative AI which can generate human-like text. They are trained on large amounts of text data and have been made popular by the launch of publicly available chatbots, including ChatGPT and Google Bard.1 Virtual patients simulate real-life clinical scenarios and can be used to teach knowledge, communication skills and clinical reasoning.2Given the challenges learners can face in accessing opportunities to practice communication skills in person, particularly in busy healthcare environments, we aimed to develop a collection of realistic virtual patients using LLM technology. The virtual patients enable learners to practise their communication and clinical reasoning skills using a chatbot interface hosted on the Geeky Medics platform. Materials and methods: A database of patient scripts was created, reflecting common patient presentations (e.g. chest pain, breathlessness). Each script consisted of a condensed summary of the patient's presentation, including relevant past medical and psychosocial history. Utilising OpenAI's GPT-3.5 and GPT-4 large language models, we developed an interactive chat interface that allows learners to engage with virtual patients generated from the patient scripts. Users can interact with the virtual patient via text or voice. This interaction mimics a real clinical encounter, facilitating natural conversation with the patient.After the consultation, learners can request an immediate AI-powered review of their transcript, which assesses the breadth and depth of their questioning to provide actionable feedback. Examples of feedback include commending areas covered well and highlighting important missed sections of the patient's history. Results and discussion: Since their introduction on the Geeky Medics platform, learners have conducted over 45,000 consultations with virtual patients. Implementation challenges included user feedback about occasional 'hallucinations' and off-topic responses from the virtual patients. User feedback has generally been favourable, highlighting the independent aspect of the interactions and the opportunity for deliberate, repeated practice of complex communication skills, such as taking a sexual history.Our findings demonstrate the viability of using LLM technology, specifically GPT-3.5 and GPT-4, to create realistic virtual patients. Despite challenges like 'hallucinations' and off-topic responses, the high volume of consultations indicates strong engagement and potential for this tool to enhance communication and clinical reasoning skills. Conclusion: This approach offers a scalable, accessible way to supplement traditional clinical training, especially in environments with limited direct patient contact.http://www.sciencedirect.com/science/article/pii/S2514664524001553 |
| spellingShingle | Lewis Potter Chris Jefferies Enhancing communication and clinical reasoning in medical education: Building virtual patients with generative AI Future Healthcare Journal |
| title | Enhancing communication and clinical reasoning in medical education: Building virtual patients with generative AI |
| title_full | Enhancing communication and clinical reasoning in medical education: Building virtual patients with generative AI |
| title_fullStr | Enhancing communication and clinical reasoning in medical education: Building virtual patients with generative AI |
| title_full_unstemmed | Enhancing communication and clinical reasoning in medical education: Building virtual patients with generative AI |
| title_short | Enhancing communication and clinical reasoning in medical education: Building virtual patients with generative AI |
| title_sort | enhancing communication and clinical reasoning in medical education building virtual patients with generative ai |
| url | http://www.sciencedirect.com/science/article/pii/S2514664524001553 |
| work_keys_str_mv | AT lewispotter enhancingcommunicationandclinicalreasoninginmedicaleducationbuildingvirtualpatientswithgenerativeai AT chrisjefferies enhancingcommunicationandclinicalreasoninginmedicaleducationbuildingvirtualpatientswithgenerativeai |