Exploring the potential of large language models for integration into an academic statistical consulting service-the EXPOLS study protocol.
<h4>Background</h4>The advancement of Artificial Intelligence, particularly Large Language Models (LLMs), is rapidly progressing. LLMs, such as OpenAI's GPT, are becoming vital in scientific and medical processes, including text production, knowledge synthesis, translation, patient...
Saved in:
| Main Authors: | , , , , , , , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Public Library of Science (PLoS)
2024-01-01
|
| Series: | PLoS ONE |
| Online Access: | https://doi.org/10.1371/journal.pone.0308375 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1846129414298927104 |
|---|---|
| author | Urs Alexander Fichtner Jochen Knaus Erika Graf Georg Koch Jörg Sahlmann Dominikus Stelzer Martin Wolkewitz Harald Binder Susanne Weber |
| author_facet | Urs Alexander Fichtner Jochen Knaus Erika Graf Georg Koch Jörg Sahlmann Dominikus Stelzer Martin Wolkewitz Harald Binder Susanne Weber |
| author_sort | Urs Alexander Fichtner |
| collection | DOAJ |
| description | <h4>Background</h4>The advancement of Artificial Intelligence, particularly Large Language Models (LLMs), is rapidly progressing. LLMs, such as OpenAI's GPT, are becoming vital in scientific and medical processes, including text production, knowledge synthesis, translation, patient communication and data analysis. However, the outcome quality needs to be evaluated to assess the full potential for usage in statistical applications. LLMs show potential for all research areas, including teaching. Integrating LLMs in research, education and medical care poses opportunities and challenges, depending on user competence, experience and attitudes.<h4>Objective</h4>This project aims at exploring the use of LLMs in supporting statistical consulting by evaluating the utility, efficiency and satisfaction related to the use of LLMs in statistical consulting from both advisee and consultant perspective. Within this project, we will develop, execute and evaluate a training module for the use of LLMs in statistical consulting. In this context, we aim to identify the strengths, limitations and areas for potential improvement. Furthermore, we will explore experiences, attitudes, fears and current practices regarding the use of LLMs of the staff at the Medical Center and the University of Freiburg.<h4>Materials and methods</h4>This multimodal study includes four study parts using qualitative and quantitative methods to gather data. Study part (I) is designed as mixed mode study to explore the use of LLMs in supporting statistical consulting and to evaluate the utility, efficiency and satisfaction related to the use of LLMs. Study part (II) uses a standardized online questionnaire to evaluate the training module. Study part (III) evaluates the consulting sessions using LLMs from advisee perspective. Study part (IV) explores experiences, attitudes, fears and current practices regarding the use of LLMs of the staff at the Medical Center and the University of Freiburg. This study is registered at the Freiburg Registry of Clinical Studies under the ID: FRKS004971. |
| format | Article |
| id | doaj-art-aff0aa86406c4d40a262c871ab52e081 |
| institution | Kabale University |
| issn | 1932-6203 |
| language | English |
| publishDate | 2024-01-01 |
| publisher | Public Library of Science (PLoS) |
| record_format | Article |
| series | PLoS ONE |
| spelling | doaj-art-aff0aa86406c4d40a262c871ab52e0812024-12-10T05:32:42ZengPublic Library of Science (PLoS)PLoS ONE1932-62032024-01-011912e030837510.1371/journal.pone.0308375Exploring the potential of large language models for integration into an academic statistical consulting service-the EXPOLS study protocol.Urs Alexander FichtnerJochen KnausErika GrafGeorg KochJörg SahlmannDominikus StelzerMartin WolkewitzHarald BinderSusanne Weber<h4>Background</h4>The advancement of Artificial Intelligence, particularly Large Language Models (LLMs), is rapidly progressing. LLMs, such as OpenAI's GPT, are becoming vital in scientific and medical processes, including text production, knowledge synthesis, translation, patient communication and data analysis. However, the outcome quality needs to be evaluated to assess the full potential for usage in statistical applications. LLMs show potential for all research areas, including teaching. Integrating LLMs in research, education and medical care poses opportunities and challenges, depending on user competence, experience and attitudes.<h4>Objective</h4>This project aims at exploring the use of LLMs in supporting statistical consulting by evaluating the utility, efficiency and satisfaction related to the use of LLMs in statistical consulting from both advisee and consultant perspective. Within this project, we will develop, execute and evaluate a training module for the use of LLMs in statistical consulting. In this context, we aim to identify the strengths, limitations and areas for potential improvement. Furthermore, we will explore experiences, attitudes, fears and current practices regarding the use of LLMs of the staff at the Medical Center and the University of Freiburg.<h4>Materials and methods</h4>This multimodal study includes four study parts using qualitative and quantitative methods to gather data. Study part (I) is designed as mixed mode study to explore the use of LLMs in supporting statistical consulting and to evaluate the utility, efficiency and satisfaction related to the use of LLMs. Study part (II) uses a standardized online questionnaire to evaluate the training module. Study part (III) evaluates the consulting sessions using LLMs from advisee perspective. Study part (IV) explores experiences, attitudes, fears and current practices regarding the use of LLMs of the staff at the Medical Center and the University of Freiburg. This study is registered at the Freiburg Registry of Clinical Studies under the ID: FRKS004971.https://doi.org/10.1371/journal.pone.0308375 |
| spellingShingle | Urs Alexander Fichtner Jochen Knaus Erika Graf Georg Koch Jörg Sahlmann Dominikus Stelzer Martin Wolkewitz Harald Binder Susanne Weber Exploring the potential of large language models for integration into an academic statistical consulting service-the EXPOLS study protocol. PLoS ONE |
| title | Exploring the potential of large language models for integration into an academic statistical consulting service-the EXPOLS study protocol. |
| title_full | Exploring the potential of large language models for integration into an academic statistical consulting service-the EXPOLS study protocol. |
| title_fullStr | Exploring the potential of large language models for integration into an academic statistical consulting service-the EXPOLS study protocol. |
| title_full_unstemmed | Exploring the potential of large language models for integration into an academic statistical consulting service-the EXPOLS study protocol. |
| title_short | Exploring the potential of large language models for integration into an academic statistical consulting service-the EXPOLS study protocol. |
| title_sort | exploring the potential of large language models for integration into an academic statistical consulting service the expols study protocol |
| url | https://doi.org/10.1371/journal.pone.0308375 |
| work_keys_str_mv | AT ursalexanderfichtner exploringthepotentialoflargelanguagemodelsforintegrationintoanacademicstatisticalconsultingservicetheexpolsstudyprotocol AT jochenknaus exploringthepotentialoflargelanguagemodelsforintegrationintoanacademicstatisticalconsultingservicetheexpolsstudyprotocol AT erikagraf exploringthepotentialoflargelanguagemodelsforintegrationintoanacademicstatisticalconsultingservicetheexpolsstudyprotocol AT georgkoch exploringthepotentialoflargelanguagemodelsforintegrationintoanacademicstatisticalconsultingservicetheexpolsstudyprotocol AT jorgsahlmann exploringthepotentialoflargelanguagemodelsforintegrationintoanacademicstatisticalconsultingservicetheexpolsstudyprotocol AT dominikusstelzer exploringthepotentialoflargelanguagemodelsforintegrationintoanacademicstatisticalconsultingservicetheexpolsstudyprotocol AT martinwolkewitz exploringthepotentialoflargelanguagemodelsforintegrationintoanacademicstatisticalconsultingservicetheexpolsstudyprotocol AT haraldbinder exploringthepotentialoflargelanguagemodelsforintegrationintoanacademicstatisticalconsultingservicetheexpolsstudyprotocol AT susanneweber exploringthepotentialoflargelanguagemodelsforintegrationintoanacademicstatisticalconsultingservicetheexpolsstudyprotocol |