OpenAI ChatGPT vs Google Gemini: A study of AI chatbots’ writing quality evaluation and plagiarism checking
This study explores the writing quality of two AI chatbots, OpenAI ChatGPT and Google Gemini. The research assesses the quality of the generated texts based on five essay models using the T.E.R.A. software, focusing on ease of understanding, readability, and reading levels using the Flesch-Kincaid...
Saved in:
| Main Authors: | , , |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
Universitas Ahmad Dahlan
2024-11-01
|
| Series: | English Language Teaching Educational Journal |
| Subjects: | |
| Online Access: | http://journal2.uad.ac.id/index.php/eltej/article/view/11572 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1846169344571080704 |
|---|---|
| author | Siraprapa Kotmungkun Wichuta Chompurach Piriya Thaksanan |
| author_facet | Siraprapa Kotmungkun Wichuta Chompurach Piriya Thaksanan |
| author_sort | Siraprapa Kotmungkun |
| collection | DOAJ |
| description |
This study explores the writing quality of two AI chatbots, OpenAI ChatGPT and Google Gemini. The research assesses the quality of the generated texts based on five essay models using the T.E.R.A. software, focusing on ease of understanding, readability, and reading levels using the Flesch-Kincaid formula. Thirty essays were generated, 15 from each chatbot, and evaluated for plagiarism using two free detection tools—SmallSEOTools and Check-Plagiarism—as well as one paid tool, Turnitin. The findings revealed that both ChatGPT and Gemini performed well in terms of word concreteness but demonstrated weaknesses in narrativity. ChatGPT showed stronger performance in referential and deep cohesion, while Gemini excelled in narrativity, syntactic simplicity and word concreteness. However, a significant concern was the degree of plagiarism detected in texts from both AI tools, with ChatGPT's essays exhibiting a higher likelihood of plagiarism compared to Gemini’s. These findings highlight the potential limitations and risks associated with using AI-generated writing.
|
| format | Article |
| id | doaj-art-767736d0f4f74f7f8e3d3a99182bd7cd |
| institution | Kabale University |
| issn | 2621-6485 |
| language | English |
| publishDate | 2024-11-01 |
| publisher | Universitas Ahmad Dahlan |
| record_format | Article |
| series | English Language Teaching Educational Journal |
| spelling | doaj-art-767736d0f4f74f7f8e3d3a99182bd7cd2024-11-13T04:39:22ZengUniversitas Ahmad DahlanEnglish Language Teaching Educational Journal2621-64852024-11-017210.12928/eltej.v7i2.11572OpenAI ChatGPT vs Google Gemini: A study of AI chatbots’ writing quality evaluation and plagiarism checkingSiraprapa Kotmungkun0Wichuta Chompurach1Piriya Thaksanan2Kasetsart University Kasetsart UniversityKasetsart University This study explores the writing quality of two AI chatbots, OpenAI ChatGPT and Google Gemini. The research assesses the quality of the generated texts based on five essay models using the T.E.R.A. software, focusing on ease of understanding, readability, and reading levels using the Flesch-Kincaid formula. Thirty essays were generated, 15 from each chatbot, and evaluated for plagiarism using two free detection tools—SmallSEOTools and Check-Plagiarism—as well as one paid tool, Turnitin. The findings revealed that both ChatGPT and Gemini performed well in terms of word concreteness but demonstrated weaknesses in narrativity. ChatGPT showed stronger performance in referential and deep cohesion, while Gemini excelled in narrativity, syntactic simplicity and word concreteness. However, a significant concern was the degree of plagiarism detected in texts from both AI tools, with ChatGPT's essays exhibiting a higher likelihood of plagiarism compared to Gemini’s. These findings highlight the potential limitations and risks associated with using AI-generated writing. http://journal2.uad.ac.id/index.php/eltej/article/view/11572AI ChatbotL2 WritingPlagiarismWriting EvaluationGoogle GeminiOpenAI ChatGPT |
| spellingShingle | Siraprapa Kotmungkun Wichuta Chompurach Piriya Thaksanan OpenAI ChatGPT vs Google Gemini: A study of AI chatbots’ writing quality evaluation and plagiarism checking English Language Teaching Educational Journal AI Chatbot L2 Writing Plagiarism Writing Evaluation Google Gemini OpenAI ChatGPT |
| title | OpenAI ChatGPT vs Google Gemini: A study of AI chatbots’ writing quality evaluation and plagiarism checking |
| title_full | OpenAI ChatGPT vs Google Gemini: A study of AI chatbots’ writing quality evaluation and plagiarism checking |
| title_fullStr | OpenAI ChatGPT vs Google Gemini: A study of AI chatbots’ writing quality evaluation and plagiarism checking |
| title_full_unstemmed | OpenAI ChatGPT vs Google Gemini: A study of AI chatbots’ writing quality evaluation and plagiarism checking |
| title_short | OpenAI ChatGPT vs Google Gemini: A study of AI chatbots’ writing quality evaluation and plagiarism checking |
| title_sort | openai chatgpt vs google gemini a study of ai chatbots writing quality evaluation and plagiarism checking |
| topic | AI Chatbot L2 Writing Plagiarism Writing Evaluation Google Gemini OpenAI ChatGPT |
| url | http://journal2.uad.ac.id/index.php/eltej/article/view/11572 |
| work_keys_str_mv | AT siraprapakotmungkun openaichatgptvsgooglegeminiastudyofaichatbotswritingqualityevaluationandplagiarismchecking AT wichutachompurach openaichatgptvsgooglegeminiastudyofaichatbotswritingqualityevaluationandplagiarismchecking AT piriyathaksanan openaichatgptvsgooglegeminiastudyofaichatbotswritingqualityevaluationandplagiarismchecking |