Evaluation of Google and Bing online translation of verb-noun collocations from English into Arabic
This article aims to investigate and evaluate the translation of verb-noun collocation in English into Arabic Google and Bing online translation engines. A number of sentences were used as a testing dataset to evaluate both engines. Human translations by three bilingual speakers were used as a gold...
Saved in:
Main Authors: | , |
---|---|
Format: | Article |
Language: | English |
Published: |
Universiti Malaya
2015-12-01
|
Series: | Journal of Modern Languages |
Subjects: | |
Online Access: | https://sare.um.edu.my/index.php/JML/article/view/3143 |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
_version_ | 1846161756924149760 |
---|---|
author | Hussein Soori Su’ad Awab |
author_facet | Hussein Soori Su’ad Awab |
author_sort | Hussein Soori |
collection | DOAJ |
description |
This article aims to investigate and evaluate the translation of verb-noun collocation in English into Arabic Google and Bing online translation engines. A number of sentences were used as a testing dataset to evaluate both engines. Human translations by three bilingual speakers were used as a gold standard. A simple evaluation metric was proposed to calculate the translation accuracy of verb-noun collocations. The results showed that Bing scored a verb-noun collocation value of 0.72 with a trend estimation ranging between 0.65 and 0.67. Google scored a verb-noun collocation value of 0.75 (3% higher than Bing) with a trend estimation ranging between 0.63 and 0.85. The results also showed that, in most cases, the Arabic translation output of both engines produced a one verb synonym which did not collocate with the different nouns in the testing data sentences. These results indicate that Google and Bing, so far, have not been able to resolve the verb-noun collocability problem in their Arabic output. This study and its results may shed some light on the problem and to develop new methods to improve Arabic verb noun collocability in the output translation of current machine translation engines.
|
format | Article |
id | doaj-art-7868d7e2ea5c45ec9d0c2d2d1e346ec1 |
institution | Kabale University |
issn | 1675-526X 2462-1986 |
language | English |
publishDate | 2015-12-01 |
publisher | Universiti Malaya |
record_format | Article |
series | Journal of Modern Languages |
spelling | doaj-art-7868d7e2ea5c45ec9d0c2d2d1e346ec12024-11-21T04:48:18ZengUniversiti MalayaJournal of Modern Languages1675-526X2462-19862015-12-01251Evaluation of Google and Bing online translation of verb-noun collocations from English into ArabicHussein Soori0Su’ad Awab1University of Malaya, MalaysiaUniversity of Malaya, Malaysia This article aims to investigate and evaluate the translation of verb-noun collocation in English into Arabic Google and Bing online translation engines. A number of sentences were used as a testing dataset to evaluate both engines. Human translations by three bilingual speakers were used as a gold standard. A simple evaluation metric was proposed to calculate the translation accuracy of verb-noun collocations. The results showed that Bing scored a verb-noun collocation value of 0.72 with a trend estimation ranging between 0.65 and 0.67. Google scored a verb-noun collocation value of 0.75 (3% higher than Bing) with a trend estimation ranging between 0.63 and 0.85. The results also showed that, in most cases, the Arabic translation output of both engines produced a one verb synonym which did not collocate with the different nouns in the testing data sentences. These results indicate that Google and Bing, so far, have not been able to resolve the verb-noun collocability problem in their Arabic output. This study and its results may shed some light on the problem and to develop new methods to improve Arabic verb noun collocability in the output translation of current machine translation engines. https://sare.um.edu.my/index.php/JML/article/view/3143English-Arabic MT, verb-noun collocations, machine translation evaluation, evaluation metric, Arabic verb synonymy |
spellingShingle | Hussein Soori Su’ad Awab Evaluation of Google and Bing online translation of verb-noun collocations from English into Arabic Journal of Modern Languages English-Arabic MT, verb-noun collocations, machine translation evaluation, evaluation metric, Arabic verb synonymy |
title | Evaluation of Google and Bing online translation of verb-noun collocations from English into Arabic |
title_full | Evaluation of Google and Bing online translation of verb-noun collocations from English into Arabic |
title_fullStr | Evaluation of Google and Bing online translation of verb-noun collocations from English into Arabic |
title_full_unstemmed | Evaluation of Google and Bing online translation of verb-noun collocations from English into Arabic |
title_short | Evaluation of Google and Bing online translation of verb-noun collocations from English into Arabic |
title_sort | evaluation of google and bing online translation of verb noun collocations from english into arabic |
topic | English-Arabic MT, verb-noun collocations, machine translation evaluation, evaluation metric, Arabic verb synonymy |
url | https://sare.um.edu.my/index.php/JML/article/view/3143 |
work_keys_str_mv | AT husseinsoori evaluationofgoogleandbingonlinetranslationofverbnouncollocationsfromenglishintoarabic AT suaadawab evaluationofgoogleandbingonlinetranslationofverbnouncollocationsfromenglishintoarabic |