Evaluation of Google and Bing online translation of verb-noun collocations from English into Arabic

This article aims to investigate and evaluate the translation of verb-noun collocation in English into Arabic Google and Bing online translation engines. A number of sentences were used as a testing dataset to evaluate both engines. Human translations by three bilingual speakers were used as a gold...

Full description

Saved in:
Bibliographic Details
Main Authors: Hussein Soori, Su’ad Awab
Format: Article
Language:English
Published: Universiti Malaya 2015-12-01
Series:Journal of Modern Languages
Subjects:
Online Access:https://sare.um.edu.my/index.php/JML/article/view/3143
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1846161756924149760
author Hussein Soori
Su’ad Awab
author_facet Hussein Soori
Su’ad Awab
author_sort Hussein Soori
collection DOAJ
description This article aims to investigate and evaluate the translation of verb-noun collocation in English into Arabic Google and Bing online translation engines. A number of sentences were used as a testing dataset to evaluate both engines. Human translations by three bilingual speakers were used as a gold standard. A simple evaluation metric was proposed to calculate the translation accuracy of verb-noun collocations. The results showed that Bing scored a verb-noun collocation value of 0.72 with a trend estimation ranging between 0.65 and 0.67. Google scored a verb-noun collocation value of 0.75 (3% higher than Bing) with a trend estimation ranging between 0.63 and 0.85. The results also showed that, in most cases, the Arabic translation output of both engines produced a one verb synonym which did not collocate with the different nouns in the testing data sentences. These results indicate that Google and Bing, so far, have not been able to resolve the verb-noun collocability problem in their Arabic output. This study and its results may shed some light on the problem and to develop new methods to improve Arabic verb noun collocability in the output translation of current machine translation engines.
format Article
id doaj-art-7868d7e2ea5c45ec9d0c2d2d1e346ec1
institution Kabale University
issn 1675-526X
2462-1986
language English
publishDate 2015-12-01
publisher Universiti Malaya
record_format Article
series Journal of Modern Languages
spelling doaj-art-7868d7e2ea5c45ec9d0c2d2d1e346ec12024-11-21T04:48:18ZengUniversiti MalayaJournal of Modern Languages1675-526X2462-19862015-12-01251Evaluation of Google and Bing online translation of verb-noun collocations from English into ArabicHussein Soori0Su’ad Awab1University of Malaya, MalaysiaUniversity of Malaya, Malaysia This article aims to investigate and evaluate the translation of verb-noun collocation in English into Arabic Google and Bing online translation engines. A number of sentences were used as a testing dataset to evaluate both engines. Human translations by three bilingual speakers were used as a gold standard. A simple evaluation metric was proposed to calculate the translation accuracy of verb-noun collocations. The results showed that Bing scored a verb-noun collocation value of 0.72 with a trend estimation ranging between 0.65 and 0.67. Google scored a verb-noun collocation value of 0.75 (3% higher than Bing) with a trend estimation ranging between 0.63 and 0.85. The results also showed that, in most cases, the Arabic translation output of both engines produced a one verb synonym which did not collocate with the different nouns in the testing data sentences. These results indicate that Google and Bing, so far, have not been able to resolve the verb-noun collocability problem in their Arabic output. This study and its results may shed some light on the problem and to develop new methods to improve Arabic verb noun collocability in the output translation of current machine translation engines. https://sare.um.edu.my/index.php/JML/article/view/3143English-Arabic MT, verb-noun collocations, machine translation evaluation, evaluation metric, Arabic verb synonymy
spellingShingle Hussein Soori
Su’ad Awab
Evaluation of Google and Bing online translation of verb-noun collocations from English into Arabic
Journal of Modern Languages
English-Arabic MT, verb-noun collocations, machine translation evaluation, evaluation metric, Arabic verb synonymy
title Evaluation of Google and Bing online translation of verb-noun collocations from English into Arabic
title_full Evaluation of Google and Bing online translation of verb-noun collocations from English into Arabic
title_fullStr Evaluation of Google and Bing online translation of verb-noun collocations from English into Arabic
title_full_unstemmed Evaluation of Google and Bing online translation of verb-noun collocations from English into Arabic
title_short Evaluation of Google and Bing online translation of verb-noun collocations from English into Arabic
title_sort evaluation of google and bing online translation of verb noun collocations from english into arabic
topic English-Arabic MT, verb-noun collocations, machine translation evaluation, evaluation metric, Arabic verb synonymy
url https://sare.um.edu.my/index.php/JML/article/view/3143
work_keys_str_mv AT husseinsoori evaluationofgoogleandbingonlinetranslationofverbnouncollocationsfromenglishintoarabic
AT suaadawab evaluationofgoogleandbingonlinetranslationofverbnouncollocationsfromenglishintoarabic