An Experiment Report On Quality Evaluation Of Machine Translation Outputs

MT softwares have been widely used in our daily life.In China,the major machine translation softwares are: Sougou Translate,Google Translate,Microsoft Translator,Tencent Translator,iFLYTEK Translate,Baidu Translate,Youdao Translate,Engkoo Translate,Bing Microsoft Translator and the like.However,are those softwares applicable and valuable for MT software users? Is the quality of MT outputs up to standard and which MT software will work with a better performance?To figure out the answers,this translation experiment report is designed to evaluate the acceptability and translation quality of three selected machine translation(“MT”)software,namely,Google Translate,Tencent Translator and Baidu Translate.With theories of translation principle,the author of the report(hereinafter referred to as the “AR”)sets the evaluation metrics as faithfulness and intelligibility and evaluates MT outputs and human translation outputs of 200 sentences in a MBA thesis with 10,477 Chinese characters.With specific evaluations,the AR gets all the faithfulness and intelligibility scores of MT outputs and human translation outputs.After analysis,two major findings are figured out.1.Both the average faithfulness and intelligibility of all the three selected MT softwares outputs exceed 90% and in some sentence translations,MT softwares perform better than human translation in faithfulness or intelligibility,which shows a high acceptability of MT outputs.2.In MT output evaluation,all the three selected MT softwares have better performances in faithfulness than in intelligibility.Because of the high ability to analyze the logic of the original sentences,Baidu Translate outperforms Google Translate and Tencent Translator.However,in spite of the relatively low ability of logic analysis,Google Translate and Tencent Translator are capable of analyzing the major messages of the original sentence and their translation outputs are up to the standard in general.The two findings are based on the machine translation of an MBA thesis from Chinese to English,so it can be concluded that all the three MT softwares get over 90% acceptability when translating MBA thesis from Chinese to English.Baidu Translate,for its high ability to analyze Chinese logic,it gets the best translation outputs,so MT users can choose Baidu Translate for MBA thesis translation.