A STUDY ON ASSESSMENT CRITERIA FOR ENGLISH – VIETNAMESE CONSECUTIVE INTERPRETING TESTS

Abstract

The study investigates the reliability and user feedback about the rubrics to evaluate English – Vietnamese consecutive interpreting tests taken by undergraduates at VNU-ULIS created by Tran and Do (2022). Five VNU-ULIS raters – two experienced raters and three novice ones – independently rated ten different interpreting tests and provided their feedback on the rubrics. The results reveal the newly created rubrics is mostly considered user-friendly and practical application for interpreting evaluation. Overall, inter-rater reliability, which was presented through Cronbach’s alpha and the single measure intra-class coefficient, was acceptable. Besides, the value among the novice raters was higher than that between the two experienced ones. The raters’ perception of each quality criterion and their rating process may account for the differences in their score decisions. The findings also suggest further improvements in terms of descriptor wording, weightings and rater training.