Purpose. The article strives for the enhancement of the efficiency of translation competence assessment in philologists’ university training with the help of the triangulation method. It is deemed in the concurrent involvement of different assessment agents (teacher, peer and self) into integrated and collaborative translation performance evaluation from two perspectives, i.e. translation product quality and process workflow, with the use of diversified methods based on different theoretical approaches. This research aims at the study of students’ video screen recording contribution combined with think-aloud protocols (TAPs) to increase the assessment objectivity and reliability of the received translation product. Method. A mixed research design was developed and implemented. It involved 40 third-year university students majoring in Philology, who were asked to perform a written translation of the excerpt of English popular science article in Marketing (c. 250 words) into Ukrainian in MS Word using any reference sources at hand, video record the process of their translation and accompany it with their comments. The research was completed with the questionnaire on students’ attitude to the screen recording and TAP involvement into translation task performance and assessment. Findings. The findings of this study reported on the positive impact of screen recording on the assessment accuracy, informative value of the collected data and formative effect of triangulated assessment method on students’ translation competence acquisition. Implications for research and practice. The received results can serve for the optimisation of the procedures of translation task difficulty measurement and competence assessment in the translation classroom.

Author Biographies

Sofiya Nikolaeva, Kyiv National Linguistic University

Department of teaching methods of foreign languages and information and communication technologies, Head of the Department , Professor of the Department

Tetiana Korol, Kyiv National Linguistic University,Poltava University of Economics and Trade

Doctor of Philosophy, associate professor of Department of the Ukrainian, Foreign Languages and Translation, Institute of Economics, Management and Information Technologies, Poltava University of Economics and Trade


Angelone, E. (2020). The impact of screen recording as a diagnostic process protocol on inter-rater consistency in translation assessment. Journal of Specialised Translation, 34, 32-50.

Angelone, E. (2018). Process-Oriented Assessment of Problems and Errors in Translation: Expanding Horizons Through Screen Recording. In E. Huertas-Barros, S. Vandepitte & E. Iglesias-Fernandez (Eds.), Quality Assurance and Assessment Practices in Translation and Interpreting (pp. 179-198). Hershey PA: IGI Global.

Angelone, E. (2015). Optimizing Process-Oriented Translator Training Using Freeware and FOSS Screen Recording Applications. In P. Sandrini & M. García González (Eds.), Translation and Openness (pp. 133-145). University of Innsbruck Press.

Denzin, N. K. (1978). The research act: A theoretical introduction to sociological methods (2nd ed.). New York, USA: McGraw-Hill.

Ericsson, K. A & Simon, H. A. (1984). Protocol Analysis: Verbal Reports as Data. Cambridge, UK.

Han, C. (2017). Using analytic rating scales to assess English–Chinese bi-directional interpreting: A longitudinal Rasch analysis of scale utility and rater behavior. Linguistica Antverpiensia, New Series: Themes in Translation Studies, 16, 196-215. Retrieved 25 January 2021 from

Hansen, G. (2005). Experience and Emotion in Empirical Translation Research with Think-Aloud and Retrospection. Meta, 50 (2), 511-521.

Hansen, G. (2008). Triangulierung im Unterricht: Ubersetzungsprozesse, Eigenkorrektur und Fremdkrrektur. Informatologia, 41(2), 105-115, 2008. Retrieved 25 January 2021 from

Jakobsen, A. L. (2003). Effects of think aloud on translation speed, revision, and segmentation. In F. Alves (Eds.), Triangulating translation: perspectives in process oriented research (pp. 69-95). Amsterdam, Philadelphia: John Benjamins Publishing Company.

Kockaert, H. J., & Segers, W. (2017). Evaluation of legal translations: PIE method (Preselected Items Evaluation). Journal of Specialised Translation, 27, 148-163. Retrieved 25 January 2021 from

Korol, T. (2018). Assessment Peculiarities of Future Philologists’ Translation Competence. Education – Technology – Computer Science, 2(24), 189-194, Retrieved 25 January 2021 from

Korol, T. (2020a). Professional Translator Certification: Implications for Assessment in Undergraduate Philologists’ Training. Bulletin of the Cherkasy Bohdan Khmelnytsky National University. Series “Pedagogical Sciences”, 3, 63-72. 10.31651/2524-2660-2020-3-63–72

Korol, T. (2020b). Translation assessment: is there anything to be tested objectively? Advanced Education, 15, 32-40, 10.20535/2410-8286.200720

Krings, H. P. (2005). Wege ins Labyrinth – Fragestellungen und Methoden der Übersetzungsprozessforschung im Überblick. Meta, 50(2), 342-358.

Kussmaul, P. (1995). Training the Translator. Amsterdam, Philadelphia: John Benjamins Publishing Company.

Li, D. (2004). Trustworthiness of think-aloud protocols in the study of translation processes. International Journal of Applied Linguistics, 14(3), 301-313.

Lörscher, W. (1991). Translation performance, translation process, and translation strategies: A psycholinguistic investigation. Tübingen, Germany: Gunter Narr.

O’Brien, S. (2006). Pauses as indicators of cognitive effort in post-editing machine translation output. Across Languages and Cultures, 7(1), 1-21.

Orozco, M. & Hurtado Albir, A. (2002). Measuring Translation Competence Acquisition. Meta, 47(3), 375-402.

PACTE (2011). Results of the validation of the PACTE translation competence model: translation problems and translation competence. In C. Alvstad, A. Hild & E. Tiselius (Eds), Methods and strategies of process research: integrative approaches in translation studies (pp. 317-343). Amsterdam, Netherlands: John Benjamins.

Patton, M. Q. (1999). Enhancing the quality and credibility of qualitative analysis. Health Sciences Research, 34, 1189-1208.

Pavlović, T. (2013). The role of collaborative translation protocols (CTPs) in translation studies. Jezikoslovlje, 14(2-3), 549-563. Retrieved 25 January 2021 from

Rosa, R. N., Sinar, T. S., Ibrahim-Bell, Z. & Setia, E. (2018). Pauses by Student and Professional Translators in Translation Process. International Journal of Comparative Literature & Translation Studies, 6(1), 18-28.

Shreve, G., Angelone, E. & Lacruz, I. (2014). Efficacy of Screen Recording in the Other-Revision of Translations: Episodic Memory and Event Models. MONTI, 1, 225-245.

Vygotsky, L. S. (2007). Myshlenie i rech [Thinking and Speech]. Moscow, Russia: Labirint.




How to Cite