A SCALE DEVELOPMENT TO DETERMINE UNIVERSITY STUDENTS' ATTITUDES TO ONLINE EXAMS ASSESSMENT

Authors

DOI:

https://doi.org/10.20535/2410-8286.283028

Keywords:

Distance education, online learning, Mobile Learning, Evaluation methodologies

Abstract

Purpose: This study aims to develop and validate a scale to determine university students' attitudes toward assessment and evaluation in online exams. Background: Measuring students' attitudes toward online exams is crucial, especially in the context of emergency transitions to online learning and the impact of external factors such as the COVID-19 pandemic. Students' perspectives on online examination practices in higher education institutions are significant in understanding students' attitudes and perceptions of online exams for effective implementation. Method: During the developmental phase of the scale, 13 items were created and presented for expert opinion. The scale propositions are designed to question the compliance of the courses with the curricula in the online education process, the transparency of online exams, and the University's technological infrastructure for online exams. The participants in the study consist of 1095 students studying in different programs at the Vocational Schools of three foundation universities in Istanbul, and they were reached via e-mail. Explanatory Factor Analysis (EFA) and Confirmatory Factor Analysis (CFA) were conducted. Findings: The results obtained prove that the 13-question scale is valid and reliable and is a good measurement to determine university students' attitudes to online exams. Implications for Research and Practice: Attitudes are likely determinants of academic achievement. Furthermore, utilizing e-tests positively impacts higher education students' performance and participation in online testing. Therefore, it is essential to consider students' attitudes towards online exams to increase academic success in online courses and provide better learning outcomes. Thus, scale development plays a pivotal role in advancing knowledge within specific domains of social science research, and it is integral to ensuring the quality and reliability of online exam instruments used in higher education.

Downloads

Download data is not yet available.

Author Biographies

Korhan Arun, Namik Kemal University

Associate Professor

Nesli Kahraman Gedik, İstanbul Aydın University

Lecturer

Zeynep Olcay, İstanbul Aydın University

Doctor Lecturer

Guven Ozdemir, İstanbul Aydın University

Doctor Lecturer

mustafa Çıkrıkçı, İstanbul Aydın University

Professor Doctor

References

  1. Abun, D., Magallanes, T., & Incarnacion, M. J. (2019). College Students’ Cognitive and Affective Attitude toward Higher Education and Their Academic Engagement. International Journal of English Literature and Social Sciences, 4(5), 1494–1507. https://doi.org/10.22161/ijels.45.38
  2. Afacan Adanır, Dr. G., İsmailova, Assoc. Prof. Dr. R., Omuraliev, Prof. Dr. A., & Muhametjanova, Assist. Prof. Dr. G. (2020). Learners’ Perceptions of Online Exams: A Comparative Study in Turkey and Kyrgyzstan. The International Review of Research in Open and Distributed Learning, 21(3). https://doi.org/10.19173/irrodl.v21i3.4679
  3. Ali, I. L., & Iftikhar, M. (2021). Comparative Analysis of Students’ Satisfaction Regarding Online Vs Traditional Examination at Postgraduate Level in University of Agriculture Faisalabad. International Journal of Social Studies, 1(1), 09–13. https://doi.org/10.55627/ijss.01.1.0111
  4. AlAdl, Abdelrahman. (2020). Using Electronic Tests Versus Pen And Paper Tests: The Experience Of Delta University. مجلة کلية التربية بالمنصورة, 110, 31-45. https://doi.org/10.21608/maed.2020.147690
  5. Alruwais, N., Wills, G., & Wald, M. (2018). Advantages and Challenges of Using e-Assessment. International Journal of Information and Education Technology, 8(1), 34–37. https://doi.org/10.18178/ijiet.2018.8.1.1008
  6. Basuony, M. A. K., EmadEldeen, R., Farghaly, M., El-Bassiouny, N., & Mohamed, E. K. A. (2021). The factors affecting student satisfaction with online education during the COVID-19 pandemic: An empirical study of an emerging Muslim country. Journal of Islamic Marketing, 12(3), 631–648. https://doi.org/10.1108/JIMA-09-2020-0301
  7. Boitshwarelo, B., Reedy, A. K., & Billany, T. (2017). Envisioning the use of online tests in assessing twenty-first century learning: A literature review. Research and Practice in Technology Enhanced Learning, 12(1), 16. https://doi.org/10.1186/s41039-017-0055-7
    |
  8. Bozkurt, A., Jung, I., Xiao, J., Vladimirschi, V., Schuwer, R., Egorov, G., … Paskevicius, M. (2020). A global outlook to the interruption of education due to COVID-19 pandemic: Navigating in a time of uncertainty and crisis. Asian Journal of Distance Education, 15(1), 1-126. https://doi.org/10.5281/zenodo.3778083
  9. Brallier, S., A. Schwanz, K., J. Palm, L., & N. Irwin, L. (2015). Online Testing: Comparison of Online and Classroom Exams in an Upper-Level Psychology Course. American Journal of Educational Research, 3(2), 255–258. https://doi.org/10.12691/education-3-2-20
  10. Brown, T. A. (2015). Confirmatory factor analysis for applied research (2nd ed.). Guilford Press.
  11. Byrne, Barbara M. (2010). Structural Equation Modeling with AMOS; Fundamental Concepts, Implementation and Programming, 2nd ed. New York: Routledge Taylor and Francis Group.
  12. Cakiroğlu, O.Ç. , Baykal, Ü. (2021). Development and psychometric properties of the attitude scale towards female employees in health institutions. Journal of Advanced Nursing, 77 (7). https://doi.org/10.1111/jan.14859
    |
  13. Daviran, A. (2015). Investigation of Impact of Educational Attitudes of Students and Teachers on Academic Achievement of Third Grade Middle School Students in Zanjan. International Journal of Academic Research in Progressive Education and Development, 3(4), Pages 403-409. https://doi.org/10.6007/IJARPED/v3-i4/1378
  14. DeVellis, Robert F.,Thorpe, Carolyn, T. (2022). Scale development: theory and applications. SAGE Publications, Inc., London. ISBN 9781544379340.
  15. Dikmen, M., (2020). The Mediating Role of Medical Students’ Attitudes towards Distance Education in the Relationship between E-Learning Styles and Academic Achievements. Journal of Educational Issues, 6(2). https://doi.org/10.5296/jei.v6i2.17789
  16. Donovan, J. Mader, C. ve Shinsky, J. (2007). Online vs. Traditional Course Evaluation Formats: Student Perceptions. Journal of Interactive Online Learning, 6(3), 158-180. https://www.ncolr.org/jiol/issues/pdf/6.3.2.pdf
    |
  17. Emin, M. N. (2020, April). Coronavirus outbreak and emergency education. SETA Perspective, (Issue 268).
  18. Gamage, K. A. A., Pradeep, R. G. G. R., & De Silva, E. K. (2022). Rethinking Assessment: The Future of Examinations in Higher Education. Sustainability, 14(6), 3552. https://doi.org/10.3390/su14063552
  19. George, D. ve Mallery, P. (2001). SPSS for Windows: step by step. Allyn & Bacon, USA.
  20. Gülbahar, Y. (2013). E-evaluation.In K. Cagiltay, Y. Goktas. (Ed.), Fundamentals of Instructional Technologies: Theories, Studies, Trends, (pp.651-663). Ankara: Pegem Academy Publishing.
  21. Halvaşi, B. (2019). Attitudes of Pre-service Music Teachers Studying in Undergraduate Programs in Turkey Towards Piano Courses. Journal of Education and Training Studies, 7(2), 142. https://doi.org/10.11114/jets.v7i2.3844.
  22. Hermanto, Y. B., & Srimulyani, V. A. (2021). The Challenges of Online Learning During the Covid-19 Pandemic. Jurnal Pendidikan Dan Pengajaran, 54(1), 46. https://doi.org/10.23887/jpp.v54i1.29703
  23. Huerta, A. H., & Britton, T. (2022). The Nexus of Carcerality and Access and Success in Postsecondary Education. American Behavioral Scientist, 66(10), 1311–1318. https://doi.org/10.1177/00027642211054820
  24. Jia, J., & He, Y. (2022). The design, implementation and pilot application of an intelligent online proctoring system for online exams. Interactive Technology and Smart Education, 19(1), 112–120. https://doi.org/10.1108/ITSE-12-2020-0246
    |
  25. Karakuş,G. (2022). Scale Development Study on University Students' Attitudes Towards Online Exams. Afyon Kocatepe University Journal of Social Sciences, 24(1). https://doi.org/10.32709/akusosbil.887141
  26. Kartallıoğlu, N. (2022). The perceptions of international students learning Turkish through distance education on Turkish language course and language skills: A metaphor study. Journal of Educational Technology & Online Learning 5(4), 1077-1093. https://doi.org/10.31681/jetol.1154079
  27. Karunarathne, G. D. D. T., & Wijewardene, L. (2021). Online Assessments: Their Importance in Higher Education. Advances in Social Sciences Research Journal, 8(12), 308–316. https://doi.org/10.14738/assrj.812.11448
  28. Kavas G. (2009). Effects of Video-Assisted Web-Based Peer Review System on Microteaching Practices: Example of Computer Education Candidates. Master Thesis, Marmara University, Istanbul.
  29. Kholid, M. N., Diptasary, F. A. A., & Tumewang, Y. K. (2021). An Integrated Model to Predict Cheating on Online Exam Among Accounting Students: Does Islamic Religiosity Matter? Jurnal Reviu Akuntansi Dan Keuangan, 11(3), 566–585. https://doi.org/10.22219/jrak.v11i3.17689
  30. Linden, K., & Gonzalez, P. (2021). Zoom invigilated exams: A protocol for rapid adoption to remote examinations. British Journal of Educational Technology, 52(4), 1323–1337. https://doi.org/10.1111/bjet.13109
  31. Luttrell, A., & Sawicki, V. (2020). Attitude strength: Distinguishing predictors versus defining features. Social and Personality Psychology Compass, 14(8). https://doi.org/10.1111/spc3.12555
  32. Means, B., & Neisler, J. (2020). Suddenly Online: A National Survey of Undergraduates during the COVID-19 Pandemic. Digital Promise. https://eric.ed.gov/?id=ED610781
  33. Ministry of Health, (2020). https://covid19.saglik.gov.tr/TR-66300/covid-19-nedir-.html
  34. Mudjijanti, F., & Srimulyani, V. A. (2023). The Impact of E-Learning on Student Interest during the Covid-19 Pandemic. European Journal of Education and Pedagogy, 4(3), 135–142. https://doi.org/10.24018/ejedu.2023.4.3.693
  35. Reedy, A., Pfitzner, D., Rook, L., & Ellis, L. (2021). Responding to the COVID-19 emergency: Student and academic staff perceptions of academic integrity in the transition to online exams at three Australian universities. International Journal for Educational Integrity, 17(1), 9. https://doi.org/10.1007/s40979-021-00075-9
    |
  36. Reeves, T. C. (2000). Alternative Assessment Approaches for Online Learning Environments in Higher Education. Journal of Educational Computing Research, 23(1), 101–111. https://doi.org/10.2190/GYMQ-78FA-WMTX-J06C
    |
  37. Rhine, R. J., & Severance, L. J. (1970). Ego involvement, inconsistency, source credibility, and attitude change. Journal of Personality and Social Psychology, 16 (2), 175–190. https://doi.org/10.1037/h0029832
    |
  38. Shakah, G. H., Al-Oqaily, A. T., & Alqudah, F. (2019). Motivation Path between the Difficulties and Attitudes of Using the E-Learning Systems in the Jordanian Universities: Aajloun University as a Case Study. International Journal of Emerging Technologies in Learning (iJET), 14(19), pp. 26–48. https://doi.org/10.3991/ijet.v14i19.10551
  39. Shraim, K. (2019). Online Examination Practices in Higher Education Institutions: Learners’ Perspectives. Turkish Online Journal of Distance Education, 20(4), 185–196. https://doi.org/10.17718/tojde.640588
    |
  40. Sijtsma K. (2009). On the Use, the Misuse, and the Very Limited Usefulness of Cronbach's Alpha. Psychometrika, 74(1), 107–120. https://doi.org/10.1007/s11336-008-9101-0.
    |
  41. Sirakaya, M., Sirakaya, D. A., & Çakmak, E. K. (2015). Investıgatıon Of The Level Of Dıstance Educatıon Students’ Attıtude Towards Onlıne Exam [Uzaktan Eğitim Öğrencilerinin Çevrimiçi Sınava Yönelik Tutum Düzeylerinin İncelenmesi]. Kastamonu Eğitim Dergisi, 23(1), Article 1.
  42. Stowell, J. R., & Bennett, D. (2010). Effects of Online Testing on Student Exam Performance and Test Anxiety. Journal of Educational Computing Research, 42(2), 161–171. https://doi.org/10.2190/EC.42.2.b
    |
  43. Stradiotová, E., Némethová, I., & Štefančík, R. (2022). What we know after the pandemic. online and face-to-face testing in comparative perspective. Advanced Education, 4–21. https://doi.org/10.20535/2410-8286.270182
  44. Şenel S., & Şenel H.C. (2021). Remote Assessment in Higher Education during COVID-19 Pandemic. International Journal of Assessment Tools in Education, 8(2), 181 - 199, 10.06.2021. https://doi.org/10.21449/ijate.820140
  45. Tabachnick, B.G. & Fidell, L.S. (2001). Using Multivariate Statistics. 4th Edition, Allyn and Bacon, Boston.
  46. Tarantini, C., Brouqui, P., Wilson, R., Griffiths, K., Patouraux, P., & Peretti-Watel, P. (2019). Healthcare workers’ attitudes towards hand-hygiene monitoring technology. Journal of Hospital Infection, 102(4), 413–418. https://doi.org/10.1016/j.jhin.2019.02.017
    |
  47. Titarenko, S., Tsys, D., Loboda, V., Khlus, N., Buzhyna, I., Kurilova, V., Butenko, H., Tsys, N., & Kasyan, A. (2020). Improving the Quality of Physical Education Classes Using Google Services in Higher Educational Institutions. Universal Journal of Educational Research, 8(11), 5081–5091. https://doi.org/10.13189/ujer.2020.081108
  48. Ünal, A., & Altuğ, F. (2021). Evaluation of Online Practical Courses and Exams from the Students’ Perspectives of Physiotherapy and Rehabilitation Department: Sample of Pamukkale University. Gevher Nesibe Journal IESDR, 6(15), 73–79. https://doi.org/10.46648/gnj.284
  49. Yamamoto, G.T, & Altun, D. (2020). Coronavirus and the Unstoppable Rise of Online Education, Journal of University Studies, 3 (1), 25-34.
  50. Yilmaz, E. O., & Toker, T. (2022). Analysing the Effects of Assessment and Evaluation Applications and Exam Formats in Distance Education. International Journal of Psychology and Educational Studies, 9(1), 165–176. https://doi.org/10.52380/ijpes.2022.9.1.691
  51. WHO (2020). https://www.who.int/emergencies/diseases/novel-coronavirus-2019/global-research-on-novel-coronavirus-2019-ncov

Downloads

Published

2023-12-30

How to Cite

Arun, K., Kahraman Gedik, N., Olcay, Z. ., Ozdemir, G., & Çıkrıkçı, mustafa. (2023). A SCALE DEVELOPMENT TO DETERMINE UNIVERSITY STUDENTS’ ATTITUDES TO ONLINE EXAMS ASSESSMENT. Advanced Education, 11(23), 157–169. https://doi.org/10.20535/2410-8286.283028

Issue

2023: Issue 23

Section

ARTICLES

License

Copyright (c) 2023 KORHAN ARUN, nesli kahraman gedik, zeynep olcay, guven ozdemir, mustafa çıkrıkçı. Article cover has been designed using assets from freepik.com

Creative Commons License

This work is licensed under a Creative Commons Attribution 4.0 International License.

Authors who publish with this journal agree to the following terms:

    1. Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal.

    1. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.

  1. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).