Perceptions of First-Year University Students on the Reliability and Validity of Student Evaluations of Teaching (SETs) in Ghana: A Mixed-Methods Study on Engagement, Bias, and Effective Teaching

Peter Eshun

doi:10.59573/emsj.9(1).2025.13

Автор(и)

Peter Eshun

DOI:

https://doi.org/10.59573/emsj.9(1).2025.13

Ключові слова:

Evaluation, Teaching, Effectiveness, Biases, Culture, Improvement

Анотація

This study investigates the perceptions of first-year university students regarding Student Evaluations of Teaching (SETs), exploring factors affecting their reliability and validity, engagement levels, and alignment with students' perceptions of effective teaching. Using a parallel convergent mixed-methods design, the study concurrently collected quantitative data through structured questionnaires from 540 randomly sampled first-year students and qualitative data from semi-structured interviews with 16 students. Quantitative data were analyzed using descriptive statistics, while qualitative data underwent thematic analysis. Quantitative findings reveal that 65% of students perceive SETs positively, 70% highlight biases such as grade expectations and instructor personality as factors affecting SET reliability, 50% demonstrate high engagement, and 60% report alignment between SET criteria and their perceptions of effective teaching. Qualitative findings complement these results, emphasizing the importance of SETs in improving teaching, the influence of biases, and the role of anonymity in fostering participation. However, challenges such as cultural norms, skepticism about feedback utilization, and gaps in evaluating interpersonal qualities persist. The study concludes that while students recognize the value of SETs, biases and contextual challenges hinder their reliability, engagement levels and alignment with effective teaching perceptions suggest that SETs can be a useful feedback mechanism if refined to address gaps in interpersonal evaluation and cultural sensitivities. The study recommends refining SET tools to include interpersonal attributes, addressing biases, implementing orientation programmes, ensuring culturally sensitive evaluation processes, and enhancing transparency to improve trust and engagement.

Посилання

Abdulkarim S. Almakadma, Nader A. Fawzy, Omar J. Baqal, & Sudha Kamada (2023). Perceptions and attitudes of medical students towards student evaluation of teaching: A cross-sectional study. Medical Education Online. https://doi.org/10.1080/10872981.2023.2220175

Adams, M. J. D., & Umbach, P. D. (2012). Nonresponse and online student evaluations of teaching: Understanding the implications. Research in Higher Education, 53(5), 576-591.

Ahmadi, M., Helms, M., & Raiszadeh, F. (2001). Business students' perceptions of faculty evaluations. International Journal of Commerce and Management, 11(2), 45-61.

Al Fryan, L. H., Shomo, M. I., & Bani, I. A. (2024). Assessment of students’ perceptions of education using the DREEM inventory at Princess Nourah University, Saudi Arabia. BMC Medical Education, 24, 928. https://doi.org/10.1186/s12909-024-05870-9.

Aleamoni, L. M. (1999). Student rating myths versus research facts from 1924 to 1998. Journal of Personnel Evaluation in Education, 13(2), 153–166. https://doi.org/10.1023/A:1008168421283

Ankomah, M., Antwi, F., & Boateng, E. (2021). Student evaluation of teaching: Challenges and opportunities in Ghanaian higher education institutions. Journal of Educational Policy and Practice, 12(3), 45–62.

Atuahene, F., & Owusu-Ansah, A. (2013). A descriptive assessment of higher education access, participation, equity, and disparity in Ghana. SAGE Open, 3(3), 1-16.

Baker, S. H. (2014). Faculty perceptions as a foundation for evaluating use of student evaluations of teaching. Graduate College Dissertations and Theses, University of Vermont.

Benton, S. L., & Cashin, W. E. (2014). Student ratings of teaching: A summary of research and literature. IDEA Paper No. 50.

Chen, Y., & Hoshower, L. B. (2003). Student evaluation of teaching effectiveness: An assessment of student perception and motivation. Assessment & Evaluation in Higher Education, 28(1), 71-88. https://doi.org/10.1080/02602930301683

Cheung, A. K. L. (2021). Structured questionnaires. In Encyclopedia of quality of life and well-being research (pp. 1-3). Cham: Springer International Publishing.

Constantinou, C., & Wijnen Meijer, M. (2022). Student evaluations of teaching and the development of a comprehensive measure of teaching effectiveness for medical schools. BMC Medical Education, 22, 113. https://doi.org/10.1186/s12909 022 03148 6

Demir, S. B., & Pismek, N. (2018). A Convergent parallel mixed-methods study of controversial issues in social studies classes: A Clash of Ideologies. Educational Sciences: Theory and Practice, 18(1), 119-149.

Donkor, A. K. (2020). Educational leadership and teacher accountability in Ghana: A conceptual framework for school improvement. Journal of Educational Administration, 58(1), 32-49.

Gyamfi, S. A., & Osei, A. (2022). Exploring student evaluation of teaching in Ghanaian universities: Insights and implications. African Journal of Educational Management, 16(2), 95-108.

Hejase, A. J., Al Kaakour, R. S., Halawi, L. A., & Hejase, H. J. (2013). Students’ perceptions of Student Evaluation of Teaching (SET) process. International Journal of Social Sciences and Education, 3(3), 565-572.

Hu, C. C. (2020). Understanding college students’ perceptions of effective teaching. International Journal of Teaching and Learning in Higher Education, 32(2), 318-328.

Kite, M. E., Subedi, P. C., & Bryant-Lees, K. B. (2015). Students’ perceptions of the teaching evaluation process. Teaching of Psychology, 42(4), 307-314. https://doi.org/10.1177/0098628315603062

Lakens, D. (2022). Sample size justification. Collabra: Psychology, 8(1), 33267.

Low, J. (2019). Unstructured and semi–structured interviews in health research. Researching Health: Qualitative, Quantitative and Mixed methods. London: Sage publications, 123-41.

Macfadyen, L. P., Dawson, S., Pardo, A., & Gasevic, D. (2021). Embracing cultural diversity in student feedback processes: Challenges and opportunities. Educational Research and Reviews, 16(4), 234-247.

Marsh, H. W. (2007). Students’ evaluations of university teaching: Dimensionality, reliability, validity, potential biases, and usefulness. The Scholarship of Teaching and Learning in Higher Education: An Evidence-Based Perspective, 319–383. https://doi.org/10.1007/1-4020-5742-3_9

Mensah, A. K., & Amponsah, S. (2020). Student evaluation of teaching: Perspectives of university students in Ghana. International Journal of Educational Management, 34(7), 1123–1137.

Merritt, J. (2019). Understanding the impact of high school to university transition on students' evaluation feedback. Journal of Educational Psychology, 12(3), 45-58.

Muya, S. M. (2019). Students’ perceptions on the quality of teaching by faculty at Jomo Kenyatta University of Agriculture and Technology in Kenya. Higher Education Research, 4(1), 1-15.

Oduro, A., & Adams, E. (2020). Cultural dimensions and their impact on student feedback in Ghanaian universities. African Journal of Educational Studies, 13(2), 127-144.

Osei-Kuffour, P. (2018). Exploring the impact of student feedback on teaching in Ghanaian universities. Higher Education Research & Development, 37(4), 695–708.

Pickersgill, B. (2018). Parallel vs. convergent evolution in domestication and diversification of crops in the Americas. Frontiers in Ecology and Evolution, 6, 56.

Quansah, F. (2022). Item and rater variabilities in students’ evaluation of teaching in a university in Ghana: application of many-facet Rasch model. Heliyon, 8(12).

Quansah, F., Cobbinah, A., Asamoah-Gyimah, K., & Hagan Jr, J. E. (2024). Validity of student evaluation of teaching in higher education: a systematic review. In Frontiers in Education (Vol. 9, p. 1329734). Frontiers Media SA.

Richardson, J. T. E. (2005). Instruments for obtaining student feedback: A review of the literature. Assessment & Evaluation in Higher Education, 30(4), 387–415. https://doi.org/10.1080/02602930500099193

Spooren, P., Brockx, B., & Mortelmans, D. (2013). On the validity of student evaluation of teaching: The state of the art. Review of Educational Research, 83(4), 598-642.

Spooren, P., Brockx, B., & Mortelmans, D. (2017). On the validity of student evaluation of teaching: The state of the art. Review of Educational Research, 73(4), 198-212. https://doi.org/10.3102/0034654313496870

Stein, S. J., Spiller, D., Terry, S., Harris, T., Deaker, L., & Kennedy, J. (2012). Unlocking the impact of tertiary teachers’ perceptions of student evaluations of teaching. Ako Aotearoa National Centre for Tertiary Teaching Excellence.

Steyn, G. M., Du Plessis, A., & De Bruin, P. (2020). Barriers to effective student evaluation of teaching in higher education: A South African perspective. Journal of Higher Education Policy and Management, 42(3), 318-331.

Tinto, V. (1993). Leaving college: Rethinking the causes and cures of student attrition. University of Chicago Press.

Treslan, D., Johnson, T., & Delaney, J. (2008). Students’ perceptions of effective teaching in higher education. Faculty of Education, Memorial University of Newfoundland. Retrieved from: https://commons.mun.ca/education.