What Do Students Really Judge? IVET Teachers' Perspectives on Student Evaluation as a Source of Professional Assessment
DOI:
https://doi.org/10.57125/FED.2026.09.10Keywords:
student evaluation of teaching, student satisfaction survey, vocational teachers, professional competence, conversion factors, professional development.Abstract
Student evaluation of teaching remains a widely used but theoretically contested institutional practice, with ongoing debate over whether student judgement can be interpreted as a valid indicator of teaching quality. This debate remains largely unexamined for teachers in initial vocational education and training, a professional category that, within the Italian regional vocational training system, lacks the standardised qualification pathways applicable to school-based teachers. Drawing on a capability-based theoretical framework, this study examined how vocational teachers position student evaluation within their broader understanding of professional assessment and proposed an alternative theoretical interpretation of student satisfaction data. Eighteen semi-structured interviews were conducted with vocational teachers employed by a regional training provider in north-eastern Italy, using thematic analysis with a critical-incident technique. Twelve interviews addressed student evaluation directly. Teachers accepted student judgement only conditionally — tied to track record, students' maturity, or explicit openness to unfavourable scores — while questioning its representativeness and its vulnerability to relational and episodic contamination. Procedural conditions of data collection, and opacity in how collected data were subsequently used, shaped whether student judgement was considered sincere and useful. Several teachers proposed outcome-based alternatives to direct opinion, while others grounded legitimacy in students' continuous presence during teaching. This legitimacy was concentrated in relational and contextual dimensions of practice rather than in technical competence. These findings offer a theoretically grounded account of student evaluation for an unregulated professional category, with practical implications for instrument design in comparable settings.
References
Antera, S. (2021). Professional competence of vocational teachers: A conceptual review. Vocations and Learning, 14(3), 459–479. https://doi.org/10.1007/s12186-021-09271-7
Antera, S. (2023). Competence importance and acquisition: Comparing qualified and non-qualified vocational teachers. Journal of Education and Work, 36(2), 109–124. https://doi.org/10.1080/13639080.2023.2167956
Braun, V., & Clarke, V. (2006). Using thematic analysis in psychology. Qualitative Research in Psychology, 3(2), 77–101. https://doi.org/10.1191/1478088706qp063oa
Bükki, E., & Fehérvári, A. (2024). Teacher, professional or both? A mixed method study of the professional identity of vocational teachers and trainers in Hungary. International Journal for Research in Vocational Education and Training, 11(3), 396–428. https://doi.org/10.13152/IJRVET.11.3.4
Caldwell, D., Johnson, C., Moore, M., Moore, A., Poush, M., & Franks, A. M. (2024). Teaching through the student lens: Qualitative exploration of student evaluations of teaching. American Journal of Pharmaceutical Education, 88(3), Article 100672. https://doi.org/10.1016/j.ajpe.2024.100672
Cedefop. (2023, March 2). Italy: Approval of national implementation plan (VET) [Policy timeline entry]. https://www.cedefop.europa.eu/en/news/italy-approval-national-implementation-plan-vet
Cedefop. (2025). Vocational education and training policy briefs 2024 – Italy: National VET policy developments 2023-24. Publications Office of the European Union.
Cook, S., Watson, D., & Webb, R. (2024). Performance evaluation in teaching: Dissecting student evaluations in higher education. Studies in Educational Evaluation, 81, Article 101342. https://doi.org/10.1016/j.stueduc.2024.101342
Cornelius-White, J. (2007). Learner-centered teacher-student relationships are effective: A meta-analysis. Review of Educational Research, 77(1), 113–143. https://doi.org/10.3102/003465430298563
Creswell, J. W. (2014). Research design: Qualitative, quantitative, and mixed methods approaches (4th ed.). SAGE.
Drue, C. R., & Bifulco, C. A. (2025). Beyond the numbers: How directors and chairs interpret student feedback to equitably evaluate teaching. Journal of Academic Ethics, 23(3), 1499–1521. https://doi.org/10.1007/s10805-025-09611-5
Dyer, K. D., & Donnelly-Hermosillo, D. (2024). Student ratings of instruction: Updating measures to reflect recent scholarship. Research in Higher Education, 65(7), 1587–1613. https://doi.org/10.1007/s11162-024-09804-8
Flanagan, J. C. (1954). The critical incident technique. Psychological Bulletin, 51(4), 327–358. https://doi.org/10.1037/h0061470
Gilbert, R. O., & Gilbert, D. R. (2025). Student evaluations of teaching do not reflect student learning: An observational study. BMC Medical Education, 25, Article 313. https://doi.org/10.1186/s12909-025-06896-3
González-Fernández, R., Ruiz-Cabezas, A., Medina Domínguez, M. C., Subía-Álava, A. B., & Delgado Salazar, J. L. (2024). Teachers' teaching and professional competences assessment. Evaluation and Program Planning, 103, Article 102396. https://doi.org/10.1016/j.evalprogplan.2023.102396
Heffernan, T. (2022). Sexism, racism, prejudice, and bias: A literature review and synthesis of research surrounding student evaluations of courses and teaching. Assessment & Evaluation in Higher Education, 47(1), 144–154. https://doi.org/10.1080/02602938.2021.1888075
Herning Declaration. (2025). Herning Declaration on attractive and inclusive Vocational Education and Training (VET) for increased competitiveness and quality jobs 2026-2030. Danish Presidency of the Council of the European Union. https://danish-presidency.consilium.europa.eu/media/23xla4rt/herning-declaration-2025-english.pdf
Hippe, R., Kyriakopoulou, P., & Psifidou, I. (2022). Teachers and trainers in a changing world: Building up competences for inclusive, green and digitalised VET (Cedefop Research Paper No. 86). Publications Office of the European Union.
Holdsworth, S., Sandri, O., Hayes, J., & Maslen, S. (2025). Scenario-based capability assessment in professional learning contexts. Journal of Adult and Continuing Education, 31(3), 600–627. https://doi.org/10.1177/14779714241297069
Isoré, M. (2009). Teacher evaluation: Current practices in OECD countries and a literature review (OECD Education Working Papers No. 23). OECD Publishing. https://doi.org/10.1787/223283631428
Kim, F., Williams, L. A., Johnston, E. L., & Fan, Y. (2024). Bias intervention messaging in student evaluations of teaching: The role of gendered perceptions of bias. Heliyon, 10(17), Article e37140. https://doi.org/10.1016/j.heliyon.2024.e37140
Le Boterf, G. (2008). Repenser la compétence: pour dépasser les idées reçues, 15 propositions (2e éd.). Éditions d'Organisation.
Levinsson, H., Nilsson, A., Mårtensson, K., & Persson, S. D. (2024). Course design as a stronger predictor of student evaluation of quality and student engagement than teacher ratings. Higher Education, 88(5), 1997–2013. https://doi.org/10.1007/s10734-024-01197-y
Marsh, H. W., & Roche, L. A. (1997). Making students' evaluations of teaching effectiveness effective. American Psychologist, 52(11), 1187–1197. https://doi.org/10.1037/0003-066X.52.11.1187
Meijer, K., Baartman, L., Vermeulen, M., & de Bruijn, E. (2025). Mapping teachers' perceived importance of assessment competence: A quantitative exploration in the context of Dutch Higher Vocational Education. Empirical Research in Vocational Education and Training, 17, Article 10. https://doi.org/10.1186/s40461-025-00185-5
Nussbaum, M. C. (2011). Creating capabilities: The human development approach. Harvard University Press.
O'Donovan, R. (2024). Missing the forest for the trees: Investigating factors influencing student evaluations of teaching. Assessment & Evaluation in Higher Education, 49(4), 453–470. https://doi.org/10.1080/02602938.2023.2266862
Pastré, P., Mayen, P., & Vergnaud, G. (2006). La didactique professionnelle. Revue Française de Pédagogie, 154, 145–198. https://doi.org/10.4000/rfp.157
Patton, M. Q. (2002). Qualitative research and evaluation methods (3rd ed.). SAGE.
Psifidou, I., Papazoglou, M., & Pouliakas, K. (2026). VET teachers at a turning point: Pilot evidence from Cedefop's European Vocational Teacher Survey (Cedefop Working Paper No. 29). Publications Office of the European Union. https://doi.org/10.2801/1254726
Quansah, F., Cobbinah, A., Asamoah-Gyimah, K., & Hagan, J. E., Jr. (2024). Validity of student evaluation of teaching in higher education: A systematic review. Frontiers in Education, 9, Article 1329734. https://doi.org/10.3389/feduc.2024.1329734
Röhl, S., Bijlsma, H., & Schwichow, M. (2025). Can feedback from students to teachers improve different dimensions of teaching quality in primary and secondary education? A hierarchical meta-analysis. Educational Assessment, Evaluation and Accountability, 37(1), 35–71. https://doi.org/10.1007/s11092-024-09450-9
Royal, K. D. (2017). A guide for making valid interpretations of student evaluation of teaching (SET) results. Journal of Veterinary Medical Education, 44(2), 316–322. https://doi.org/10.3138/jvme.1215-201R
Schön, D. A. (1983). The reflective practitioner: How professionals think in action. Basic Books.
Sen, A. (1999). Development as freedom. Oxford University Press.
Søndergaard, M. K., Degn, L., & Lassesen, B. (2024). Thinking or talking about teaching? Student evaluation as an occasion for dialogue or reflection on teaching. Tertiary Education and Management, 30, 147–163. https://doi.org/10.1007/s11233-024-09140-7
Spooren, P., Brockx, B., & Mortelmans, D. (2013). On the validity of student evaluation of teaching: The state of the art. Review of Educational Research, 83(4), 598–642. https://doi.org/10.3102/0034654313496870
Stark, P. B., & Freishtat, R. (2014). An evaluation of course evaluations. ScienceOpen Research. https://doi.org/10.14293/S2199-1006.1.SOR-EDU.AOFRQA.v1
Uttl, B., White, C. A., & Wong Gonzalez, D. (2017). Meta-analysis of faculty's teaching effectiveness: Student evaluation of teaching ratings and student learning are not related. Studies in Educational Evaluation, 54, 22–42. https://doi.org/10.1016/j.stueduc.2016.08.007
Vehovar, V., & Štrlekar, L. (2024). When to conduct student evaluation of teaching surveys: Before or after the final examination? Assessment & Evaluation in Higher Education, 49(6), 767–780. https://doi.org/10.1080/02602938.2023.2298771
Woodzicka, J. A., Greer, L., Murdock, K. K., Johnson, D. R., Locy, T., & Goldsmith, A. H. (2025). One piece of the puzzle: Developing an empirically informed open-ended student evaluation of teaching. Frontiers in Education, 10, Article 1670426. https://doi.org/10.3389/feduc.2025.1670426
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2026 author

This work is licensed under a Creative Commons Attribution 4.0 International License.
