Several biases in evaluation process of professors by undergraduate students

Authors

DOI:

https://doi.org/10.31686/ijier.vol10.iss7.3838

Keywords:

Teaching evaluations bias, student evaluations of teaching, teacher effectiveness, education quality

Abstract

The evaluation of the teaching process uses questionnaires applied to the students, giving them the power of be anonymous in their responses. However, if at the end of the course some students get low grades, at the moment of their responses to the questionnaires they can have an attitud of revenge against the teacher, manifested by bad evaluation to the teachers. There are other situations that interfere with students responses leading to biases in evaluation process. We reviewed factors that interfere in the teacher evaluation through questionnaires causing biases and, we also tryed to find alternatives to diminish biases in evaluation. We search original articles and reviews in web sites databases about biases in professor evaluation process and comments about avoid these biases. We also conducted a manual search for relevant articles in the reference lists of articles. Several factors can be biases in teachig evaluation proccess as feeling of revenge, more difficult course, younger students and gender male students evaluators. Non-white teachers, female teachers, older teachers, non-charism teachers, non-good look teachers also get lower grades. Teacher evaluations through questionnaires must be viewed with caution due to several biases.  Since questionnaires are difficult to be replaced in the evaluation of teachers, we discuss alternatives in order to avoid injustice to the teachers.

Downloads

Download data is not yet available.

Author Biographies

  • Patricia Nasser Carvalho, Universidade Federal de Minas Gerais

    Department of Economics

  • Marcus V H Carvalho

    Department of Surgery, Faculdade de Medicina de Jundiaí.

References

Bedard K, Khun P. Where class size matters: class size and student ratings instructors efffectiveness. Economics of Education Review 2008; 27:253-265 DOI: https://doi.org/10.1016/j.econedurev.2006.08.007

DOI: 10.1016/econodurev.2006.08.007

Beechman R. Teaching quality and student satisfaction: Nexus or Simulacrum? London Review of Education 2009;7(2):135-146. DOI: https://doi.org/10.1080/14748460902990336

DOI: 10.1080/14748460902990336 DOI: https://doi.org/10.1080/14748460902990336

Boring A, Ottoboni K, Stark PB. Student evaluations of teaching (mostly) do not measure teaching effectiveness. 2021.

https://www.scienceopen.com/hosted-document?doi=10.14293/S2199-1006.1.SOR-EDU.AETBZC.v1

DOI: 10.14293/S2199-1006.1.SOR-EDU.AETBZC.v1 DOI: https://doi.org/10.14293/S2199-1006.1.SOR-EDU.AETBZC.v1

Braga M, Paccagnella M, Pellizari M. Evaluating student`s evalaution of professor. Economic of Education Review 2014. 41:71-88. DOI: https://doi.org/10.1016/j.econedurev.2014.04.002

DOI: 10.1016/j.econedurev.2014.04.002 DOI: https://doi.org/10.1016/j.econedurev.2014.04.002

Dommeyer CJ, Baum P, Hanna RW, Chapman KS. Gathering faculty teaching evaluations by in‐class and online surveys: their effects on response rates and evaluations. 2004. 29(5):611-623 DOI: https://doi.org/10.1080/02602930410001689171

DOI: 10.1080/02602930410001689171 DOI: https://doi.org/10.1080/02602930410001689171

Fan Y, Shepherrd LJ, Slavich E, Waters D, Stone M, Abel R, Johnston EL. Gender and cultural bias in student evaluations: why representation matters 2018; PLoS ONE 14(42): e0209749 DOI: https://doi.org/10.1371/journal.pone.0209749

DOI: org/10.1371/jornal.pone.0209749

Goos M, Salomons A. Measuring teaching quality in higher education: assessing selection bias in course evaluations. Res High Educ 2017; 58:341-364 DOI: https://doi.org/10.1007/s11162-016-9429-8

DOI: 10.10.1007/s1162-9429-8

Griffin B W. Grading leniency, grade discrepancy, and student ratings of instruction. Contemp Educat Psycology 2004;29(4):410-425 DOI: https://doi.org/10.1016/j.cedpsych.2003.11.001

doi.org/10.1016/j.cedpsych.2003.11.001

Hornstein, HA. Student evaluations of teaching are a inadequate assessment tool for evaluating faculty performance. Cogent Education 2017;4:1304016 DOI:10.1080/2331186X.2017.1304016 DOI: https://doi.org/10.1080/2331186X.2017.1304016

Joye SW, Wilson JH. Professor age and gender affect student perceptions and grades. J Scholarship of teaching and learning 2015;15(4):126-138 DOI: https://doi.org/10.14434/josotl.v15i4.13466

DOI: 10.14434/josotl.v15i4.13466 DOI: https://doi.org/10.14434/josotl.v15i4.13466

Khon J, Schoenfeld-Tacher R, Helleyer. The role of gender in teaching effectiveness ratings of faculty. Academy of Educational Leardship J; 2006. 10:121-137

doi.org/10.3102/0034654313496870

Langbeins L. Management by results: student evaluation of faculty teaching and the mis-measurement of performance 2008.; Economics of Education Ver 27:417-428 DOI: https://doi.org/10.1016/j.econedurev.2006.12.003

DOI: 10.1016/econedurev.2006.12.003

Luo, Mingchu Neal. Student Response Rate and Its Impact on Quantitative Evaluation of Faculty Teaching". 2020. The Advocate 25 (2) DOI: https://doi.org/10.4148/2637-4552.1137

DOI: 10.4148/2637-4552.1137 DOI: https://doi.org/10.4148/2637-4552.1137

Magnus JR, Peresetsky A A. Grade expectations: Rationality and overconfidence. Front in Psycol 2018; 8:1-10 DOI: https://doi.org/10.3389/fpsyg.2017.02346

DOI: 10.3389/fpsyg.2017.02346 DOI: https://doi.org/10.3389/fpsyg.2017.02346

MacNell L, Driscoll A, Hunt Na. What´s in a name: exposing gender bias in student rating of teaching 2015; 40:291-303 DOI: https://doi.org/10.1007/s10755-014-9313-4

DOI: 10.1007/s10755-014-9313-4 DOI: https://doi.org/10.1007/s10755-014-9313-4

McPherson MA, Todd Jewell R, Kim, M. What determines student evaluation scores? A random effects analysys on undergraduated economics classes. Eastern Economic J. 2009, 35:37-51 DOI: https://doi.org/10.1057/palgrave.eej.9050042

DOI: 10.1057/palgrave.eej.9050042 DOI: https://doi.org/10.1057/palgrave.eej.9050042

Morrison J. ABC of learning and teaching in medicine: Evaluation. BMJ 2003.326(7385):385-387. DOI: https://doi.org/10.1136/bmj.326.7385.385

DOI: 10.1136/bmj.326.7385.385 DOI: https://doi.org/10.1136/bmj.326.7385.385

Novell C, Alston RM. I thought I got na A! Overconfidence across the economics curriculum. The J of Economic Education 2007;38(2):131-142 DOI: https://doi.org/10.3200/JECE.38.2.131-142

DOI.org/10.3200/JECE.38.2.131-142

Pinquart M, Pietzsch MC. Change in Students’ Educational Expectations – A Meta-Analysis. J Educational and Developmental Psychology 2022.12(1):43-53 DOI: https://doi.org/10.5539/jedp.v12n1p43

DOI: 10.5539/jedp.v12n1p43 DOI: https://doi.org/10.5539/jedp.v12n1p43

Ponzo M & Scopp V. The good, the bad, The ugly: teaching evaluations, beauty and abilities. 2012; Michela Ponzo & Vincenzo Scoppa, 2012; Working Papers 201204, Università della Calabria, Dipartimento di Economia, Statistica e Finanza "Giovanni Anania" – DESF

https://EconPapers.repec.org/RePEc:clb:wpaper:201204

Remedios R, Lieberman DA. I liked your course because you taugh me well: The influence of grades, workload, expectations and goals on students´evaluations of teaching. British Educational Research J 2008; 34(1):91-115 DOI: https://doi.org/10.1080/01411920701492043

DOI: 10.1080/01411920701492043 DOI: https://doi.org/10.1080/01411920701492043

Senior BA. Student teaching evaluations options and concerns. J Construction Education. 2000. 5(1):20-29

http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.527.5468

Shelvin M, Banyard P, Davies M, Griffiths MD. The validity of student evaluation of teaching in higher education: love me, love my lectures? Assessement & Evaluation in Higher Education 2000; 25(4):396-405 DOI: https://doi.org/10.1080/713611436

DOI: 10.1080/713611436 DOI: https://doi.org/10.1080/713611436

Stroebe W. Why Good Teaching Evaluations May Reward Bad Teaching: On Grade Inflation and Other Unintended Consequences of Student Evaluations. Perspect Psychol Sci. 2016 Nov;11(6):800-816. DOI: https://doi.org/10.1177/1745691616650284

DOI: 10.1177/1745691616650284 DOI: https://doi.org/10.1177/1745691616650284

Stroebe W. Student evaluations of teaching encourages poor teaching and contributes to grade inflation: a theoretical and empirical analysis. Basic and Applied Social Psychology 2020. 42(4):276-294. DOI: https://doi.org/10.1080/01973533.2020.1756817

DOI: 10.1080/01973533.2020.1756817 DOI: https://doi.org/10.1080/01973533.2020.1756817

Spooren P. On the credibility of the judge. A cross-classified multilevel analysis on student evaluations of teaching. Studies in Educational Evaluation 2010. 36:121-131

DOI: 10.1016/j.stueduc.2011.02.001

Spooren P. On the credibility of the judge. A cross-classified multilevel analysis on student evaluations of teaching. Studies in Educational Evaluation 2010. 36:121-131 DOI: https://doi.org/10.1016/j.stueduc.2011.02.001

DOI: 10.1016/j.stueduc.2011.02.001 DOI: https://doi.org/10.1016/j.stueduc.2011.02.001

Wall D. Evaluation: Improving Practice, Influencing Policy in Understanding Medical Education: Evidence, Theory and Practice - Chapter 23, pages 336-351. Editor Tim Swanwick. Wiley Online Library 2010. DOI: https://doi.org/10.1002/9781444320282.ch23

DOI: 10.1002/9781444320282.ch23 DOI: https://doi.org/10.1002/9781444320282.ch23

Warner J, Simmons, A. Giving voice to students: a preliminar analysis of informal mid-term evaluations & procedural justice. Academy of Educational Leadership Journal; Arden 2015; 19(1): 71-79.

p584373.pdf (decisionsciences.org)

Downloads

Published

2022-07-01

How to Cite

Carvalho, P. N., & Carvalho, M. V. H. (2022). Several biases in evaluation process of professors by undergraduate students. International Journal for Innovation Education and Research, 10(7), 433-441. https://doi.org/10.31686/ijier.vol10.iss7.3838
Received 2022-06-20
Accepted 2022-07-06
Published 2022-07-01