The Validity and Reliability of the Student Evaluation of Teaching: A case in a Private Higher Educational Institution in Malaysia.

Tan Lay Khong

doi:10.31686/ijier.vol2.iss9.238

Authors

Tan Lay Khong

Taylor’s University, Malaysia

DOI:

https://doi.org/10.31686/ijier.vol2.iss9.238

Keywords:

Student Evaluation of Teaching, validity, reliability

Abstract

Most universities are using the Student Evaluation of Teaching (SET) as an instrument for students to assess a lecturer’s teaching performance. It is an essential instrument to reflect the feedback in enhancing the quality of teaching and learning. The purpose of this paper is to examine the validity and reliability of the SET as a valid instrument in evaluating teaching effectiveness in a private higher education institution in Malaysia. Exploratory Factor Analysis and Confirmatory Factor Analysis have validated all 10 items of SET whereby all items indicated high reliability and internal consistency. A Confirmatory Factor Analysis using AMOS software also confirmed that a single factor model was used to evaluate teaching effectiveness. The single factor model was further validated using 1000 repeated samples of Bootstrap method in AMOS.

Author Biography

Tan Lay Khong, Taylor’s University, Malaysia

Taylor’s Business School

References

D’Apollinia, S. &. Abrami, P.C. (1997). Navigating student ratings of instruction, American Psychologist, 64, 431 - 441.

Efron, B. (1979). Bootstrap methods: Another look at the jackknife. Annals of Statistics, 7, 1-26. DOI: https://doi.org/10.1214/aos/1176344552

Feldman, K.A. (1977) Consistency and variability among college students in rating their teachers and courses. Research in Higher Education, 10, 137 – 194. DOI: https://doi.org/10.1007/BF00991288

Foulger, D. and other participants. (June 1, 2010). Statistical Methods. MediaSpaceWiki. Retrieved on from http://evolutionarymedia.com/cgi-bin/wiki.cgi?StatisticalMethods.

Fox, R. (1994). Validating lecturer effectiveness questionnaires in accounting. Accounting Education, 3 (3), 249 – 258. DOI: https://doi.org/10.1080/09639289400000023

Greenwald, A. G. (1997). Validity Concerns and Usefulness of Student Ratings of Instruction. American Psychologist, 52(11), 1182 - 1186. DOI: https://doi.org/10.1037/0003-066X.52.11.1182

Kember, D. and Leung, D.Y.P. (2008). Establishing the validity and reliability of course evaluation questionnaires. Assessment & Evaluation in Higher Education, 33(4), 341 - 353. DOI: https://doi.org/10.1080/02602930701563070

Kerlinger, Fred N. (1986). Foundations of Behavioural Research: Educational and Psychology Inquiry, 3rd.edition. New York: Holt, Rinehard and Winston.

Kremer, J.F. (1990). Construct Validity of Multiple Measures in Teaching, Research, and Service and Reliability of Peer Ratings. Journal of Educational Psychology, 82(2), 213 - 218. DOI: https://doi.org/10.1037/0022-0663.82.2.213

Marsh, H.W.(1984). Students, evaluations of university teaching: dimensionality, reliability, validity, potential biases and utility, Journal of Educational Psychology, 76(5), 707 - 754. DOI: https://doi.org/10.1037/0022-0663.76.5.707

Marsh, H.W..(1987). Students’ evaluations of of university teaching: research findings, methodological issues, and directions for further research, International Journal of Educational Research, 11(3), 253 – 288. DOI: https://doi.org/10.1016/0883-0355(87)90001-2

Messick, S. (1989). Validity In .R.Linn (Ed.) Educational measurement (4th ed., 13 - 103), New York: Macmillan Publishing.

Ramsden, P. (1991). A performance indicator of teaching quality in higher education: the course experience questionnaire, Studies in Higher Education, 16, 129 - 150 DOI: https://doi.org/10.1080/03075079112331382944

Richardson, J.T.E. (1994). A British evaluation of the course experience questionnaire. Studies in Higher Education, 19, 59 - 68. DOI: https://doi.org/10.1080/03075079412331382143

Sheehan, E.P. & DuPrey,T. (1999). Student evaluations of university teaching. Journal of Instructional Psychology, 26, 188.

Shevlin, M.; Banyard, P.; Davies, M. & Griffiths, M. (2000). The Validity of Student Evaluation of Teaching in Higher Education: love me, love my lectures? Assessment & Evaluation in Higher Education, 25(4), 397 - 405. DOI: https://doi.org/10.1080/713611436

Sproule, R. (2002). The underdetermination of instructor performance by data from the student evaluation of teaching, Economics of Education Review, 21, 287 – 294 DOI: https://doi.org/10.1016/S0272-7757(01)00025-5

Trigwell, K. & Prosser, M. (1991). Improving the quality of student learning: the influence of learning context and student approaches to learning on learning outcomes. Higher Education, 22, 251 - 266. DOI: https://doi.org/10.1007/BF00132290

Wilson, K.L.; Lizzio, A. and Ramsden, P. (1997). The development, validation and application of the Course Experience Questionnaire. Studies in Higher Education, 22(1), 33 - 53. DOI: https://doi.org/10.1080/03075079712331381121

Yung, K.H., Bentler, P.M. (1996). Bootstrapping techniques in analysis of mean and covariance structures. In G.A. Marcoulides & R.E. Schumacker. Advanced structural equation modeling: Issues and techniques. Erlbaum N.J.