From Brock University Teaching Wiki

Contents 1 Best Practices Guide to the Evaluation of Teaching 2 Resources 2.1 Online Resources 2.2 Further Reading 2.2.1 Selected resources on the validity and reliability of student course evaluations

[edit] Best Practices Guide to the Evaluation of Teaching

• available at: http://brocku.ca/ctlet/services-ctlet/best-practice-evaluation

[edit] Resources

Contact the CTLET for:

• Consultations
• Formative feedback instruments, e.g. Teacher Behaviours Inventory (Murray, 1983)
• Evaluation of course and teaching question bank

[edit] Online Resources

• Online course evaluation example - http://www.brocku.ca/ctlet/eval
• Word document template for Scantron forms
• Scantron RPT converter for use in Excel or SPSS - https://ctlet.brocku.ca/sanetron/
• Departmental course evaluation examples (contact CTLET)
  • Some Example Evaluation of Teaching Forms available online
• Reports regarding course evaluation data (contact CTLET)
• CAUT Model Clause on the Evaluation of Teaching Performance

[edit] Further Reading

• Beran, T., & Violato, C. (2005). Ratings of university teacher instruction: How much do student and course characteristics really matter? Assessment & Evaluation in Higher Education, 30(6), 593-601.
• Clayson, D. E., Frost, T. F., & Sheffet, M. J. (2006). Grades and the student evaluation of instruction: A test of the reciprocity effect. Academy of Management Learning & Education, 5(1), 52-85.
• Penny, A. R. (2003). Changing the agenda for research into students' views about university teaching: Four shortcomings of SRT research. Teaching in Higher Education, 8(3), 399-411.
• Tokuno, K. A. (2006). Assessment of TA training: Use of strength of effect and problems with centralized assessment. Assessment Update, 18(6), 3-6.

[edit] Selected resources on the validity and reliability of student course evaluations

From: Student Course Evaluations: Research, Models and Trends (Pamela Gravestock and Emily Gregor-Greenleaf, University of Toronto, October 2008)

• Abrami, P.C. (2001). Improving judgments about teaching effectiveness using teacher rating forms. In M. Theall, P.C. Abrami, and L.A. Mets (Eds.). The Student Ratings Debate: Are They Valid? How Can We Best Use Them? [Special issue. New Directions for Institutional Research 109, 59-87.]
• Aleamoni. (1999). Student rating myths versus research facts from 1924 to 1998. Journal of Personnel Evaluation in Education, 13(2), 153-166.
• Algozzine, B., Beattie, J., Bray M., Flowers C., Gretes J., Howley L., Mohanty G., and Spooner F.. (2004). Student evaluation of college teaching: A practice in search of principles. College Teaching, 52(4), 134-141.
• Ali, D.L & Sell Y. (1998) Issues regarding the reliability, validity and utility of student ratings of instruction: A Survey of research findings. Calgary: University of Calgary APC Implementation Task Force on Student Ratings of Instruction.
• Beran, T., Violato C., & Kline D. (2007). What’s the ‘use’ of student ratings of instruction for administrators? One university’s experience. Canadian Journal of Higher Education, 17(1), 27-43.
• Beran, T., Violato C., Kline D. & Frideres J. (2005). The utility of student ratings of instruction for students, faculty, and administrators: A “consequential validity” study. Canadian Journal of Higher Education, 35(2), 49-70.
• Cashin, W.E. (1995). Student ratings of teaching: The research revisited. IDEA Paper No. 32. Kansas State University: Center for Faculty Evaluation and Development.
• Cashin, W.E. (1988). Student ratings of teaching: A summary of the research, IDEA Paper No. 20. Kansas State University: Center for Faculty Evaluation and Development.
• d’Apollonia S & Abrami P.C. (1997). Navigating student ratings of instruction. American Psychologist, 52(11), 1198-1208.
• Franklin, J. (2001). Interpreting the numbers: Using a narrative to help others read student evaluations of your teaching accurately. In K.G. Lewis (Ed.). Techniques and Strategies for Interpreting Student Evaluations [Special Issue. New Directions for Teaching and Learning, 87, 85-100]
• Franklin, J. & Theall, M. (1989). Who reads ratings: Knowledge, attitude and practice of users of student ratings of instruction. Paper presented at the American Educational Research Association annual meeting of the AERA, San Francisco.
• Greenwald, A.G. (1997). Validity concerns and usefulness of student ratings of instruction. American Pyschologist, 52(11), 1182-1186
• Kulik, J.A. (2001). Student ratings: Validity, utility, and controversy. In M. Theall, P.C. Abrami, and L.A. Mets (Eds.). The Student Ratings Debate: Are They Valid? How Can We Best Use Them? [Special issue. New Directions for Institutional Research, 109, 9-25, San Francisco: Jossey-Bass.]
• Marsh, H.W., and Roche, L. (1997). Making students’ evaluations of teaching effectiveness effective: The critical issues of validity, bias and utility. The American Psychologist, 52(11), 1187-97.
• McKeachie, W. J. (1997). Student ratings: The validity of use. American Psychologist, 52(11), 1218-25.
• Ory, J.C. (2001). Faculty thoughts and concerns about student ratings. In K.G. Lewis (Ed.). Techniques and Strategies for Interpreting Student Evaluations [Special Issue. New Directions for Teaching and Learning, 87, 3-15.]
• Ory, J.C. and K. Ryan (2001). How do student ratings measure up to a new validity framework? In M. Theall, P.C. Abrami, and L.A. Mets (Eds.). The Student Ratings Debate: Are They Valid? How Can We Best Use Them? [Special issue. New Directions for Institutional Research, 109, 27-44.]
• Theall, M. and Franklin, J. (2001) Looking for Bias in All the Wrong Places: A Search for Truth or a Witch Hunt in Student Ratings of Instruction?, In M. Theall, P.C. Abrami, and L.A. Mets (Eds.). The Student Ratings Debate: Are They Valid? How Can We Best Use Them? (Special issue). New Directions for Institutional Research, 109, 45-56.
• Wachtel, H.K. (1998). Student evaluation of college teaching effectiveness: A brief review. Assessment & Evaluation in Higher Education, 29(2), 191-121.