TY - JOUR
T1 - Validation of the SETOC instrument - Student evaluation of teaching in outpatient clinics
AU - Zuberi, Rukhsana W.
AU - Bordage, Georges
AU - Norman, Geoffrey R.
PY - 2007/2
Y1 - 2007/2
N2 - Purpose: There is a paucity of evaluation forms specifically developed and validated for outpatient settings. The purpose of this study was to develop and validate an instrument specifically for evaluating outpatient teaching, to provide reliable and valid ratings for individual and group feedback to faculty, and to identify outstanding teachers in that setting. Method: By literature reviews and pilot studies at the Faculties of Health Sciences, McMaster University (Canada) and Aga Khan University (AKU-Pakistan), a 15-item instrument, Student Evaluation of Teaching in Outpatient Clinics (SETOC), was created with five subscales: "Establishing Learning-Milieu, Clinical-Teaching, General-Teaching, Clinical-Competence, and Global-Rating." Seven-point Likert-type rating scales were used. Students also nominated three "best" outpatient teachers. Participants: 87 faculty members (79%) rated by all 224 third to fifth-year students (clerks) at outpatient departments of the AKU hospital over a one-year period. Analyses: Repeated measures generalizability studies, correlations, concurrent validity of SETOC scores with best teacher nominations. Results: Inter-rater G-coefficient and internal consistency of SETOC student ratings were 0.92 and 0.98. Average inter-item and inter-subscale correlations were 0.79 and 0.86. Comparing SETOC scores against "Best Teacher" nominations, sensitivity, specificity, positive and negative predictive values were greater than 0.84.Student ratings ranged from unsatisfactory (fourteen instructors) to outstanding (four instructors). Mean-scores for Learning-Milieu, Clinical-Teaching and General-Teaching were lower than those for Clinical-Competence and Global-Rating (p=0.000 for all). Conclusions: The SETOC elicited reliable and valid student ratings that can provide specific feedback to individual faculty with weak or outstanding teaching skills, and identify overall group shortcomings for faculty development.
AB - Purpose: There is a paucity of evaluation forms specifically developed and validated for outpatient settings. The purpose of this study was to develop and validate an instrument specifically for evaluating outpatient teaching, to provide reliable and valid ratings for individual and group feedback to faculty, and to identify outstanding teachers in that setting. Method: By literature reviews and pilot studies at the Faculties of Health Sciences, McMaster University (Canada) and Aga Khan University (AKU-Pakistan), a 15-item instrument, Student Evaluation of Teaching in Outpatient Clinics (SETOC), was created with five subscales: "Establishing Learning-Milieu, Clinical-Teaching, General-Teaching, Clinical-Competence, and Global-Rating." Seven-point Likert-type rating scales were used. Students also nominated three "best" outpatient teachers. Participants: 87 faculty members (79%) rated by all 224 third to fifth-year students (clerks) at outpatient departments of the AKU hospital over a one-year period. Analyses: Repeated measures generalizability studies, correlations, concurrent validity of SETOC scores with best teacher nominations. Results: Inter-rater G-coefficient and internal consistency of SETOC student ratings were 0.92 and 0.98. Average inter-item and inter-subscale correlations were 0.79 and 0.86. Comparing SETOC scores against "Best Teacher" nominations, sensitivity, specificity, positive and negative predictive values were greater than 0.84.Student ratings ranged from unsatisfactory (fourteen instructors) to outstanding (four instructors). Mean-scores for Learning-Milieu, Clinical-Teaching and General-Teaching were lower than those for Clinical-Competence and Global-Rating (p=0.000 for all). Conclusions: The SETOC elicited reliable and valid student ratings that can provide specific feedback to individual faculty with weak or outstanding teaching skills, and identify overall group shortcomings for faculty development.
KW - Concurrent validity
KW - Faculty evaluation
KW - Feedback
KW - Generalizability
KW - Outpatient clinics
KW - Reliability
KW - SETOC
KW - Student ratings
UR - http://www.scopus.com/inward/record.url?scp=33846517631&partnerID=8YFLogxK
U2 - 10.1007/s10459-005-2328-y
DO - 10.1007/s10459-005-2328-y
M3 - Article
C2 - 17160501
AN - SCOPUS:33846517631
SN - 1382-4996
VL - 12
SP - 55
EP - 69
JO - Advances in Health Sciences Education
JF - Advances in Health Sciences Education
IS - 1
ER -