What is inter-rater reliability, and why is it important?
Consistent assessment yields the best data. For this reason, we (i.e., the GE Board) want to know what steps you are taking to minimize variability between how different instructors evaluate the assignments. Inter-rater reliability refers to the steps we take to insure that different faculty raters assign the same score for performance on the same assignments. Some acceptable ways to insure inter-rater reliability are to use written rubrics to which those evaluating an assignment will refer and concur. Another useful method is to include a third rater when there is some concern about the accuracy of the assessment.
