How is quality maintained throughout the scoring process?
Two readers score each paper independently. If the two scores are different but adjacent, the paper receives the average of the two scores. If the two readers’ scores differ by more than one point, the paper is scored by a team leader. In addition, papers are chosen at random and read by a third reader to monitor consistency. State specialists review the statistics constantly to ensure that the readers are using the full scale of the scoring rubric. Readers and their scoring are monitored throughout the scoring process to ensure reliability.
