What does reliability mean for performance assessments meeting the rigorous requirements of the NRS?
In the field of assessment, the concept of reliability is related to the consistency of the measurement when the testing procedure is repeated on a population of individuals or groups (American Educational Research Association, American Psychological Association, & National Council on Measurement in Education, 1999). For example, if a learner takes a test once, then takes it again an hour later and maybe another hour after that, the learner should get about the same score each time, provided nothing else has changed. As the diagram indicates, a performance assessment has a number of potential sources for inconsistency. These include the assessment task itself, the administrator, the rater, the procedure, the conditions under which it is administered, or even the examinee. For example, an examinee might be feeling great the day of the pre-test but facing a family crisis on the day of the post-test. The job of assessment developers is to demonstrate that reliability can be achieved even
Related Questions
- To meet the requirements of clause 4.6.6 that contractors shall be under the supervision of a nominated person – does that mean they have to be accompanied at all times on site?
- What does reliability mean for performance assessments meeting the rigorous requirements of the NRS?
- What does service mean and what are the service requirements ?
