How accurate is IntelliMetric®?
IntelliMetric® is as accurate as human expert scorers. How do we know this? One way educators evaluate the accuracy of scoring is to look at how often two experts who review a set of papers independently agree with each other on the scores that should be assigned. In most controlled situations using a 6-point scale, two experts will agree with each other within one point about 95% of the time. When we look at how often IntelliMetric® scores agree with either of those experts we find that IntelliMetric® typically agrees with either expert about 97% to 99% of the time. For the set of prompts included within MY Access!, IntelliMetric® agreed with expert scorers 99% of the time.
