Can IntelliMetric® be tricked?
Yes. Just as an expert rater can sometimes be tricked, IntelliMetric® is also not a perfect system. Since we know IntelliMetric® can be tricked, we have controls in place to catch non-legitimate essays submitted for scoring. At Vantage Learning, we tend to be on the conservative side, flagging a considerable number of essays for expert review to be certain we catch the non-legitimate essays. For any prompt, approximately 5% of the most aberrant essays will be flagged for expert review. We have had great success in being able to identify aberrant essays such as those that are off-topic, off-task, lack proper development, are written in a language other than what was expected, contain bad syntax, copy the question, are inappropriate, or contain messages of harm.
