How is IntelliMetric® trained?
Similar to how human raters are trained to score a new prompt, IntelliMetric® is given a training set that includes many essays that were previously scored by experts. IntelliMetric® takes that information and processes it to determine what it means to be an essay deserving of each score point as mandated by the experts. IntelliMetric® establishes a scoring program unique for each training set that best predicts what the experts would score new essays submitted to that same prompt. After the model is created, the IntelliMetric® scores are compared to expert scores on a validation set of essays. These essays have been scored by humans, but are not part of the training process. If IntelliMetric® and the experts agree, the IntelliMetric® model is ready to be put into use to score new essays submitted to that prompt.