How were the result tolerances chosen?
In a validating run, the SPEC tools compare the program results against a reference output, and the results are valid if they differ by no more than a specified margin of tolerance. The tolerances themselves are the smallest margin that permited a “pass” on all the test platforms. Because of communication race-conditions between processes in the MPI2007 applications, they behave less deterministically than the single process applications of CPU2006 or the threaded applications of OMP2001. Consequently the margin of tolerance for the MPI2007 applications is correspondingly wider than it is for CPU2006 or OMP2001.
In a validating run, the SPEC tools compare the program results against a reference output, and the results are valid if they differ by no more than a specified margin of tolerance. The tolerances themselves are the smallest margin that permited a “pass” on all the test platforms. Because of communication race-conditions between processes in the MPI2007 applications, they behave less deterministically than the single process applications of CPU2006 or the threaded applications of OMP2001. Consequently the margin of tolerance for the MPI2007 applications is correspondingly wider than it is for CPU2006 or OMP2001.