What is the difference between a valid and a reportable run?
The SPEC tools consider a run to be invalid of it does not satisfy all the following criteria: • All the benchmark runs produce valid results. • The mref data set is used. (Future releases of MPI2007 will include the allowable lref and xref data sets as well). • The base optimization level is tested. The peak optimization level is optional. • At least two iterations are run. • Certain flags like check_md5 and reportable have the correct settings. The output report will state invalid run if any of these criteria fail to hold. A report that doesn’t state this, though, may still contain violations of the SPEC MPI2007 Run and Reporting Rules. and isn’t guaranteed to pass the SPEC/HPG committee review. The SPEC tools cannot determine that a portability flag is really required, for example. A report that passes SPEC/HPG review must also give a complete and accurate description of the system under test.
The SPEC tools consider a run to be invalid of it does not satisfy all the following criteria: • All the benchmark runs produce valid results. • The mref data set is used. (Future releases of MPI2007 will include the allowable lref and xref data sets as well). • The base optimization level is tested. The peak optimization level is optional. • At least two iterations are run. • Certain flags like check_md5 and reportable have the correct settings. The output report will state invalid run if any of these criteria fail to hold. A report that doesn’t state this, though, may still contain violations of the SPEC MPI2007 Run and Reporting Rules. and isn’t guaranteed to pass the SPEC/HPG committee review. The SPEC tools cannot determine that a portability flag is really required, for example. A report that passes SPEC/HPG review must also give a complete and accurate description of the system under test. Reports are typically submitted by the company that developed the system under test, so th
