Why does SPEC use a reference machine for determining performance metrics? What machine is used for SPEC CPU2000 benchmark suites?
A21: SPEC uses a reference machine to normalize the performance metrics used in the CPU2000 suites. Each benchmark is run and measured on this machine to establish a reference time for that benchmark. These times are then used in the SPEC calculations. SPEC uses a Sun Ultra5_10 with a 300MHz processor as the reference machine. It takes approximately two days to do a SPEC-conforming run of CINT2000 and CFP2000 on this machine. The performance relation between two systems measured with the CPU2000 benchmarks would remain the same even if a different reference machine was used. This is a consequence of the mathematics involved in calculating the individual and overall (geometric mean) metrics.
Related Questions
- Why does SPEC use a reference machine for determining performance metrics? What machine is used for SPEC CPU2000 benchmark suites?
- Why does SPEC use a reference machine for determining performance metrics? What machine is used for SPEC OMP2001 benchmark suites?
- How long does it take to run the SPEC MPI2007 benchmark suites on their reference platforms?