What dictates the constraint of parallelizability?
One constraint of supercomputers on speed of processing a problem is the amount of the task that is actually parallelizable. Amdahl’s Law provides that speeding up a calculation through parallelization is subject to diminishing returns. Only that part of the problem that is parallelizable will be accelerated. Amdahl’s law is concerned with the speedup attainable from an improvement to a computation that affects a proportion P of that computation where the improvement has a speedup of S.