How does OPUS make things easier?
Compared with the HST pipeline, the sample pipeline is in fact a simple demonstration. While running all the observations through the sample pipeline can take some time, it is trivial compared with a true calibration pipeline. However, you can still get a feeling for, and experiment with, creating multiple instances of processes and distributing processes over several machines. First, on the same machine, bring up several copies of the g2f task. Use the Process Manager (PMG) to select the same task on the same machine several times. The pipect task will monitor the pipeline throughput and produce a summary report when it is terminated. That report, described in the first question, as well as the wall clock time required to complete the sample dataset, should demonstrate the benefit of multiple instances. It is still possible to swamp the resources on a single machine with too many tasks. Try bringing up several copies of the g2f process on different machines to determine what the best
