How do I farm several smaller jobs to make one larger multiprocessor job?
It is possible to submit jobs to the batch queueing system which are composed of several sub-jobs – e.g. to run 8 serial programs simultaneously as a single 8-cpu batch job. Note that there should be no need to do precisely this with the new queueing system, since the small queue accepts single-cpu jobs, but in principle a job of size MxN can be submitted composed of M distinct N-cpu sub-jobs. This is often referred to a “farming” jobs (a kind of trivial parallelism). The obvious way to do this is to create a basic jobscript firing each sub-job in turn with an & (see the user guide); e.g.