Important Notice: Our web hosting provider recently started charging us for additional visits, which was unexpected. In response, we're seeking donations. Depending on the situation, we may explore different monetization options for our Community and Expert Contributors. It's crucial to provide more returns for their expertise and offer more Expert Validated Answers or AI Validated Answers. Learn more about our hosting issue here.

How do I farm several smaller jobs to make one larger multiprocessor job?

0
Posted

How do I farm several smaller jobs to make one larger multiprocessor job?

0

It is possible to submit jobs to the batch queueing system which are composed of several sub-jobs – e.g. to run 8 serial programs simultaneously as a single 8-cpu batch job. Note that there should be no need to do precisely this with the new queueing system, since the small queue accepts single-cpu jobs, but in principle a job of size MxN can be submitted composed of M distinct N-cpu sub-jobs. This is often referred to a “farming” jobs (a kind of trivial parallelism). The obvious way to do this is to create a basic jobscript firing each sub-job in turn with an & (see the user guide); e.g.

Related Questions

What is your question?

*Sadly, we had to bring back ads too. Hopefully more targeted.

Experts123