Important Notice: Our web hosting provider recently started charging us for additional visits, which was unexpected. In response, we're seeking donations. Depending on the situation, we may explore different monetization options for our Community and Expert Contributors. It's crucial to provide more returns for their expertise and offer more Expert Validated Answers or AI Validated Answers. Learn more about our hosting issue here.

In what order are datasets processed in the pipeline?

datasets pipeline processed
0
Posted

In what order are datasets processed in the pipeline?

0

In the Unix environment OPUS uses the glob command to determine what is waiting to be processed. For better performance, by default, OPUS uses the “no-sort” option of glob so that filenames are returned in no particular order. Thus it is difficult to determine which observation will enter the pipeline first if there are many candidates. To force the use of the sort option of glob, set an environment variable in your login shell or OPUS_DEFINITIONS_DIR:opus_login.csh file for setenv OPUS_SORT_FILES This will cause OPUS to perform all file searches using the sorted glob (which collates in LC_COLLATE order, see your operating system documentation for more information). This likely will result in alphabetically ordered searches.

Related Questions

What is your question?

*Sadly, we had to bring back ads too. Hopefully more targeted.

Experts123