Important Notice: Our web hosting provider recently started charging us for additional visits, which was unexpected. In response, we're seeking donations. Depending on the situation, we may explore different monetization options for our Community and Expert Contributors. It's crucial to provide more returns for their expertise and offer more Expert Validated Answers or AI Validated Answers. Learn more about our hosting issue here.

What are “fetcher” threads?

April 26, 2017fetcher threads

0

Posted

What are “fetcher” threads?

1 Answer

0

Posted

Fetchersor fetcher-threads are trackers which perform the function of “fetching”, i.e downloading the files pointed to by urls. They download URLs which do not produce web-page content (HTML/XHTML) statically or dynamically. They download non-webpage URLs such as images, pdf files, zip files etc. The fetchers get their data from the urlqueue and they post web-page data to the dataqueue.