Important Notice: Our web hosting provider recently started charging us for additional visits, which was unexpected. In response, we're seeking donations. Depending on the situation, we may explore different monetization options for our Community and Expert Contributors. It's crucial to provide more returns for their expertise and offer more Expert Validated Answers or AI Validated Answers. Learn more about our hosting issue here.

What can a webmaster do to cut down on bandwidth concerns from the spider program?

April 26, 2017bandwidth concerns cut program Spider webmaster

0

Posted

What can a webmaster do to cut down on bandwidth concerns from the spider program?

1 Answer

0

Posted

A webmaster can run the spider on their own site, then save the .spider file in their main directory. When spider is run, it will download and use that file instead of scanning the whole site.