Important Notice: Our web hosting provider recently started charging us for additional visits, which was unexpected. In response, we're seeking donations. Depending on the situation, we may explore different monetization options for our Community and Expert Contributors. It's crucial to provide more returns for their expertise and offer more Expert Validated Answers or AI Validated Answers. Learn more about our hosting issue here.

Can I have PolicyPage automatically visit each individual page on a site? Can I Spider or Crawl through a site?

April 26, 2017automatically Crawl individual page policypage site Spider visit

0

Posted

Can I have PolicyPage automatically visit each individual page on a site? Can I Spider or Crawl through a site?

1 Answer

0

Posted

Yes. You can specify the starting page and the number of levels to spider. PolicyPage will evaluate each page it finds as it follows the links starting at the page you specify. You may specify the names of links such as “About” that you want PolicyPage to ignore.