Important Notice: Our web hosting provider recently started charging us for additional visits, which was unexpected. In response, we're seeking donations. Depending on the situation, we may explore different monetization options for our Community and Expert Contributors. It's crucial to provide more returns for their expertise and offer more Expert Validated Answers or AI Validated Answers. Learn more about our hosting issue here.

What robots meta tags does the bot support?

April 26, 2017bot Meta Robots support Tags

0

Posted

What robots meta tags does the bot support?

1 Answer

0

Posted

We plan to support the NOINDEX, and NOFOLLOW meta-tags. NOINDEX will restrict our crawler from caching a copy of your web page in our archive, while NOFOLLOW will prevent our crawler from following link targets contained within the content of your web page.