Does the bot support nofollow?
As per the Wikipedia: The nofollow attribute value is not meant for blocking access to content or preventing content to be indexed by search engines. Instead, the nofollow attribute is primarily used by site authors to prevent Search Engines such as Google from having the source page’s PageRank impact the PageRank of linked targets. We plan to ignore the nofollow for the purposes of restricting the crawler’s ability to follow link targets. The proper methods for blocking search engine spiders to access content on a website or for preventing them to include the content of a page in their index are the Robots Exclusion Protocol (robots.txt).
