Can I use meta tags to prevent htdig from indexing certain files?
Yes, in each HTML file you want to exclude, add the following between the
and tags:Doing so will allow htdig to still follow links to other documents, but will prevent this document from being put into the index itself. You can also use “nofollow” to prevent following of links. See the section on Recognized META information for more details. For documents produced automatically by MhonArc, you can have that line inserted automatically by putting it in the MhonArc resource file, in the sections IDXPGBEGIN and TIDXPGBEGIN.You can also use the noindex_start and noindex_end attributes to define one set of tags which will mark sections to be stripped out of documents, so they don’t get indexed, or you can mark sections with the non-DTD tags.
Yes, in each HTML file you want to exclude, add the following between the
and tags: Doing so will allow htdig to still follow links to other documents, but will prevent this document from being put into the index itself. You can also use “nofollow” to prevent following of links. See the section on Recognized META information for more details. For documents produced automatically by MhonArc, you can have that line inserted automatically by putting it in the MhonArc resource file, in the sections IDXPGBEGIN and TIDXPGBEGIN. You can also use the noindex_start and noindex_end attributes to define one set of tags which will mark sections to be stripped out of documents, so they don’t get indexed, or you can mark sections with the non-DTD tags. The noindex_start and noindex_end attributes can also be used to suppress in-line JavaScript code that wasn’t properly enclosed in HTML comment tags (see question 4Related Questions
- Im using a hosting service for my site that prevents me from adding meta tags or uploading HTML files. How can I verify my site?
- Can I prevent the indexing of the META tags, ALT tags, and / or content within FORM or OPTION tags within EVERY page of my index?
- Can I use meta tags to prevent htdig from indexing certain files?
