Is Ajax bad for SEO?
Any content available via Ajax should also be available without Ajax if a site is designed properly (i.e. accessible). That means search engines should still be able to access that data even though they don’t support Ajax/JavaScript. If you cannot then it isn’t a flaw in using Ajax, it is a flaw in the development of the site. Robots.txt Robots.txt files do not directly have an affect on SEO as commonly believed. Robots.txt files are used to tell search engines (or more specifically, user-agents) what content they are not permitted to access (and thus index). This is usally to prevent sensitive data from being found and indexed (admin control panels, etc.). If you do not wish to block any files from the search engines then you do not need to use a robots.txt file. Having one will not improve your rankings by itself nor make your site more attractive to the search engines. In fact, you should only use one if you absolutely need it as an error in your robots.txt file may result in import
