robots.txt and sitemap checker online
A single Disallow: / line in robots.txt can drop a site from Google. Enter an address and check whether the site is open to search bots and whether a sitemap is listed.
A single Disallow: / line in robots.txt can drop a site from Google. Enter an address and check whether the site is open to search bots and whether a sitemap is listed.