We have several websites served by the same instance of Sitecore and the same web server. Each website has its own site map and Google News feeds, and so far we have included the sitemap specification for each in a single .NET site robots.txt file.
Our SEO expert raised the presence of different domains in the same robots.txt file as a possible problem, and I can not find any documentation that specifically indicates one way or another. Thanks.
source
share