By default the Virtual Robots. txt plugin allows access to the parts of WordPress that best bots name Google need to access.
If the plugin detects XML sitemap issue reference to it will be automatically added to your robots. txt file...
Because WordPress is in sub-folder it won't. know. when someone is requesting the robots. txt issue.
By default the virtual robots. txt is set to block WordPress issues and folders that don't need to be accessed by search engines.
XML sitemap wasn't included in the robots. txt issue even thought this was described as number that will work out of the box.
When I automatically go to mydomain. com robots. txt I see in the material issue not what the plugin saved..
Awesome solution to common file page content director who want to hide many pages from Google search results..
Just little note in subject the Sitemap created by Google XML Sitemaps Generator. Arne Brachhold wasn't detected.....
Browse the code recheck out SVN repository or subscribe to the development log RSS....
Fixed bug for link to robots. txt that didn't tighten for sub-folder installations of WordPress..
Read more