Hello man
You are OK? I hope you are well.
I am in dire straits and have a bit of problems. I have a simple robots.txt file like this:
User Agent: *
Do not allow:
Sitemap: http://x.com/post-sitemap.xml
Sitemap: http://x.com/series-sitemap.xml
Sitemap: http://x.com/movies-sitemap.xml
Sitemap: http://x.com/genre-sitemap.xml
Sitemap: http://x.com/genreseries-sitemap.xml
Sitemap: http://x.com/category-sitemap.xml
Sitemap: http://x.com/post_tag-sitemap.xml
Sitemap: http://x.com/tagz-sitemap.xml
Sitemap: http://x.com/tagzz-sitemap.xml
The XML Sitemap is created with the SEO plugin by Yoast. I submitted the robots.txt to google webmaster tools. Then I introduced my Sitemap URL. It shows me 768 warnings: Sitemap contains URLs that are blocked by robots.txt.
But the thing is, my robots.txt file has no preferences that cause search engines to crawl to my sitemap.
