??? why would you have a robots.txt pointing at a sitemap.xml and then the sitemap.xml just responds with "Connection failed! You are not authorized!"
Follow
And it's not like this will stop me from indexing the site (which doesn't seem to be their goal anyway - they have an explicit allow-all robots.txt), but really this only inconveniences *them* because now their server has to handle more requests due to me indexing category-by-category??
I do not understand what they are trying to achieve here
