And it's not like this will stop me from indexing the site (which doesn't seem to be their goal anyway - they have an explicit allow-all robots.txt), but really this only inconveniences *them* because now their server has to handle more requests due to me indexing category-by-category??

I do not understand what they are trying to achieve here