Perplexity is using stealth, undeclared crawlers to evade website no-crawl directives
https://blog.cloudflare.com/perplexity-is-using-stealth-undeclared-crawlers-to-evade-website-no-crawl-directives/
#IT #SysAdmin
@stefano So is everyone else?..
Anyone operating a public git forge server has known about this for a long time... Anubis or pow-bot-deterrent have become a requirement.
Also, fuck cloudflare
Small server part of the pixie.town infrastructure. Registration is closed.
