LLM crawlers are aggressively destroying important community infrastructures but sadly there is not an easy fix. Still: Blocking those crawlers should be high on your list of todos
(EDIT: You do not need to link me to nepenthes, etc. I am aware of those as is sourcehut)
(Original title: LLM crawlers continue to DDoS SourceHut)
@tante Something that continues to stand out to me, is how most of this highly abusive traffic originates from the big cloud providers.
If smaller hosting providers originated this much abuse and didn't put effective mitigations in place, they would get cut off from their upstreams without a second thought, and listed on 'abusive networks' toplists.
But apparently it's "fine" if the big cloud companies do it, and there's neither recourse nor consequences.
@joepie91 that's monopoly power.