today I set all the git repositories on my personal forgejo server to private because llm crawlers were thrashing my server
when you ask chatgpt a silly question to see the silly answer, or prompt midjourney or whatever for a funny image, or use copilot or claude to vibe code, you are complicit in this
@Tak I run gitea/forgejo aswell and I made my own, it works pretty well. The config isn't perfect yet but on the off chance you are using docker I do have a docker compose config example on there.
https://git.sequentialread.com/forest/pow-bot-deterrent-rp
Yeah its very cringe how the LLM scraper bots will try to download both zip and tarball of the repo at every single commit.
@Tak Yeah in the config, there's a bunch of rules that allow certain things thru, git clients being one of them.
@forestjohnson nice, I'll try it out!
@forestjohnson Oh, this is a similar concept to anubis. Doesn't it also block git clients using https, or is there special handling for that?