Like many other FLOSS projects running on the goodwill of others (thanks OSUOSL you’re awesome). Our web infrastructure is being hit relatively constantly by AI bots.

Despite being told via robots.txt not to they seem to want to traverse the entirety of the of the old mercurial and git repositories that we’ve left for historical reference. Special shout out to “Lightpanda/1.0” which seems to be sending GETs for URLs not even hosted by our infrastructure.

So in addition to the ban-hammer for “Lightpanda/1.0” I’ve had to turn off the web interface for the old repositories. This shouldn’t really affect anyone as the current source is on https://github.com/crosstool-ng/crosstool-ng/ and has been for some time.