• 0 Posts
  • 94 Comments
Joined 2 years ago
cake
Cake day: July 12th, 2023

help-circle









  • If you’re wondering if it’s really that bad, have this quote:

    GNOME sysadmin, Bart Piotrowski, kindly shared some numbers to let people fully understand the scope of the problem. According to him, in around two hours and a half they received 81k total requests, and out of those only 3% passed Anubi’s proof of work, hinting at 97% of the traffic being bots

    And this is just one quote. The article is full of quotes of people all over reporting they can’t focus on their work because either the infra they rely on is constantly down, or because they’re the ones fighting to keep it functional.

    This shit is unsustainable. Fuck all of these AI companies.





  • LiveLM@lemmy.ziptoLinux@programming.devGIMP 3.0.0 tagged
    link
    fedilink
    English
    arrow-up
    12
    arrow-down
    1
    ·
    edit-2
    16 days ago

    It’s an attempt to stop poorly behaved AI crawlers written by someone who had their Git server flooded Amazon’s crawler. The worst part is that it seems these companies are so desperate to suck up data to feed their models that they’ll happily disregard “good etiquette” and summarily workaround the website owner’s attempt to slow them down.

    I don’t want to have to close off my Gitea server to the public, but I will if I have to. It’s futile to block AI crawler bots because they lie, change their user agent, use residential IP addresses as proxies, and more. I just want the requests to stop.

    Source: Amazon’s AI crawler is making my git server unstable by Xe Iaso

    Given the Gnome gitlab is a rather known website, I can only imagine they’ve suffered from the same fate, probably even worse.