Got a warning for my blog going over 100GB in bandwidth this month… which sounded incredibly unusual. My blog is text and a couple images and I haven’t posted anything to it in ages… like how would that even be possible?

Turns out it’s possible when you have crawlers going apeshit on your server. Am I even reading this right? 12,181 with 181 zeros at the end for ‘Unknown robot’? This is actually bonkers.

    • benagain@lemmy.mlOP
      link
      fedilink
      English
      arrow-up
      0
      ·
      15 days ago

      It’s a mix, I put two screenshots together. On the left is my monthly bandwidth usage from CPanel on the right is Awstats (though I hid some sections so the Robots/Spiders section was closer to the top).

        • benagain@lemmy.mlOP
          link
          fedilink
          English
          arrow-up
          0
          ·
          15 days ago

          I think they’re winding down the project unfortunately, so I might have to get with the times…