Got a warning for my blog going over 100GB in bandwidth this month… which sounded incredibly unusual. My blog is text and a couple images and I haven’t posted anything to it in ages… like how would that even be possible?

Turns out it’s possible when you have crawlers going apeshit on your server. Am I even reading this right? 12,181 with 181 zeros at the end for ‘Unknown robot’? This is actually bonkers.

  • ikt@aussie.zone
    link
    fedilink
    English
    arrow-up
    31
    arrow-down
    1
    ·
    2 months ago

    that wouldn’t do much

    the one with the quadrillion hits is this bad boy: https://www.babbar.tech/crawler

    Babbar.tech is operating a crawler service named Barkrowler which fuels and update our graph representation of the world wide web. This database and all the metrics we compute with are used to provide a set of online marketing and referencing tools for the SEO community.

        • Vorpal@programming.dev
          link
          fedilink
          English
          arrow-up
          12
          ·
          2 months ago

          It is common custom to indicate quotes, with either “quotes” or for a longer quote a

          block quote

          The latter can be done by prefixing the line with a > here on lemmy (uses the common markdown syntax).

          Doing either of this help avoid ambiguity.

          • Jessica@discuss.tchncs.de
            link
            fedilink
            English
            arrow-up
            4
            ·
            2 months ago

            You replied to the wrong person. I already know this, but clearly the person who posted the quote doesn’t ;)

          • porcoesphino@mander.xyz
            link
            fedilink
            English
            arrow-up
            3
            ·
            2 months ago

            Thanks the taking the time. I always find it hard to follow up and point out the ambiguity / alternative without coming across in some unwelcome way