Beehaw
  • Communities
  • Create Post
  • search
    Search
  • Login
  • Sign Up
fattyfoods ( fattyfoods@feddit.nl )  to Open Source@lemmy.ml · 1 year ago

The Open-Source Software Saving the Internet From AI Bot Scrapers

www.404media.co

external-link
message-square
49
link
fedilink
  • cross-posted to:
  • opensource@programming.dev
  • technology
371
external-link

The Open-Source Software Saving the Internet From AI Bot Scrapers

www.404media.co

fattyfoods ( fattyfoods@feddit.nl )  to Open Source@lemmy.ml · 1 year ago
message-square
49
link
fedilink
  • cross-posted to:
  • opensource@programming.dev
  • technology
Anubis, which block AI scrapers from scraping websites to death, has been downloaded almost 200,000 times.
  • ElectricVocalist ( Mubelotix@jlai.lu ) 
    link
    fedilink
    arrow-up
    56
    ·
    1 year ago

    Exactly. It’s called proof-of-work and was originally invented to reduce spam emails but was later used by Bitcoin to control its growth speed

    • JackbyDev ( JackbyDev@programming.dev ) 
      link
      fedilink
      English
      arrow-up
      6
      ·
      1 year ago

      It’s funby that older captchas could be viewed as proof of work algorithms now because image recognition is so good. (From using captchas.)

      • ElectricVocalist ( Mubelotix@jlai.lu ) 
        link
        fedilink
        arrow-up
        5
        ·
        1 year ago

        Interesting stance. I have bought many tens of thousand of captcha soves for legitimate reasons, and I have now completely lost faith in them

      • Ferk ( Ferk@lemmy.ml ) 
        link
        fedilink
        arrow-up
        1
        ·
        edit-2
        1 year ago

        That’s actually a good idea. A very simple “click the frog” captcha might be solvable by an AI but it would work as a way to make it more expensive for crawlers without wasting compute resources (energy!) on the user or slowing down old devices to a crawl. So in some ways it could be a better alternative to Anubis.

    • RandomTester ( RandomTester@lemmybefree.net ) 
      link
      fedilink
      arrow-up
      3
      ·
      1 year ago

      it wasn’t made for bitcoin originally? didn’t know that!

      • 0xebfe ( 0xebfe@lemmy.today ) 
        link
        fedilink
        arrow-up
        8
        ·
        1 year ago

        Originally called hashcash: http://hashcash.org/

        • RandomTester ( RandomTester@lemmybefree.net ) 
          link
          fedilink
          arrow-up
          8
          ·
          1 year ago

          you know it’s old when it doesn’t have ssl

        • daw ( daw@feddit.org ) 
          link
          fedilink
          arrow-up
          2
          ·
          1 year ago

          TIL

Open Source@lemmy.ml

opensource@lemmy.ml

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !opensource@lemmy.ml

All about open source! Feel free to ask questions, and share news, and interesting stuff!

Useful Links

  • Open Source Initiative
  • Free Software Foundation
  • Electronic Frontier Foundation
  • Software Freedom Conservancy
  • It’s FOSS
  • Android FOSS Apps Megathread

Rules

  • Posts must be relevant to the open source ideology
  • No NSFW content
  • No hate speech, bigotry, etc

Related Communities

  • !libre_culture@lemmy.ml
  • !libre_software@lemmy.ml
  • !libre_hardware@lemmy.ml
  • !linux@lemmy.ml
  • !technology@lemmy.ml

Community icon from opensource.org, but we are not affiliated with them.

Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 153 users / day
  • 379 users / week
  • 1.91K users / month
  • 4.44K users / 6 months
  • 867 local subscribers
  • 49.3K subscribers
  • 2.99K Posts
  • 23.1K Comments
  • Modlog
  • mods:
  • Evan ( Cloak@lemmy.ml ) 
  • kevincox ( kevincox@lemmy.ml ) 
  • CrypticCoffee ( CrypticCoffee@lemmy.ml ) 
  • Lettuce eat lettuce ( Lettuceeatlettuce@lemmy.ml ) 
  • BE: 0.19.15
  • Modlog
  • Legal
  • Instances
  • Docs
  • Code