NekuSoul-Lemmy
  • Communities
  • Create Post
  • heart
    Support Lemmy
  • search
    Search
  • Login
  • Sign Up
sabreW4K3@lazysoci.al to Technology@beehaw.orgEnglish · 1 day ago

The Open-Source Software Saving the Internet From AI Bot Scrapers

www.404media.co

external-link
message-square
21
fedilink
  • cross-posted to:
  • opensource@lemmy.ml
136
external-link

The Open-Source Software Saving the Internet From AI Bot Scrapers

www.404media.co

sabreW4K3@lazysoci.al to Technology@beehaw.orgEnglish · 1 day ago
message-square
21
fedilink
  • cross-posted to:
  • opensource@lemmy.ml
Anubis, which block AI scrapers from scraping websites to death, has been downloaded almost 200,000 times.
  • FundMECFS@lemmy.blahaj.zone
    link
    fedilink
    arrow-up
    12
    ·
    1 day ago

    This thing Anubis always flags me for some reason. I use mullvad and safari (ios) with some add and tracker blocking extensions.

    • Appoxo@lemmy.dbzer0.com
      link
      fedilink
      arrow-up
      4
      ·
      13 hours ago

      I wonder why traffic from known VPN companies are under more scrutiny than traffic from domestic households…

    • Photuris@lemmy.ml
      link
      fedilink
      arrow-up
      6
      ·
      23 hours ago

      More sites in general are blocking mullvad traffic lately (in my experience), and I’m not sure what, if anything, can be done about it.

      • FundMECFS@lemmy.blahaj.zone
        link
        fedilink
        arrow-up
        6
        ·
        23 hours ago

        I expect better from a popular FOSS tool being used by privacy aware people though.

        • Lime Buzz (fae/she)@beehaw.org
          link
          fedilink
          English
          arrow-up
          2
          ·
          22 hours ago

          Can you open an issue, or see if one is open already for this?

      • Powderhorn@beehaw.org
        link
        fedilink
        English
        arrow-up
        3
        ·
        20 hours ago

        Agreed. Luckily, they don’t seem to have the full list of Mullvad IPs, so if I really want to read something, I just try another tunnel.

    • simple@piefed.social
      link
      fedilink
      English
      arrow-up
      6
      ·
      1 day ago

      Do you have javascript or cookies disabled? That might stop you from getting past.

      • FundMECFS@lemmy.blahaj.zone
        link
        fedilink
        arrow-up
        3
        ·
        1 day ago

        nope

Technology@beehaw.org

technology@beehaw.org

Subscribe from Remote Instance

Create a post
You are not logged in. However you can subscribe from another Fediverse account, for example Lemmy or Mastodon. To do this, paste the following into the search field of your instance: !technology@beehaw.org

A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.

Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.

Subcommunities on Beehaw:

  • Free and Open Source Software
  • Programming
  • Operating Systems

This community’s icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.

Visibility: Public
globe

This community can be federated to other instances and be posted/commented in by their users.

  • 284 users / day
  • 1.03K users / week
  • 3.04K users / month
  • 7.7K users / 6 months
  • 1 local subscriber
  • 39.5K subscribers
  • 3.6K Posts
  • 61.6K Comments
  • Modlog
  • mods:
  • alyaza [they/she]@beehaw.org
  • TheRtRevKaiser@beehaw.org
  • gyrfalcon@beehaw.org
  • rs5th@beehaw.org
  • coldredlight@beehaw.org
  • Leigh@beehaw.org
  • TheRtRevKaiser@kbin.social
  • Chris Remington@beehaw.org
  • BE: 0.19.8
  • Modlog
  • Instances
  • Docs
  • Code
  • join-lemmy.org