•  dan   ( @dan@lemm.ee ) 
        link
        fedilink
        English
        4
        edit-2
        2 years ago

        The problem with scraping is that while it’s difficult/impossible to block completely, it’s pretty easy to keep making changes to your site to disrupt scrapers. The work required by the scraper to adapt to those changes is usually way more than the work you put in to disrupt them.

        So if a commercial site wants to make scraping unreliable and impractical, they almost certainly can.