The rise and fall of robots.txt
www.theverge.com
As unscrupulous AI companies crawl for more and more data, the basic social contract of the web is falling apart.
  • gian @lemmy.grys.itEnglish
    151·
    9 months ago

    Why not blame the companies ? After all they are the ones that are doing it, not the boomer politicians.

    And in the long term they are the ones that risk to be “punished”, just imagine people getting tired of this shit and starting to block them at a firewall level…