{"id":1215234,"date":"2025-02-14T11:32:02","date_gmt":"2025-02-14T16:32:02","guid":{"rendered":"https:\/\/www.prime-wow.com\/?p=1215234"},"modified":"2025-02-14T11:32:02","modified_gmt":"2025-02-14T16:32:02","slug":"fighting-the-ai-scraperbot-scourge","status":"publish","type":"post","link":"https:\/\/www.prime-wow.com\/?p=1215234","title":{"rendered":"[$] Fighting the AI scraperbot scourge"},"content":{"rendered":"<div>There are many challenges involved with running a web site like LWN.  Some<br \/>\nof them, such as finding the courage to write for people who know more<br \/>\nabout the subject matter than we do, simply come with the territory we have<br \/>\nchosen.  But others show up as an unwelcome surprise; the ongoing task of<br \/>\nfending off bots determined to scrape the entire Internet to (seemingly)<br \/>\nfeed into the insatiable meat grinder of AI training is certainly one of<br \/>\nthose.  Readers have, at times, expressed curiosity about that fight and<br \/>\nhow we are handling it; read on for a description of a modern-day plague.<\/div>\n","protected":false},"excerpt":{"rendered":"<p>There are many challenges involved with running a web site like LWN. Some of them, such as finding the courage to write for people who know more about the subject matter than we do, simply come with the territory we &hellip; <a href=\"https:\/\/www.prime-wow.com\/?p=1215234\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[72,116],"tags":[],"class_list":["post-1215234","post","type-post","status-publish","format-standard","hentry","category-linux","category-lwn-net"],"_links":{"self":[{"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=\/wp\/v2\/posts\/1215234","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=1215234"}],"version-history":[{"count":0,"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=\/wp\/v2\/posts\/1215234\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=1215234"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=1215234"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.prime-wow.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=1215234"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}