Resident Pulser@infosec.pubB to Pulse of Truth@infosec.pubEnglish · 3 days agoAI haters build tarpits to trap and trick AI scrapers that ignore robots.txtarstechnica.comexternal-linkmessage-square15fedilinkarrow-up1133arrow-down14file-textcross-posted to: technology@lemmy.world
arrow-up1129arrow-down1external-linkAI haters build tarpits to trap and trick AI scrapers that ignore robots.txtarstechnica.comResident Pulser@infosec.pubB to Pulse of Truth@infosec.pubEnglish · 3 days agomessage-square15fedilinkfile-textcross-posted to: technology@lemmy.world
minus-squaredrkt@scribe.disroot.orglinkfedilinkEnglisharrow-up1·1 day agoThey will see a long string of base64 that takes a quarter of a second longer to load then a regular page. If it’s important to you, you can make the base64 string invisible and add some HTML to make it appear as a normal 404 page.
They will see a long string of base64 that takes a quarter of a second longer to load then a regular page. If it’s important to you, you can make the base64 string invisible and add some HTML to make it appear as a normal 404 page.