kiolM to Linux Prepper podcastEnglish · 4 months agoWhat steps can be taken to prevent AI training and scraping of my public facing website?message-squaremessage-square2linkfedilinkarrow-up18arrow-down10file-text
arrow-up18arrow-down1message-squareWhat steps can be taken to prevent AI training and scraping of my public facing website?kiolM to Linux Prepper podcastEnglish · 4 months agomessage-square2linkfedilinkfile-text
I realize my options are limited, but what about any robots.txt style steps? Thanks for any suggestions.
minus-squareShellMonkey@piefed.socdojo.comlinkfedilinkEnglisharrow-up5·4 months agoA robots txt with a bunch of scraper user agents is a start, but there’s no guarantee they honor it. A firewall with some dynamic lists of known scanners and scrapers is a bit more forceful method.
A robots txt with a bunch of scraper user agents is a start, but there’s no guarantee they honor it. A firewall with some dynamic lists of known scanners and scrapers is a bit more forceful method.