Sites scramble to block ChatGPT web crawler after instructions emergearstechnica.comexternal-linkcross-posted to: tech@kbin.social UngodlyAudrey🏳️⚧️ ( @UngodlyAudrey@beehaw.org ) Technology • 1 year ago message-square32arrow-up1179
arrow-up1179external-linkSites scramble to block ChatGPT web crawler after instructions emergearstechnica.com UngodlyAudrey🏳️⚧️ ( @UngodlyAudrey@beehaw.org ) Technology • 1 year ago message-square32cross-posted to: tech@kbin.social
minus-square m-p{3} ( @mp3@lemmy.ca ) linkfedilinkEnglish26•1 year agoLemmy.ca added a block at the nginx level for it https://lemmy.ca/comment/1999439 # curl -H 'User-agent: GPTBot' https://lemmy.ca/ -i HTTP/2 403
minus-square The Bard in Green ( @thebardingreen@lemmy.starlightkel.xyz ) linkfedilinkEnglish3•1 year agoHilariously, unless ALL lemmy instances do this, anyone that federates with you will have to block it too or any communities they sync with you will be available on their instances…
minus-square m-p{3} ( @mp3@lemmy.ca ) linkfedilink5•1 year agoI know but at this point you do what you can.
Lemmy.ca added a block at the nginx level for it
https://lemmy.ca/comment/1999439
Hilariously, unless ALL lemmy instances do this, anyone that federates with you will have to block it too or any communities they sync with you will be available on their instances…
I know but at this point you do what you can.