Cynicus Rex@lemmy.ml to Privacy@lemmy.mlEnglish · 4 months agoHow to block AI Crawler Bots using robots.txt filewww.cyberciti.bizexternal-linkmessage-square64fedilinkarrow-up1110arrow-down133
arrow-up177arrow-down1external-linkHow to block AI Crawler Bots using robots.txt filewww.cyberciti.bizCynicus Rex@lemmy.ml to Privacy@lemmy.mlEnglish · 4 months agomessage-square64fedilink
minus-squarespookedintownsville@lemmy.worldlinkfedilinkEnglisharrow-up2·4 months agoCan this be done without fail2ban?
minus-squareMangoPenguin@lemmy.blahaj.zonelinkfedilinkEnglisharrow-up1·4 months agoShould be able to do it with Crowdsec
minus-squarespookedintownsville@lemmy.worldlinkfedilinkEnglisharrow-up2·4 months agoHow did you do it? Looking to do this on my own site.
minus-squareɐɥO@lemmy.ohaa.xyzlinkfedilinkEnglisharrow-up3·4 months agoMy websites Backend is written in flask so it was pretty easy to add
Can this be done without fail2ban?
Should be able to do it with Crowdsec
probably. never used it tho
How did you do it? Looking to do this on my own site.
My websites Backend is written in flask so it was pretty easy to add