jonasjacek / robots.txt Star 84 Code Issues Pull requests Simple robots.txt template. Keep unwanted robots out (disallow). White lists (allow) legitimate user-agents. Useful for all websites. search-engine whitelist user-agent seo crawling twitterbot robots-txt googlebot crawlers web-crawling bingbot robots-exclusion-standard blocking-bots web-robots search-engine-optimization baiduspider Updated Feb 16, 2025
herrbischoff / badbots Sponsor Star 17 Code Issues Pull requests Current CIDR-formatted list of unwanted bots caught on my systems. blacklist bots ipv6 ipv4 blocking cidr blocking-bots cidr-notation hourly Updated Sep 28, 2021
JBlond / ban_em_all Star 5 Code Issues Pull requests collection of bash scripts to fill iptables with ip adresses iptables fail2ban bash-script blocking-bots Updated Nov 12, 2025 Shell
SkyrocketStan / TwitterMassBlocker.py Star 1 Code Issues Pull requests Automatically Block Followers of the user(s). twitter-bot twitter blocker blocking-bots Updated Feb 28, 2018 Python