blocking bad bots

Let us talk about scripts, HTML, Perl, PHP, apache, etc.
User avatar
Stevyn
SysOp
Posts:1773
Joined:Mon Nov 09, 2009 10:03 am
Location:Japan
Contact:
blocking bad bots

Post by Stevyn » Fri Feb 22, 2019 12:14 pm

1. check webserver logs to see what bots are scanning your site.
2. run

Code: Select all

netstat -t
to see who is on now.
3. check https://botcrawl.com to learn about the bot.

block AhrefsBot

block with webserver or use ubuntu firewall:

Code: Select all

sudo ufw insert 1 deny from 195.154.127.0/24 comment 'Block ahrefs bot'
AhrefsBot:
173.199.64.0/18
54.36.148.0/24
54.36.149.0/24
54.36.150.0/24
195.154.122.0/24
195.154.123.0/24
195.154.126.0/24
195.154.127.0/24

reload :

Code: Select all

sudo ufw reload
Contact me directly: Ironfeatherbooks (@) gmail.com

Image

Post Reply