Forum Discussion

Christoph_Fris1's avatar
Christoph_Fris1
Icon for Nimbostratus rankNimbostratus
Jul 10, 2017

How to allow Google to crawl my Site, when DOS Profile is active?

Hello all,   we activated the DDos Protection on our F5 Cluster, but after that Google is no longer able to crawl our site. Although I already set all "Google" Signatures on the "Whitelist".   Bu...
ASM Advanced WAF
ddos
security
Cirrus's avatar
Cirrus
Icon for Cirrus rankCirrus
Jul 12, 2017

So I opened a ticket for this topic and get this as solution from F5: 1) For this feature to be fully functional F5 recommend to configure a DNS resolver 2) We will recommend to configure a forward zone with "." in FQDN name 3) Also we will recommend to configure the DoS profile on "Bot Signatures", with "Report" enabled for the "Search Bot" and "Search Engine" categories. Remove the Bot Signature List since this overrides the configured actions for the bot signature categories. 4) To validate/verify if this change solves the issue, You can use the google tool to test your website https://support.google.com/webmasters/answer/6065812?hl=en

 

Now everything is working. Hope this answer will also help others with similar issues

 

Regards, Christoph