Forum Discussion

CBaum99_160945's avatar
CBaum99_160945
Icon for Nimbostratus rankNimbostratus
Jun 29, 2015

ASM - WebScraping / Bot Detection

Hi,

 

I want to add sogou-spider (important for my business) to the friendly search engine list via Security > Options > Application Security > Advanced Configuration > Search Engines

 

Search Engine - Sogou Web Spider Bot Name - Sogou web spider Domain Name - .sogou.com

 

But it seems that is has no effect. In the WebScraping logs I still see a blocked User Agent "Sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm07)"

 

Anybody know which has to be filled in to the F5 Gui that it will work?

 

Regards, CBaum

 

  • Go to System > Configuration > Device > DNS and ensure that a DNS server is configured on BIG-IP.