For more information regarding the security incident at F5, the actions we are taking to address it, and our ongoing efforts to protect our customers, click here.

Forum Discussion

Stewart's avatar
Stewart
Icon for Altostratus rankAltostratus
Mar 04, 2015

ASM to block indexing of sites.

Hi,   I need to set up ASM to block any indexing of my web site. I think that I can do this by enabling Anomaly Detection for Web Scraping. If this is done it will stop most but will still allo...
ASM Advanced WAF
security
Stefan_Klotz's avatar
Stefan_Klotz
Icon for Cumulonimbus rankCumulonimbus
Jun 06, 2016

Hi Hannes,

 

thank you for the quick response. But will the 200 OK blocking page from ASM result in the "correct" behavior for the search engines, because this will not be a timeout. Or should I not directly handle this outside ASM and just create a small iRule to drop any request towards /robots.txt?

 

Ciao Stefan :)