Forum Discussion
Stewart
Altostratus
AltostratusASM to block indexing of sites.
Hi,
I need to set up ASM to block any indexing of my web site. I think that I can do this by enabling Anomaly Detection for Web Scraping. If this is done it will stop most but will still allo...
Here's an article I wrote that discusses web scraping and how to configure ASM to block against it: https://devcentral.f5.com/articles/these-are-not-the-scrapes-youre-looking-for-session-anomalies.
To my knowledge, deleting Google, Ask, Bing, etc will block indexing from these sites (although I haven't tested that specifically). That's why most people don't delete these search engines in their ASM configuration.
I hope this helps! John
