Forum Discussion
Dave_Burnett_20
Nimbostratus
Nov 10, 2008How to allow Search Engine Robots/Slurps through ASM?
We have recently installed a pair of F56400s (v9.4.3) in front of our website with ASM in blocking mode.
We are seeing and blocking loads of Non-RFC compliant request violations. Exami...
Ido_Breger_3805
Jan 28, 2009Historic F5 Account
I think that the Yahoo robots can be identified by their IP address or range of IPs, (they probably share that info with the webmasters community for business related reporting ) you could route with iRule traffic which is "sourced" from these IPs to a different class which has these checks (or all checks) turned off.
I would want to believe that the chance that attack will be coming from Yahoo servers is very low.
Help guide the future of your DevCentral Community!
What tools do you use to collaborate? (1min - anonymous)Recent Discussions
Related Content
DevCentral Quicklinks
* Getting Started on DevCentral
* Community Guidelines
* Community Terms of Use / EULA
* Community Ranking Explained
* Community Resources
* Contact the DevCentral Team
* Update MFA on account.f5.com
Discover DevCentral Connects