Forum Discussion
Bob_10976
Nimbostratus
Feb 18, 2011iRule to Block Google and other Search Engines
Hello all,
We would like to use an iRule to block google and other search engines from crawling our sites and was hopeing someone could point me in the right direction. In the past we woul...
Steve_Brown_882
Feb 18, 2011Historic F5 Account
What you have will work for a single user agent, but you might want to add a number of them. You might try something like this and add all the user agents you want to block. I found a good list of these user agents here.
http://www.user-agents.org/index.shtml?t_z
when HTTP_REQUEST {
switch -glob [string tolower [HTTP::header "User-Agent]] {
"*googlebot*" -
"*yahooseeker" -
"*etc*" { drop }
default { return}
}
Help guide the future of your DevCentral Community!
What tools do you use to collaborate? (1min - anonymous)Recent Discussions
Related Content
DevCentral Quicklinks
* Getting Started on DevCentral
* Community Guidelines
* Community Terms of Use / EULA
* Community Ranking Explained
* Community Resources
* Contact the DevCentral Team
* Update MFA on account.f5.com
Discover DevCentral Connects
