Forum Discussion
Bob_10976
Nimbostratus
NimbostratusiRule to Block Google and other Search Engines
Hello all,
We would like to use an iRule to block google and other search engines from crawling our sites and was hopeing someone could point me in the right direction. In the past we woul...
What you have will work for a single user agent, but you might want to add a number of them. You might try something like this and add all the user agents you want to block. I found a good list of these user agents here.
http://www.user-agents.org/index.shtml?t_z
when HTTP_REQUEST {
switch -glob [string tolower [HTTP::header "User-Agent]] {
"*googlebot*" -
"*yahooseeker" -
"*etc*" { drop }
default { return}
}