For more information regarding the security incident at F5, the actions we are taking to address it, and our ongoing efforts to protect our customers, click here.

Forum Discussion

sfracass_83515's avatar
sfracass_83515
Icon for Nimbostratus rankNimbostratus
Apr 11, 2008

iRule to block networks works, sometimes.....

I just want to block googlebot requests to certain virtual servers at the LTM but this rule doesn't seem to work. Oddly enough, when I change the IP values to block my own internal network subnets at ...
application delivery
dev
devops
iRules
Joe_Pruitt's avatar
Joe_Pruitt
Apr 11, 2008
Did you log the value of IP::remote_addr to verify it's correct when googlebot is trying to access it?

Wouldn't it be simpler to use a user-agent test?

when HTTP_REQUEST {
  if { [string tolower [HTTP::header "User-Agent"]] contains "googlebot" } {
    reject
  }
}

This would block googlebot from any source network and is very easy to test with the user-agent switcher in FireFox.

-Joe