Forum Discussion

Bob_10976's avatar
Bob_10976
Icon for Nimbostratus rankNimbostratus
Feb 18, 2011

iRule to Block Google and other Search Engines

Hello all,     We would like to use an iRule to block google and other search engines from crawling our sites and was hopeing someone could point me in the right direction. In the past we woul...
application delivery
dev
devops
iRules
hooleylist's avatar
hooleylist
Icon for Cirrostratus rankCirrostratus
Feb 18, 2011
You could also add the user-agent strings to a datagroup and then use the class (v10) or matchclass (v9) commands to look up the user-agent header value against the datagroup.

 

 

Aaron