SHAREPOINT Crawler Traffic Segragation
Hi Team,
i am working on a the share point 2013 deployment with F5 LTM.
I am facing the issue with the Segregation of Crawler Traffic on the basis of User Agent.
Current irule setup is
when HTTP_REQUEST { set uagent [string tolower [HTTP::header User-Agent]] if { $uagent contains "ms search"} { pool pool_crawler } else { pool pool-NonCrwaler } }
The Irule is not working.
when taking captures from the IIS server """""""""""""""""""""""""""""""""""""""""""""""" GET / HTTP/1.0 Cache-Control: no-cache Connection: Keep-Alive Accept: / From: no-reply@x.ab.cc If-Modified-Since: Mon, 01 Jan 1601 00:00:00 GMT User-Agent: Mozilla/4.0 (compatible; MSIE 4.01; Windows NT; MS Search 6.0 Robot) Host: XXXXXXXXXXXXXXXXXXXXXXX Authorization: NTLM TlRMTVNTUAABAAAAB4IIogAAAAAAAAAAAAAAAAAAAAAGAbEdAAAADw== """"""""""""""""""""""""""""""""""""""""""""""""""
we can see that the Useragent contains MS SEARCH.
Could you please help in the correct IRULE condition which may help is in segregating the trrafic.