Forum Discussion
Dave_Burnett_20
Nimbostratus
NimbostratusHow to allow Search Engine Robots/Slurps through ASM?
We have recently installed a pair of F56400s (v9.4.3) in front of our website with ASM in blocking mode.
We are seeing and blocking loads of Non-RFC compliant request violations. Exami...
Dave_Burnett_20Nimbostratus
NimbostratusDo these help?
GET /spurs/savings/adult_saver/index.html HTTP/1.0
Accept: */*
User-Agent: Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)
LLF-Cache-Control:
Host: www.britannia.co.uk
This violation was generated by IP address 74.6.22.97
GET /isa/transfer_in.html HTTP/1.0
Accept: */*
User-Agent: Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)
LLF-Cache-Control:
Host: www.britannia.co.uk
If-Modified-Since: Fri, 07 Nov 2008 17:33:57 GMT
This violation was generated by IP address 67.195.37.92
GET /careers/benefits.html HTTP/1.0
Accept: */*
User-Agent: Mozilla/5.0 (compatible; Yahoo! Slurp; http://help.yahoo.com/help/us/ysearch/slurp)
LLF-Cache-Control:
Host: www.britannia.co.uk
This violation was again generated by IP address 74.6.22.97
