Forum Discussion
JB_41040
Nimbostratus
NimbostratusWebAccelerator causes problem for crawlers?
Has anyone else encountered this problem? we launched the BigIP WAM 3900 system in Mid july and have had significant drop in traffic - almost 30-40% and google webmaster tools indicates drop in google...
You ought to be able to see if those crawlers are hitting your site at all by user agent string. That's where I'd start looking first for an answer. Create a request-logging profile (for v11) or enable logging in WAM (v10) to start collecting that data.
Cheers,
-dude