Forum Discussion
Dianna_129659
Nimbostratus
Sep 23, 2013How can I see if Google is hitting us?
We are experiencing many problems with Google hitting us really hard. Our Tomcat log indicates this, and it is almost crashing our ecommerce website. Is there a way that I can check F5 to see when we...
StephanManthey
Nacreous
Sep 23, 2013Afaik, the google bot can be identified by the user agent.
But this can be faked. And sometimes the google bot does not identify itself to make sure you are not tuning your site for google.
How to proceed?
First thing might be a log analysis of your tomcat logs to figure out, what these requests have in common. Perhaps it´s always the same source IP, same user agent, same path, whatever ...
Based on this, an iRule can be applied to limit the number of requests based on specific criterias. There are some table-based sample iRules for request rate limitation on DC.
Just dropping all google requests may have some negative business impact ...
Help guide the future of your DevCentral Community!
What tools do you use to collaborate? (1min - anonymous)Recent Discussions
Related Content
DevCentral Quicklinks
* Getting Started on DevCentral
* Community Guidelines
* Community Terms of Use / EULA
* Community Ranking Explained
* Community Resources
* Contact the DevCentral Team
* Update MFA on account.f5.com
Discover DevCentral Connects