Forum Discussion
Geo IP + Search Engine Crawlers
- Jan 07, 2016
It all depends on the volume of traffic you have generally. Irules impose some overhead, but if you're not maxing out your device, then this should not be a problem. You should consider doing this using Local Traffic policies if you can express the logic, as those are more efficient than irules.
In any case, user-agent strings can be easily forged, so as long as you're not doing anything security-critical, then it sounds reasonable to key off this. If you're doing anything that relies on the integrity of this header, then you might want to work out a way to pair the user-agent strings with valid source IP addresses obtained via DNS, but this adds the challenge of managing the IP to user-agent mappings and keeping them up to date.
My two-pence.
Thanks for the quick reply. We have beefy Big-IPs (can't remember the models) and they run at about 10% so i think we're fine on performance, great.
Nothing related to security at all... its our main customer facing site, not transactional. Basically wanting to ensure Google doesn't list our minor country specific versions of our sites as the main result when you google us.
Cheers!
Recent Discussions
Related Content
* Getting Started on DevCentral
* Community Guidelines
* Community Terms of Use / EULA
* Community Ranking Explained
* Community Resources
* Contact the DevCentral Team
* Update MFA on account.f5.com