Forum Discussion
11.4.0 : best storage for large data-sets
f5 BIG-IP LTM VE v11.4.0 on ESXi
I have multiple data-sets of 1M+ records that my iRule need to match against.
I've heard that v11 has improved technology around storing & accessing large datasets.
What is the best storage mechanism such large data-sets ? Data Group External File ? iFile ? Table ? Something else ?
These data-sets need to be updated on a nightly schedule, so also need an update process.
3 Replies
- JRahm
Admin
External data group should be fine, but an external service called from a sideband connection is an alternative. Since updates are a concern, the external service might be preferable.
The only issue with going the sideband connection route would be that you would have to write the service that the sideband connection calls. The most easy probably is to implement it as a HTTP request as there are already samples floating around to show how to issue a HTTP GET from a sideband call. You'll just have to have an app server routable that contains the service for the lookup. That will probably be the best performing but, as Jason said, an external data group with the "class" command should work for you as well.
- JRahm
for high performance requirements, you can make a sideband connection to a second vip on the box that then has the external service defined as a pool of servers and enables oneconnect to them.
