Forum Discussion
Paul_Dawson_208
Nimbostratus
Nimbostratusprevention of web scraping - plausible?
Hello,
Given the flexibility of iRules, would it be possible to prevent web/screen scraping?
Perhaps defining certain criteria/behavior to look for and then applying a rate shapin...
There is actually some iRule code to help with this sort of thing already written up in a Tech Tip. You can find it here: Click here
This particular code was designed to deal with Phishing attempts in particular, but it should demonstrate the kinds of things that can be done to help deal with scraping attempts.
You could also modify it to include a requests per time check as well, if you so desired.
HTH,
Colin
