prevention of web scraping - plausible?

Hi,

 

 

I would like to point the difference between two kinds of scraping –

 

- Scraping with a malicious intent – such as scanners or scripts intended to detect or attack various part of the site

 

- Scraping by innocent users – such as scripts intended for consolidating and enhancing capabilities of applications (such as scripts that consolidate information from different bank accounts or that monitor sites for specific information.)

 

 

Both kinds have common traffic characteristics with regards to the frequency of the requests per a given source (provided the source can be distinguished).

 

The iRules language is strong enough to be used for implementing such logic with options such as utilizing cookies for source distinguishing and counters of requests per a given time.

 

With regards to protecting applications against the malicious side of this issue, I would recommend using the F5 application security solution.