Web Scraping Feature

[Mohamed_Ahmed_Kansoh]

I am wondering if "Web Scraping" Feature still available to configure or not. 
- I know it was available under ( Security >>> Application security >>> Anomaly Detection >>> web scraping). 
I am taking about Releases versions V14 and V15 as well. 

Thanks

[Daniel_Wolf]

Hi @Mohamed_Ahmed_Kansoh,

in 14.1 web scraping detection has moved to the Bot Defense feature. Take a look here: K42323285: Overview of the unified Bot Defense profile.

KR
Daniel  

[Mohamed_Ahmed_Kansoh]

Hi @Daniel_Wolf , 

Thanks for your fast response , but I think it is not configured such as old version any more , I mean that all of below intevals do not exist in V14.1 : 
and it has been reduced in V14.1 with Bot Defense with simple configuration through " Microservice " Feature when creating a Bot Profile. 

[Daniel_Wolf · Accepted solution]

True, the available configuration options have changed. And what was Web Scraping till 14.0 is now Bot Defense, where Web Scraping exists as a sub-feature called Web Scraping to prevent any attempts to collect application content.

It is also stated in K42323285: "The Bot Defense profile replaces and includes  the original functionality of the DoS profile bot signatures and proactive bot defense, as well as Web Scraping."

[Mohamed_Ahmed_Kansoh]

Thanks alot @Daniel_Wolf 

[Nikoolayy1]

Yup as now for example " Anomalies category" in the Bot profile now includes stuff like "Session Opening" but I wish they kept the latency options atleast as system variables Latency increased/Latency reached/Minimum Latency Threshold for detection for the stress based DDOS detection as now also after 13.1 it is automatic and in some environments I see the use cases but oh well 😔