Sep 2026 - DevCentral will be set to Read-Only on Sep 14th for a platform update. Details: DevCentral is Evolving.

Forum Discussion

THE_BLUE's avatar
THE_BLUE
Icon for Cirrostratus rankCirrostratus
Jul 16, 2020

web scraping

I am receiving we scrapping block , normally after clear cache and cookies this issue solved. so is it possible to customize the response page when the issue related to web scrapping asking client...
ASM Advanced WAF
devops
irules
LTM
security
Erik_Novak's avatar
Erik_Novak
Icon for Employee rankEmployee
Jul 16, 2020

Yes, it is possible to customize the blocking response page. In v14 and later, web scraping is a microservice within the bot defense profile. You can customize the response on the general settings page of the bot defense profile. Click the Custom tab as shown here and then edit and preview the response.

  • THE_BLUE's avatar
    THE_BLUE
    Icon for Cirrostratus rankCirrostratus
    Jul 17, 2020

    thank you, but it seems this feature not available in v13