Forum Discussion
mtobkes_64700
Nimbostratus
NimbostratusRate-Limiting Crawlers
Hi I found this iRule here that will limit requests to 1 request per n seconds. I would like to know how I'd be able to allow n requests per 1 second, e.g. allow 5 requests per 1 second.
wh...
mtobkes_64700Nimbostratus
NimbostratusThanks Aaron. I changed the line however I now get this TCL error in my logs:
TCL error: googlebot_rate-limit_vb5 HTTP_REQUEST - invalid command name 1273758282 while executing $::active_crawlers$user_agent $curr_time