Forum Discussion
Peter_Reilly
Nimbostratus
NimbostratusDisallow Robots
Will the following iRule work for disallowing robots?
Thanks,
when HTTP_REQUEST {
if {[HTTP::path] eq "/robots.txt"}
{
HTTP::respond 200 content "
User-agent...
aneilsingh_5064Nimbostratus
NimbostratusCan you confirm the /robots.txt file is in the root of the website?
thanks
