For more information regarding the security incident at F5, the actions we are taking to address it, and our ongoing efforts to protect our customers, click here.

Forum Discussion

Daniel_S_135288's avatar
Daniel_S_135288
Icon for Nimbostratus rankNimbostratus
13 years ago
Solved

irule to log googlebots

Hello   My goal is to log the googlebot's. I want to log the time and which page was crawled...   Can anybody help me?   Regards   Danisch  
application delivery
devops
iRules
security
  • IheartF5_45022's avatar
    IheartF5_45022
    13 years ago

    something like (not tested);

    when HTTP_REQUEST {
    set fBot 0
    if {[HTTP::header value "User-Agent"] contains "Googlebot"} {
        set fBot 1
        set ua [HTTP::header value "User-Agent"]
        set uri [HTTP::uri]
    }
}
when HTTP_RESPONSE {
    if {$fBot} {
        log local0. "[clock clicks -milliseconds],$uri,$ua,[HTTP::status]"
    }
}
IheartF5_45022's avatar
IheartF5_45022
Icon for Nacreous rankNacreous
13 years ago

something like (not tested);

when HTTP_REQUEST {
    set fBot 0
    if {[HTTP::header value "User-Agent"] contains "Googlebot"} {
        set fBot 1
        set ua [HTTP::header value "User-Agent"]
        set uri [HTTP::uri]
    }
}
when HTTP_RESPONSE {
    if {$fBot} {
        log local0. "[clock clicks -milliseconds],$uri,$ua,[HTTP::status]"
    }
}