Retrieving Configuration Utility's stats data instead of polling

Question

Hello F5 users,
&nbsp;I'd like to examine (raw) data used by Configuration Utility's stats that it displays (in Performance tab). I'd appreciate if someone can give the path for these files (- I'm hoping they're in ASCII).
&nbsp;The intention is to reuse data instead of polling LTM's SNMP Agent.
&nbsp;Regards,
&nbsp;Alex&nbsp;&nbsp;

hoolio · Answer

Hi Alex, 
&nbsp;  
&nbsp; The performance graph data is stored in rrd data files under /var/rrd/.  You can export them to another host and use rrdtool to process them: 
&nbsp;  
&nbsp; http://oss.oetiker.ch/rrdtool/ 
&nbsp;  
&nbsp; Aaron

epaalx · Answer

Thank you.&nbsp;

epaalx · Answer

For those who are interested...
RRD database files are /var/rrd/. One such file is "connections":[admin@foo-dc-6900-1:Active] rrd  cat /var/rrd/connections.info
 DO NOT DELETE OR MODIFY this autogenerated file.
 This file contains the contents of the RRDFILE section of the statsd.conf file used to generate the rrdfile: '/var/rrd/connections'
 To restore the /config/statsd.conf contents to match this rrdfile, replace the existing rrdfile entry for /var/rrd/connections with the contents of this file
RRDFILE "/var/rrd/connections" {
    DATASOURCE "sslcurclientconns"    { EXPR "sslcurclientconns" DSTYPE GAUGE  MIN 0 MAX UNKNOWN }
    DATASOURCE "sslcurserverconns"    { EXPR "sslcurserverconns" DSTYPE GAUGE  MIN 0 MAX UNKNOWN }
    DATASOURCE "ssltotnatclient"    { EXPR "ssltotnatclient"   DSTYPE DERIVE MIN 0 MAX UNKNOWN }
    DATASOURCE "ssltotcomclient"    { EXPR "ssltotcomclient"   DSTYPE DERIVE MIN 0 MAX UNKNOWN }
    DATASOURCE "ssltotnatserver"    { EXPR "ssltotnatserver"   DSTYPE DERIVE MIN 0 MAX UNKNOWN }
    DATASOURCE "ssltotcomserver"    { EXPR "ssltotcomserver"   DSTYPE DERIVE MIN 0 MAX UNKNOWN }
    DATASOURCE "curclientconns"    { EXPR "curclientconns"    DSTYPE GAUGE  MIN 0 MAX UNKNOWN }
    DATASOURCE "curserverconns"     { EXPR "curserverconns"    DSTYPE GAUGE  MIN 0 MAX UNKNOWN }
    DATASOURCE "totclientconns"     { EXPR "totclientconns"    DSTYPE DERIVE MIN 0 MAX UNKNOWN }
    DATASOURCE "totserverconns"     { EXPR "totserverconns"    DSTYPE DERIVE MIN 0 MAX UNKNOWN }
    DATASOURCE "pvacurclientconns"    { EXPR "pvacurclientconns" DSTYPE GAUGE  MIN 0 MAX UNKNOWN }
    DATASOURCE "pvacurserverconns"    { EXPR "pvacurserverconns" DSTYPE GAUGE  MIN 0 MAX UNKNOWN }
    DATASOURCE "pvatotclientconns"    { EXPR "pvatotclientconns" DSTYPE DERIVE MIN 0 MAX UNKNOWN }
    DATASOURCE "pvatotserverconns"    { EXPR "pvatotserverconns" DSTYPE DERIVE MIN 0 MAX UNKNOWN }
    DATASOURCE "globalaccepts"     { EXPR "globalaccepts"     DSTYPE DERIVE MIN 0 MAX UNKNOWN }
    DATASOURCE "globalconnects"     { EXPR "globalconnects"    DSTYPE DERIVE MIN 0 MAX UNKNOWN }
    DATASOURCE "httprequests"     { EXPR "http_requests"     DSTYPE DERIVE MIN 0 MAX UNKNOWN }
    RRA { CF AVERAGE XFF 0.500000 STEPS 1 ROWS 1080 }     non-averaged, keep data for duration of (1080 samples ´300s=) 90hours
    RRA { CF AVERAGE XFF 0.500000 STEPS 3 ROWS 2880 }     averaged over 3 raw sample reads; keep data for duration (3´2880 samples ´300s=) 30 days
    RRA { CF AVERAGE XFF 0.500000 STEPS 6 ROWS 10080 }     averaged over 6 raw sample reads; keep data for duration (6´10080 samples ´300s=) 210 days
    RRA { CF AVERAGE XFF 0.500000 STEPS 60 ROWS 4320 }     averaged over 60 raw sample reads; keep data for duration (60´4320 samples ´300s=) 900 days
}
CRC 4177393880
for clarity, the re-formatting and commenting is my own - alas, I can't get this post to display it properly.
Those not familiar with RRDTool should realise that 
1. the data that is kept in database is post-processed ("CDPs"), not raw (sampled) data; 
2. this data is stored to display a certain view which is defined during original database creation and not alterable
- those RRAs definitions defined both- what's stored and retrievable.
A few ways to examine RRDs:Show timestamps of first and last updates&nbsp;[admin@m5F5:Active] rrd  rrdtool first connections | gawk '{print($0strftime(" - %a %b %d %H:%M:%S %Z %Y",$0))}'
1313559530 - Wed Aug 17 15:38:50 EST 2011
[admin@m5F5:Active] rrd  rrdtool last connections  | gawk '{print($0strftime(" - %a %b %d %H:%M:%S %Z %Y",$0))}' 
1313570325 - Wed Aug 17 18:38:45 EST 2011Show most recent update of an RRD[admin@m5F5:Active] rrd  rrdtool lastupdate connections
        sslcurclientconns    sslcurserverconns    ssltotnatclient    ssltotcomclient    ssltotnatserver    ssltotcomserver    curclientconns    curserverconns    totclientconns    totserverconns    pvacurclientconns    pvacurserverconns    pvatotclientconns    pvatotserverconns    globalaccepts    globalconnects    httprequests
1313570325:    0            0            0        0        0        0        66        66        18973315    18253872     0            0            0            0            1532570        1532129        1532286

&nbsp;
&nbsp;Graph statistics over last 3600s (1 hours) into connections.png[admin@m5F5:Active] rrd  rrdtool graph /tmp/connections.png --start -3600 DEF:outconns=connections:totclientconns:AVERAGE LINE1:outconns0000FF:"totclientconns"
481x168

hamish · Answer

A slightly cleaner (Easier? IMO anyway :) way may be to use iControl to get the stats...  
&nbsp;  
&nbsp; System::Statistics::get_performance_table_statistics 
&nbsp; System::Statistics::get_performance_table_list 
&nbsp; System::Statistics::get_performance_graph_list 
&nbsp; System::Statistics::get_performance_graph_csv_statistics 
&nbsp;  
&nbsp; H

randy_black_758 · Answer

is there a way via statsd.conf to sent the data via UDP to another host, say a carbon server?

Forum Discussion

Retrieving Configuration Utility's stats data instead of polling

6 Replies

Recent Discussions

ASM attack signatures not syncing between active and standby F5

Hardware BIG-IP appliance reach EOSS, but the software version running on it not yet?

VPN Communication Error with F5 BIG-IP Edge Client

simultaneous disabling / enabling of all LTM objects

Query on source IP preservation for syslog traffic through F5 virtual server

Related Content

configuration utility restarting (upgrade)

Solution for delayed BIG-IP page load of the Configuration utility

BIG-IP Configuration utility vulnerability CVE-2023-38138

Managing iRules configuration

F5 utilization