BigIP 10.2.2 HF3 config sync problem

Here are the "csTest.pl -vv" on both peer :

Active :

[root@lb-ensmgt:Active] tmp  csTest.pl --v
Status of daemons:
Warning: BigDB daemon (bigdbd) is not running.
Configsync configuration:
    Failover address (Self): 192.168.168.1
    Peer IP address: 192.168.168.2
    Configsync port: 443
    Configsync username: admin
    Acceptable time difference: 600 seconds
Configsync auto detect status:
    3 - Config modified on both systems, manual intervention required
    Last change (Self): 05/27/2014 09:55:50 (1401177350)
    Peer state is: known
    Last change (Peer): 05/26/2014 16:00:45 (1401112845)
    Last configsync: 05/23/2014 11:18:53 (1400836733)
    Peer update interval: 30 (seconds)
Network connection status:
    Local system is listening on configsync port (443).
    Ping test to peer 192.168.168.2 succeeded.
    SOAP connection test to peer 192.168.168.2 succeeded.
SOAP time difference check:
    Within the acceptable range.
Product version test:
    Major and minor product versions are identical. The maintenance
    versions are different.

The configsync tests completed successfully. You can run this
diagnostic tool on the peer 192.168.168.2 for further information.

Passive :

[root@lb-opamgt:Standby] tmp  csTest.pl --v
Status of daemons:
Warning: BigDB daemon (bigdbd) is not running.
Configsync configuration:
    Failover address (Self): 192.168.168.2
    Peer IP address: 192.168.168.1
    Configsync port: 443
    Configsync username: admin
    Acceptable time difference: 600 seconds
Configsync auto detect status:
    3 - Config modified on both systems, manual intervention required
    Last change (Self): 05/26/2014 16:00:43 (1401112843)
    Peer state is: known
    Last change (Peer): 05/27/2014 09:55:51 (1401177351)
    Last configsync: 05/23/2014 11:18:52 (1400836732)
    Peer update interval: 30 (seconds)
Network connection status:
    Local system is listening on configsync port (443).
    Ping test to peer 192.168.168.1 succeeded.
    SOAP connection test to peer 192.168.168.1 succeeded.
SOAP time difference check:
    Within the acceptable range.
Product version test:
    Major and minor product versions are identical. The maintenance
    versions are different.

The configsync tests completed successfully. You can run this
diagnostic tool on the peer 192.168.168.1 for further information.

I tried manual sync, but it doesn't work too : The result of the install on the remote peer :

[root@lb-opamgt:Standby] ~  bigpipe config install /var/local/ucs/lb-ensmgt.hcuge.ch-2014-05-27.ucs
Saving active configuration...
mkdir: cannot create directory `/var/tmp/cert_temp': Read-only file system
/tmp/cs_save_pre_script: line 41: cd: /var/tmp/cert_temp: No such file or directory
/tmp/cs_save_pre_script: line 61: cd: /var/tmp/cert_temp: No such file or directory
/tmp/cs_save_pre_script: line 77: cd: /var/tmp/cert_temp: No such file or directory
mkdir: cannot create directory `/var/tmp/gtm_tmp': Read-only file system
mkdir: cannot create directory `/var/tmp/gtm_tmp': Read-only file system
/tmp/cs_save_pre_script: line 105: cd: /var/tmp/gtm_tmp/gtm: No such file or directory
/tmp/cs_save_pre_script: line 108: cd: /var/tmp/gtm_tmp/gtm: No such file or directory
mkdir: cannot create directory `/var/tmp/gtm_tmp': Read-only file system
/tmp/cs_save_pre_script: line 116: cd: /var/tmp/gtm_tmp/big3d: No such file or directory
mkdir: cannot create directory `/var/tmp/em_db_temp': Read-only file system
Error creating package
Error backing up current configuration.
mkdir: cannot create directory `/var/tmp/ucs.20890': Read-only file system
Fatal: executing: mkdir -p /var/tmp/ucs.20890
Operation aborted.
/tmp/configsync.spec: Error installing package
Config install aborted.
BIGpipe parsing error:
   01110001:3: Error running config install

have you tried to restart standby unit and then configsync again?

anyway, i think it may be good to open a support case before rebooting just in case if Support needs any data which may be gone after rebooting.

It seems to be a problem with the remote peer hardrive firmware :

[root@lb-opamgt:Standby] tmp  hdparm -I /dev/sda | grep Firmware
        Firmware Revision:  04.04V05
[root@lb-opamgt:Standby] tmp  eud_info
12.8.0.799.0

The other box has its firmware version at : 04.04v06 and is ok

The question is : Can i update the EUD on only one peer? (the box will have a différent version of EUD...)

Can i update the EUD on only one peer? (the box will have a différent version of EUD...)

eud and hard disk firmware version can be different from peer unit.

Thanks for the quick answer.

I'm opening a support case as you suggested if they need some information before restarting the box.

After a few more investigation, i found those logs in the remote peer :

local/lb-opamgt err statsd[3767]: 011b0600:3: Error 'opening '/var/rrd/connections': Read-only file system' during rrd_update for rrd file '/var/rrd/connections'

It match this issue : http://support.f5.com/kb/en-us/solutions/public/12000/700/sol12780.html

I'm still waiting for f5 support answer to plan an intervention on the remote peer.

I updated the HDD firmware this morning (The support confirmed about this issue). Now the problem is solved. The S.M.A.R.T. test passed successfully after the upgrade.

Thanks for the help,

Jérôme

Hi,

Can you pls describe the steps involved for this upgradation.

Also, How to perform the S.M.A.R.T tes.

Thanks in advance

Thanks Amit

I think the links below give the answers to all your questions :

Download the EUD : https://downloads.f5.com/esd/ecc.sv?sw=Hardware-Specific&pro=Platform&ver=3900&container=EUD-v12.12.0

Create a USB bootable Flash drive with EUD on it : https://devcentral.f5.com/wiki/AdvDesignConfig.create_eud_on_usb_from_windows.ashx?NoRedirect=1

How to use the EUD : http://support.f5.com/content/kb/en-us/products/big-ip_ltm/releasenotes/related/eud-m-12-12-0/_jcr_content/pageContent/download/file.res/eud-m-12-12-0.pdf

Let me know if you have further question