bigip comes back active immediately after manual failover

I have the situation where after failing over active device to standby, standby device becomes active and immediately goes back to standby which means that the previously active device reverted back ...