Forum Discussion
b_136889
Nimbostratus
NimbostratusBigiq throwing Re-starting restjavad error.
I am running a bigiq VE on kvm. I was able to run it successfully for like 2 days along with web GUI access and I was even able to license it. After restarting the host machine once I am getting this following error.
Mar 12 15:07:51 bigiq1 emerg logger: Re-starting restjavadand I am not able to access the web GUI.
23 Replies
nitass_89166Noctilucent
are httpd and tomcat up?
root@(ve11c)(cfg-sync In Sync)(Active)(/Common)(tmos) show sys service httpd tomcat httpd (pid 5446) is running... tomcat run (pid 10275) 21 days, 1 startdo you see packet coming to bigip (e.g. tcpdump)?
tcpdump -nni eth0 -s0 port 443
b_136889looks like its down. This is the output I am getting root@(bigiq1)(Active)(/Common)(tmos) show sys service httpd tomcat httpd down, normally up Couldn't find service: tomcat if I try to stop it. stop sys service httpd Stopping httpd: [FAILED] if I try to start the httpd; start sys service httpd Starting httpd: (98)Address already in use: make_sock: could not bind to address 127.0.0.1:80 no listening sockets available, shutting down Unable to open logs [FAILED]- b_136889netstat o/p [root@bigiq1:Active] config netstat -a | grep 80 udp 0 0 fe33::5033:ff:fe33:333b:ntp *:* udp 0 0 fe33::233:73ff:fe3:ntp *:* udp 0 0 f330::5044:ff:fe44:5044:ntp *:* unix 2 [ ACC ] STREAM LISTENING 800574 /var/agentx/master unix 2 [ ] DGRAM 807969 unix 3 [ ] STREAM CONNECTED 805920 unix 3 [ ] STREAM CONNECTED 805918 unix 3 [ ] STREAM CONNECTED 805901 unix 2 [ ] DGRAM 805863 unix 3 [ ] STREAM CONNECTED 805862 unix 3 [ ] STREAM CONNECTED 805861 unix 3 [ ] STREAM CONNECTED 805860 unix 3 [ ] STREAM CONNECTED 805227 unix 3 [ ] STREAM CONNECTED 805226 unix 2 [ ] DGRAM 804652 unix 2 [ ] DGRAM 804603 unix 3 [ ] STREAM CONNECTED 804576 unix 3 [ ] STREAM CONNECTED 804432 unix 3 [ ] STREAM CONNECTED 802389 unix 3 [ ] STREAM CONNECTED 803522 /var/run/mcp unix 3 [ ] STREAM CONNECTED 802368 unix 3 [ ] STREAM CONNECTED 801036 /var/run/mcp unix 3 [ ] STREAM CONNECTED 801018 unix 2 [ ] DGRAM 800571 unix 3 [ ] STREAM CONNECTED 800510 /var/run/mcp unix 3 [ ] STREAM CONNECTED 800506 unix 3 [ ] STREAM CONNECTED 800498 /var/run/mcp unix 3 [ ] STREAM CONNECTED 800497 /var/run/mcp unix 3 [ ] STREAM CONNECTED 800496 /var/run/mcp unix 3 [ ] STREAM CONNECTED 800495 /var/run/mcp
- b_136889[root@bigiq1:Active] config lsof -i :80 COMMAND PID USER FD TYPE DEVICE SIZE NODE NAME webd 12509 root 6u IPv4 1249111 TCP *:http (LISTEN) webd 12529 apache 6u IPv4 1249111 TCP *:http (LISTEN)
- nitass
Employee
are httpd and tomcat up?
root@(ve11c)(cfg-sync In Sync)(Active)(/Common)(tmos) show sys service httpd tomcat httpd (pid 5446) is running... tomcat run (pid 10275) 21 days, 1 startdo you see packet coming to bigip (e.g. tcpdump)?
tcpdump -nni eth0 -s0 port 443- b_136889looks like its down. This is the output I am getting root@(bigiq1)(Active)(/Common)(tmos) show sys service httpd tomcat httpd down, normally up Couldn't find service: tomcat if I try to stop it. stop sys service httpd Stopping httpd: [FAILED] if I try to start the httpd; start sys service httpd Starting httpd: (98)Address already in use: make_sock: could not bind to address 127.0.0.1:80 no listening sockets available, shutting down Unable to open logs [FAILED]
- b_136889netstat o/p [root@bigiq1:Active] config netstat -a | grep 80 udp 0 0 fe33::5033:ff:fe33:333b:ntp *:* udp 0 0 fe33::233:73ff:fe3:ntp *:* udp 0 0 f330::5044:ff:fe44:5044:ntp *:* unix 2 [ ACC ] STREAM LISTENING 800574 /var/agentx/master unix 2 [ ] DGRAM 807969 unix 3 [ ] STREAM CONNECTED 805920 unix 3 [ ] STREAM CONNECTED 805918 unix 3 [ ] STREAM CONNECTED 805901 unix 2 [ ] DGRAM 805863 unix 3 [ ] STREAM CONNECTED 805862 unix 3 [ ] STREAM CONNECTED 805861 unix 3 [ ] STREAM CONNECTED 805860 unix 3 [ ] STREAM CONNECTED 805227 unix 3 [ ] STREAM CONNECTED 805226 unix 2 [ ] DGRAM 804652 unix 2 [ ] DGRAM 804603 unix 3 [ ] STREAM CONNECTED 804576 unix 3 [ ] STREAM CONNECTED 804432 unix 3 [ ] STREAM CONNECTED 802389 unix 3 [ ] STREAM CONNECTED 803522 /var/run/mcp unix 3 [ ] STREAM CONNECTED 802368 unix 3 [ ] STREAM CONNECTED 801036 /var/run/mcp unix 3 [ ] STREAM CONNECTED 801018 unix 2 [ ] DGRAM 800571 unix 3 [ ] STREAM CONNECTED 800510 /var/run/mcp unix 3 [ ] STREAM CONNECTED 800506 unix 3 [ ] STREAM CONNECTED 800498 /var/run/mcp unix 3 [ ] STREAM CONNECTED 800497 /var/run/mcp unix 3 [ ] STREAM CONNECTED 800496 /var/run/mcp unix 3 [ ] STREAM CONNECTED 800495 /var/run/mcp
- b_136889[root@bigiq1:Active] config lsof -i :80 COMMAND PID USER FD TYPE DEVICE SIZE NODE NAME webd 12509 root 6u IPv4 1249111 TCP *:http (LISTEN) webd 12529 apache 6u IPv4 1249111 TCP *:http (LISTEN)
- nitass
oops sorry, i just notice it is bigiq. httpd down and no tomcat is expected.
[root@biq2:Active] config tmsh show sys service httpd tomcat httpd down, normally up Couldn't find service: tomcatare you seeing packet coming?
- b_136889Yes I am able to ssh to it and am able to ping to google.
- nitassis there any error on webd log?
- b_136889I see the following in /var/log/webd_errors.log 2015-03-12T18:53:19-07:00 bigiq1 notice boot_marker : ---===[ HD1.1 - BIG-IQ 4.5.0 Build 0.0.7028 ]===--- and I dont see any messages in /var/log/webd/errors.log /var/log/webd/access.log
- nitass_89166
oops sorry, i just notice it is bigiq. httpd down and no tomcat is expected.
[root@biq2:Active] config tmsh show sys service httpd tomcat httpd down, normally up Couldn't find service: tomcatare you seeing packet coming?
- b_136889Yes I am able to ssh to it and am able to ping to google.
- nitass_89166is there any error on webd log?
- b_136889I see the following in /var/log/webd_errors.log 2015-03-12T18:53:19-07:00 bigiq1 notice boot_marker : ---===[ HD1.1 - BIG-IQ 4.5.0 Build 0.0.7028 ]===--- and I dont see any messages in /var/log/webd/errors.log /var/log/webd/access.log
Mike_99062I used the solution from K15886: "Restoring the BIG-IQ system to factory default settings" which worked for similar issue. I have also seen this problem when the BIG-IQ VE is not provisioned with the required 16G of RAM.
