High Availability Setup- Web server down after UCP Node Server Upgrade Attempt

Hi guys,

After we updated the UCP Node Server to 12.0.5 in Module admin on a brand-new 6.12.65-29 HA system, we got an error, then it brought down the httpd_server which will not restart. pcs_status says:

 httpd_service      (ocf::heartbeat:apache):        Stopped

Failed actions:
httpd_service_start_0 on freepbx-b ‘unknown error’ (1): call=709, status=complete, last-rc-change=‘Sat Aug 29 21:03:09 2015’, queued=3159ms, exec=0ms

PCSD Status:
Error: no nodes found in corosync.conf

Doing a crm_resource reset on httpd_server, then an “amportal restart” shows at the end:

sh: node_modules/forever/bin/forever: No such file or directory

npm ERR! Linux 2.6.32-431.el6.x86_64
npm ERR! argv “node” “/usr/bin/npm” "start"
npm ERR! node v0.10.29
npm ERR! npm v2.14.1
npm ERR! file sh
npm ERR! code ELIFECYCLE
npm ERR! errno ENOENT
npm ERR! syscall spawn
npm ERR! [email protected] start: node_modules/forever/bin/forever start -m 1 -a -l $ASTLOGDIR/ucp_forever.log -o $ASTLOGDIR/ucp_out.log -e $ASTLOGDIR/ucp_err.log --uid 'ucp' index.js
npm ERR! spawn ENOENT
npm ERR!
npm ERR! Failed at the [email protected] start script ‘node_modules/forever/bin/forever start -m 1 -a -l $ASTLOGDIR/ucp_forever.log -o $ASTLOGDIR/ucp_out.log -e $ASTLOGDIR/ucp_err.log --uid ‘ucp’ index.js’.
npm ERR! This is most likely a problem with the ucp-server package,
npm ERR! not with npm itself.
npm ERR! Tell the author that this fails on your system:
npm ERR! node_modules/forever/bin/forever start -m 1 -a -l $ASTLOGDIR/ucp_forever.log -o $ASTLOGDIR/ucp_out.log -e $ASTLOGDIR/ucp_err.log --uid ‘ucp’ index.js
npm ERR! You can get their info via:
npm ERR! npm owner ls ucp-server
npm ERR! There is likely additional logging output above.

npm ERR! Please include the following file with any support request:
npm ERR! /drbd/httpd/www/html/admin/modules/ucpnode/node/npm-debug.log
Starting Queue Callback Daemon
Starting prosody: Prosody is already running with PID 42171
[FAILED]
Starting XMPP Presence State daemon: Already running [FAILED]

The executable file in “/node_modules/forever/bin/forever” doesn’t exist, that’s why it’s failing.

In the /var/log/httpd/error_log file:

[Sat Aug 29 21:03:09 2015] [notice] Digest: generating secret for digest authentication …
[Sat Aug 29 21:03:09 2015] [notice] Digest: done
[Sat Aug 29 21:03:09 2015] [notice] Apache/2.2.15 (Unix) DAV/2 PHP/5.3.28 mod_ssl/2.2.15 OpenSSL/1.0.1e-fips configured – resuming normal operations
[Sat Aug 29 21:03:10 2015] [error] [client 127.0.0.1] client denied by server configuration: /var/www/html/server-status
[Sat Aug 29 21:03:10 2015] [notice] caught SIGWINCH, shutting down gracefully

Can you help?

Update:
I could not uninstall ucpnode, so I manually updated from CLI:

amportal a ma update ucpnode

This completed without error and now shows installed. Amportal restart appears clean, however, the GUI is still not running.

Resource Group: httpd
httpd_fs (ocf::heartbeat:Filesystem): Started freepbx-b
httpd_ip (ocf::heartbeat:IPaddr2): Started freepbx-b
httpd_service (ocf::heartbeat:apache): Stopped

Failed actions:
asterisk_service_monitor_30000 on freepbx-b ‘not running’ (7): call=671, status=complete, last-rc-change=‘Sat Aug 29 21:11:30 2015’, queued=0ms, exec=0ms
httpd_service_start_0 on freepbx-b ‘unknown error’ (1): call=734, status=complete, last-rc-change=‘Sat Aug 29 21:28:21 2015’, queued=3180ms, exec=0ms

PCSD Status:
Error: no nodes found in corosync.conf

Alright.
We got the GUI back up, but we still don’t know how to clear below errors:
Failed actions:
asterisk_service_monitor_30000 on freepbx-b ‘not running’ (7): call=671, status=complete, last-rc-change=‘Sat Aug 29 21:11:30 2015’, queued=0ms, exec=0ms

PCSD Status:
Error: no nodes found in corosync.conf