Updates did not start. Incron error?

Freepbx: 4.0.10.3

After a start from the Gui for those update:

RPM(s) requiring upgrades:
asterisk-version-switch.noarch 5.2-1.sng7 (current: 5.1.2.sng7)
htop.x86_64 2.2.0-3.el7 (current: 2.2.0.1.el7)
incron.x86_64 0.5.12-11.el7 (current: 0.5.10.10.sng7)
openvpn.x86_64 2.4.7-1.el7 (current: 2.4.6.1.el7)
redis.x86_64 3.2.12-2.el7 (current: 3.2.12.1.el7)

“System Update Status” always in working mode

Via SSH:
yum update
Loaded plugins: fastestmirror, versionlock
Loading mirror speeds from cached hostfile
No packages marked for update

Any help is welcome to clean up this status

After a fwconsole restart: no change

After a reboot:

System Update Status: Idle

but:
Updates did not start. Incron error?
File:/var/www/html/admin/libraries/Builtin/SystemUpdates.php:115

Via ssh:
bin/systemctl start incrond.service
Error: No space left on device

Restapps Daemon not started:
restarted via SSH:
fwconsole start restapps

yum downgrade incron to 0.5.10-10.sng7
No error anymore.

Refer https://community.freepbx.org/t/system-firewall-not-enabled-after-updates

I am having exact same issue as well. This link to firewall not enabled is not solving my issues.

Just upgrade your system manually

yum upgrade

I just updated a system this morning.

yum update
fwconsole ma upgradeall
fwconsole ma upgrade endpoint --edge
fwconsole reload
reboot

Asterisk wasn’t running on reboot. So I tried to restart

[[email protected] ~]$ sudo fwconsole restart
[sudo] password for jbusch: 
Asterisk not currently running
Running FreePBX shutdown...

Core FastAGI Server is not running
RestApps Server is not running
UCP Node Server is not running
Chat Server is not running
Zulu Server is not running

Wanrouter: No valid Sangoma Hardware found, if you have no Sangoma cards this is OK
Stopping DAHDi for Digium Cards
DAHDi Stopped

In Firewall.class.php line 281:
                                                                                                                                
  Hook file '/var/spool/asterisk/incron/firewall.stopfirewall' was not picked up by Incron after 5 seconds. Is it not running?  
                                                                                                                                

restart [-i|--immediate] [--] [<args>]...

[[email protected] ~]$ 

My experience: error with incron version 0.5.12-11.el7
Ok with version 0.5.10-10.sng7

Whith incron 0.5.12-11.el7

systemctl status incrond.service
● incrond.service - Inotify System Scheduler
Loaded: loaded (/usr/lib/systemd/system/incrond.service; enabled; vendor preset: disabled)
Active: active (running) since Tue 2019-04-23 15:39:43 CEST; 23s ago
Process: 12093 ExecStart=/usr/sbin/incrond (code=exited, status=0/SUCCESS)
Main PID: 12094 (incrond)
CGroup: /system.slice/incrond.service
└─12094 /usr/sbin/incrond

Apr 23 15:39:48 pbx.wiseavocats.be incrond[12094]: cannot create watch for system table legacy: (28) No space left on device
Apr 23 15:39:48 pbx.wiseavocats.be incrond[12094]: cannot create watch for system table legacy: (28) No space left on device
Apr 23 15:39:48 pbx.wiseavocats.be incrond[12094]: cannot create watch for system table legacy: (28) No space left on device
Apr 23 15:39:48 pbx.wiseavocats.be incrond[12094]: cannot create watch for system table legacy: (28) No space left on device
Apr 23 15:39:48 pbx.wiseavocats.be incrond[12094]: cannot create watch for system table legacy: (28) No space left on device
Apr 23 15:39:48 pbx.wiseavocats.be incrond[12094]: cannot create watch for system table legacy: (28) No space left on device
Apr 23 15:39:48 pbx.wiseavocats.be incrond[12094]: cannot create watch for system table legacy: (28) No space left on device
Apr 23 15:39:48 pbx.wiseavocats.be incrond[12094]: cannot create watch for system table legacy: (28) No space left on device
Apr 23 15:39:48 pbx.wiseavocats.be incrond[12094]: cannot create watch for system table legacy: (28) No space left on device
Apr 23 15:39:48 pbx.wiseavocats.be incrond[12094]: cannot create watch for system table legacy: (28) No space left on device

after a downgrade to incron version 0.5.10-10.sng7 (yum downgrade incron)

systemctl status incrond.service
● incrond.service - Inotify System Scheduler
Loaded: loaded (/usr/lib/systemd/system/incrond.service; enabled; vendor preset: disabled)
Active: active (running) since Tue 2019-04-23 15:40:47 CEST; 1h 1min ago
Process: 12699 ExecStart=/usr/sbin/incrond (code=exited, status=0/SUCCESS)
Main PID: 12701 (incrond)
CGroup: /system.slice/incrond.service
└─12701 /usr/sbin/incrond

Apr 23 15:40:47 pbx.wiseavocats.be incrond[12701]: loading user tables
Apr 23 15:40:47 pbx.wiseavocats.be incrond[12701]: loading table for user root
Apr 23 15:40:47 pbx.wiseavocats.be incrond[12701]: ready to process filesystem events
Apr 23 15:41:00 pbx.wiseavocats.be incrond[12701]: (system::sysadmin) CMD (/usr/bin/sysadmin_manager framework.yum-check-updates)
Apr 23 15:41:00 pbx.wiseavocats.be incrond[12701]: (system::sysadmin) CMD (/usr/bin/sysadmin_manager framework.yum-check-updates)
Apr 23 15:41:00 pbx.wiseavocats.be sysadmin-hook[12747]: sysadmin hook started - ["/usr/bin/sysadmin_manager",“framework.yum-check-updates”]
Apr 23 15:41:00 pbx.wiseavocats.be sysadmin-hook[12748]: sysadmin hook started - ["/usr/bin/sysadmin_manager",“framework.yum-check-updates”]
Apr 23 15:41:00 pbx.wiseavocats.be sysadmin-hook[12748]: File ‘/var/spool/asterisk/incron/framework.yum-check-updates’ didn’t exist. That’s unpossible (Are you runn…anually?)
Apr 23 15:41:00 pbx.wiseavocats.be sysadmin-hook[12747]: Security check passed. Running '/var/www/html/admin/modules/framework/hooks/yum-check-updates ’
Apr 23 15:41:00 pbx.wiseavocats.be sysadmin-hook[12748]: Security check passed. Running '/var/www/html/admin/modules/framework/hooks/yum-check-updates ’
Hint: Some lines were ellipsized, use -l to show in full.

New version incron.x86_64 0:0.5.12-11.el7 not allow # as comment in files placed in /etc/incron.d/
If delete all lines started with # incron will work properly.

Better answer

yum downgrade incron
fwconsole restart
[[email protected] ~]$ sudo yum downgrade incron
Loaded plugins: fastestmirror, versionlock
Loading mirror speeds from cached hostfile
Resolving Dependencies
--> Running transaction check
---> Package incron.x86_64 0:0.5.10-10.sng7 will be a downgrade
---> Package incron.x86_64 0:0.5.12-11.el7 will be erased
--> Finished Dependency Resolution

Dependencies Resolved

=======================================================================================================================================
 Package                      Arch                         Version                                Repository                      Size
=======================================================================================================================================
Downgrading:
 incron                       x86_64                       0.5.10-10.sng7                         sng-pkgs                        91 k

Transaction Summary
=======================================================================================================================================
Downgrade  1 Package

Total download size: 91 k
Is this ok [y/d/N]: y
Downloading packages:
incron-0.5.10-10.sng7.x86_64.rpm                                                                                |  91 kB  00:00:00     
Running transaction check
Running transaction test
Transaction test succeeded
Running transaction
  Installing : incron-0.5.10-10.sng7.x86_64                                                                                        1/2 
  Cleanup    : incron-0.5.12-11.el7.x86_64                                                                                         2/2 
  Verifying  : incron-0.5.10-10.sng7.x86_64                                                                                        1/2 
  Verifying  : incron-0.5.12-11.el7.x86_64                                                                                         2/2 

Removed:
  incron.x86_64 0:0.5.12-11.el7                                                                                                        

Installed:
  incron.x86_64 0:0.5.10-10.sng7                                                                                                       

Complete!
[[email protected] ~]$ sudo fwconsole restart
Asterisk not currently running
Running FreePBX shutdown...

Core FastAGI Server is not running
RestApps Server is not running
UCP Node Server is not running
Chat Server is not running
Zulu Server is not running

Wanrouter: No valid Sangoma Hardware found, if you have no Sangoma cards this is OK
Stopping DAHDi for Digium Cards
DAHDi Stopped
Running FreePBX startup...
Running Asterisk pre from Dahdiconfig module
Wanrouter: No valid Sangoma Hardware found, if you have no Sangoma cards this is OK
Starting DAHDi for Digium Cards
DAHDi Started
Running Asterisk pre from Firewall module
Running Asterisk pre from Sysadmin module
Running Sysadmin Hooks
Restarting fail2ban
fail2ban Restarted
Updating License Information for 63875063
Checking Vpn server 
Starting Asterisk...
[============================] 15 secs
Asterisk Started
Running Asterisk post from Core module
Running Asterisk post from Dahdiconfig module
Running Asterisk post from Endpoint module
Running Asterisk post from Restapps module
Starting RestApps Server...

Broadcast message from [email protected] (Tue Apr 23 10:21:38 2019):

Firewall service now starting.

[>---------------------------] < 1 sec
Started RestApps Server. PID is 23103
Running Asterisk post from Ucp module
Starting UCP Node Server...
[>---------------------------] 1 sec
Started UCP Node Server. PID is 23537
Running Asterisk post from Xmpp module
Starting Chat Server...
[>---------------------------] 1 sec
Started Chat Server. PID is 23709
Running Asterisk post from Zulu module
This product is not licensed
[[email protected] ~]$ 

The fix is here: https://bugzilla.redhat.com/show_bug.cgi?id=1666590

And we will be updating this later today

Hmm the patches for incron already exist and are available. Are you running incron-0.5.12-11?

You have no disk space

Where did you find that?

I found it empirically. If there is a # symbol at the beginning of the line in the /etc/incron.d/legacy file, then incrond does not work.

“You have no disk space” => No, plenty of disk available

Filesystem Size Used Avail Use% Mounted on
/dev/mapper/SangomaVG-root 437G 12G 425G 3% /
devtmpfs 1.7G 0 1.7G 0% /dev
tmpfs 1.7G 8.0K 1.7G 1% /dev/shm
tmpfs 1.7G 69M 1.7G 4% /run
tmpfs 1.7G 0 1.7G 0% /sys/fs/cgroup
/dev/sda2 1.9G 197M 1.6G 11% /boot
/dev/sda1 200M 12M 189M 6% /boot/efi
tmpfs 348M 0 348M 0% /run/user/0
tmpfs 348M 0 348M 0% /run/user/995

This will fix it. If someone can test that would be great

wget http://mirror1.freepbx.org/incron-0.5.10-11.sng7.x86_64.rpm
yum install incron-0.5.10-11.sng7.x86_64.rpm

In new version incron added “recursive directory watching”, maybe # in files placed in /etc/incron.d/ breaks down path to monitoing and “recursive watching” try to watch all files in disk.

Yeah I kind of came to the same conclusion. Also EPEL is using a fork of incron (as far as I can tell) as the original maintainer’s site still has listed 0.5.10.

Anyways best to try with

wget http://mirror1.freepbx.org/incron-0.5.10-11.sng7.x86_64.rpm
yum install incron-0.5.10-11.sng7.x86_64.rpm

I did the test with incron-0.5.10-11.sng7.x86_64.rpm

Working so far.

1 Like

On original maintainer’s site (http://inotify.aiken.cz/?section=common&page=news&lang=en) there is a link to new repo on github (https://github.com/ar-/incron). And many linux distros already update this package.