2.10 latest APache eating RAM

Ever since the last round of updates (this morning) httpd (apache) keeps using more and more ram, restarted httpd, mem usage back to normal, and growing again.
It looks like the op_server.pl has something to do with it, but fail to see what.

anybody else see this behaviour ?

I don’t know about the increasing usage since I just now checked it out.
However, the ps-output of my top 10 memory hogs looks like this:

root      3291  0.0  2.1 683904 44608 ?        Sl   13:08   0:04      \_ /usr/java/
latest/bin/java -Djava.library.path=lib -jar iSymphonyServer.jar .
asterisk  3131  0.0  1.1  44512 24532 ?        S    13:08   0:11  \_ /usr/sbin/httpd
asterisk  3129  0.0  1.1  42520 22876 ?        S    13:08   0:11  \_ /usr/sbin/httpd
asterisk  3127  0.0  1.1  43188 23584 ?        S    13:08   0:12  \_ /usr/sbin/httpd
asterisk  3126  0.0  1.1  42704 23216 ?        S    13:08   0:11  \_ /usr/sbin/httpd
asterisk  3125  0.0  1.1  42716 23068 ?        S    13:08   0:13  \_ /usr/sbin/httpd
asterisk  3124  0.0  1.1  43272 23716 ?        S    13:08   0:11  \_ /usr/sbin/httpd
asterisk  3130  0.0  1.0  41244 21984 ?        S    13:08   0:11  \_ /usr/sbin/httpd
asterisk  3128  0.0  1.0  40908 21240 ?        S    13:08   0:10  \_ /usr/sbin/httpd
mysql     2920  0.0  0.9 139588 20372 ?        Sl   13:08   0:02  \_ /usr/libexec/
mysqld --basedir=/usr --datadir=/var/lib/mysql --user=mysql --pid-file=/var/run/
mysqld/mysqld.pid --skip-external-locking --socket=/var/lib/mysql/mysql.sock

All this is on a brand new install (one extension and one trunk)!

My production server with 1.87.29.55-2 distro (a lot of extensions, trunks, IVR’s, custom contexts and other bells and whistles) uses much less RAM and Processor…

Somehow, I thing it is the iSymphony…

Is there any way of stopping iSymphony permanently? I don’t need it and it just eats resources…

DrDarko

You have very little memory being used. Apache is less that 10% of your memory based on that print out.

Yes you can stop iSymphony and yes it can use lots of memory since it is Java based.

service isymphony stop to stop the service. You can also chckconfig isymphony off so it wont start on boot

Able

Without seeing a print out of memory usage I do not know what to tell you. You provided no details on this.

Do a free -m to show us your total memory usage. Than do a ps aux to see what processes are using it. Please paste your free -m here.

Thanks for the clarification Tony.

I stopped service iSymphonyServer and memory release impacted httpd too.

Now, it looks like this:

asterisk 11742  0.1  1.0  41196 21032 ?        S    01:23   0:00  \_ /usr/sbin/httpd
asterisk 11738  0.2  1.0  41156 21024 ?        S    01:23   0:01  \_ /usr/sbin/httpd
asterisk 11740  0.0  0.8  38536 18044 ?        S    01:23   0:00  \_ /usr/sbin/httpd
asterisk 11737  0.0  0.8  38504 18072 ?        S    01:23   0:00  \_ /usr/sbin/httpd
asterisk 11741  0.0  0.5  31388 10560 ?        S    01:23   0:00  \_ /usr/sbin/httpd
asterisk 11739  0.0  0.5  31452 10856 ?        S    01:23   0:00  \_ /usr/sbin/httpd

which is quite similar to my production system (old distro)

asterisk 14073  0.0  0.5  35432 18416 ?        S    Mar02   0:44  \_ /usr/sbin/httpd
asterisk 28925  0.0  0.3  28652 11392 ?        S    Mar03   0:08  \_ /usr/sbin/httpd
asterisk 14443  0.0  0.3  28700 11420 ?        S    Mar02   0:37  \_ /usr/sbin/httpd
asterisk 14075  0.0  0.3  30292 13164 ?        S    Mar02   0:38  \_ /usr/sbin/httpd
asterisk 14074  0.0  0.3  30328 13320 ?        S    Mar02   0:40  \_ /usr/sbin/httpd
asterisk 14068  0.0  0.3  30304 13208 ?        S    Mar02   0:38  \_ /usr/sbin/httpd

I hope that stopping iSymphony will not influence FreePBX…

I do not see that httpd memory usage is increasing in time.

If httpd is eating memory, it should not have anything to do with latest FreePBX…

some more details;

some 6 to 8 hours later;


asterisk 21688 0.1 3.7 104276 84212 ? S Mar04 3:05 /usr/sbin/httpd
asterisk 21689 0.1 3.7 104808 84700 ? S Mar04 3:05 /usr/sbin/httpd
asterisk 21690 0.1 3.7 104272 84180 ? S Mar04 3:05 /usr/sbin/httpd
asterisk 21692 0.1 3.7 104824 84912 ? S Mar04 3:05 /usr/sbin/httpd
asterisk 21693 0.1 3.7 104280 84188 ? S Mar04 3:04 /usr/sbin/httpd
asterisk 21694 0.1 3.7 104776 84856 ? S Mar04 3:04 /usr/sbin/httpd
asterisk 21695 0.1 3.7 104276 84348 ? S Mar04 3:04 /usr/sbin/httpd
asterisk 21696 0.1 3.7 104212 84208 ? S Mar04 3:04 /usr/sbin/httpd

         total       used       free     shared    buffers     cached

Mem: 2202 1205 996 0 175 263
-/+ buffers/cache: 766 1436
Swap: 760 0 760

top - 19:14:39 up 4 days, 18:58, 1 user, load average: 0.33, 0.15, 0.10
Tasks: 147 total, 1 running, 146 sleeping, 0 stopped, 0 zombie
Cpu(s): 2.8%us, 0.2%sy, 0.0%ni, 96.9%id, 0.0%wa, 0.0%hi, 0.0%si, 0.0%st
Mem: 2255784k total, 1239028k used, 1016756k free, 179904k buffers
Swap: 779144k total, 16k used, 779128k free, 269964k cached

PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
21692 asterisk 18 0 103m 83m 3824 S 6.3 3.8 3:08.36 httpd
21693 asterisk 18 0 104m 84m 3644 S 5.3 3.8 3:07.59 httpd
21438 root 15 0 10040 3216 2660 S 0.3 0.1 0:00.04 sshd
22289 root 15 0 2428 1068 800 R 0.3 0.0 0:00.01 top
1 root 15 0 2160 596 516 S 0.0 0.0 0:00.87 init

No clue on that. Someone else a few weeks ago reported this and I was never able to track it down. He said it just went away after he upgraded all his modules.

I would start by removing backups since those are the few things that run on a cron that could cause memory to keep creeping.

i have this one 2 prod machines and 1 test, i can play around with the latter one a day or two, restaring apache cleans the ram so not to worried yet and it has enough to play with anyway. will start disabling some stuff (backups first)

For me, it only happens when the page “freepbx system status” is loaded. It does some background updating to keep tabs on active channels/calls/registered phones, and maybe this is related to the memory leak. If I restart httpd and navigate away from that page (to some other config page), it doesn’t leak memory anymore.

What it mainly was, there are a number of commercial license parts in the new distro and some seem to be turned on by default, result is that the schmooze software is continuously checking for a licensekey (every 1-2 seconds) and thus cretain growing logs and growing memory usage.

I turned them all of and have not noticed it since

We do not check for a licensekey every second or 2 and that would have nothing to do with the main landing page. The only reason we would keep looking for a license is if you installed commercial modules but did not have a license for that module.

iSymphony might since there are time expirations on their iSymphony product. Any chance this could be causing this issue?

I also have the same bug with eating RAM.
You can resolve this by editting file /etc/httpd/conf/httpd.conf end restart apache.

StartServers 1 MinSpareServers 1 MaxSpareServers 3 ServerLimit 16 MaxClients 16 MaxRequestsPerChild 400