Mem Leak with add_string_pool from utils.c?

[SomeJ]

Version 1.4.22-r5 (current install) and seen in 1.4.21.1

We have been experiencing a steady increase in memory usage from asterisk over time; “memory show summary” shows that utils.c is using almost all of the memory.

And “memory show allocation” shows most of that is used by add_string_pool.

We have 195 sip peers, all using G711U with no transcending. We have no problems with CPU, just with mem.

195 sip peers [Monitored: 182 online, 13 offline Unmonitored: 0 online, 0 offline]

After about 2500 calls and 21 hours since the last restart of the process here is what we see…

memory show summary
584 bytes in 2 allocations in file ‘btree/bt_open.c’
516 bytes in 1 allocations in file ‘enum.c’
20 bytes in 1 allocations in file ‘btree/bt_utils.c’
168 bytes in 5 allocations in file ‘devicestate.c’
25648 bytes in 2 allocations in file ‘app_followme.c’
848 bytes in 4 allocations in file ‘logger.c’
12316 bytes in 1 allocations in file ‘stdtime/localtime.c’
1296 bytes in 6 allocations in file ‘file.c’
21684 bytes in 6 allocations in file ‘mpool/mpool.c’
48 bytes in 4 allocations in file ‘func_callerid.c’
1122 bytes in 24 allocations in file ‘app_dial.c’
10296 bytes in 8 allocations in file ‘io.c’
18088 bytes ( 1920 cache) in 16 allocations in file ‘frame.c’
126 bytes in 6 allocations in file ‘app.c’
45124 bytes in 55 allocations in file ‘/usr/src/asterisk/asterisk-1.4.22-rc5/i’
1046 bytes in 43 allocations in file ‘manager.c’
752 bytes in 2 allocations in file ‘res_crypto.c’
16496 bytes in 20 allocations in file ‘cdr.c’
169800 bytes in 30 allocations in file ‘rtp.c’
14941 bytes in 56 allocations in file ‘channel.c’
31223 bytes in 130 allocations in file ‘loader.c’
469786660 bytes in 163 allocations in file ‘utils.c’
15457 bytes in 209 allocations in file ‘config.c’
5211 bytes in 184 allocations in file ‘chanvars.c’
18464 bytes in 471 allocations in file ‘sched.c’
821760 bytes in 15 allocations in file ‘udptl.c’
5590 bytes in 196 allocations in file ‘asterisk.c’
3873 bytes in 241 allocations in file ‘cli.c’
20859 bytes in 1192 allocations in file ‘res_indications.c’
912406 bytes in 455 allocations in file ‘chan_sip.c’
78666 bytes in 1187 allocations in file ‘pbx.c’
15184 bytes in 1007 allocations in file ‘pbx_config.c’
472056272 bytes allocated (1920 in caches) in 5742 allocations

asterisk -rx “memory show allocations” | grep add_string_pool
…
…
…
516 bytes allocated in add_string_pool at line 1218 of utils.c
33554436 bytes allocated in add_string_pool at line 1218 of utils.c
132 bytes allocated in add_string_pool at line 1218 of utils.c
516 bytes allocated in add_string_pool at line 1218 of utils.c
516 bytes allocated in add_string_pool at line 1218 of utils.c
516 bytes allocated in add_string_pool at line 1218 of utils.c
32772 bytes allocated in add_string_pool at line 1218 of utils.c
67108868 bytes allocated in add_string_pool at line 1218 of utils.c
516 bytes allocated in add_string_pool at line 1218 of utils.c
516 bytes allocated in add_string_pool at line 1218 of utils.c
516 bytes allocated in add_string_pool at line 1218 of utils.c
2097156 bytes allocated in add_string_pool at line 1218 of utils.c
516 bytes allocated in add_string_pool at line 1218 of utils.c
516 bytes allocated in add_string_pool at line 1218 of utils.c
131076 bytes allocated in add_string_pool at line 1218 of utils.c
4100 bytes allocated in add_string_pool at line 1218 of utils.c
524292 bytes allocated in add_string_pool at line 1218 of utils.c
260 bytes allocated in add_string_pool at line 1218 of utils.c
132 bytes allocated in add_string_pool at line 1218 of utils.c
516 bytes allocated in add_string_pool at line 1218 of utils.c
2097156 bytes allocated in add_string_pool at line 1218 of utils.c
…
…
…
472095750 bytes allocated (2304 in caches) in 5828 allocations

Does anyone know for what reason this add_string_pool function is called? There is a perl script that runs before the Dial() function and then another perl script runs durring the h extension via DeadAGI. Maybe memory isnt being cleaned up after the scripts run? Is there anything in the dialplan that could cause this?

I am looking for any info or help possible. I really dont like the idea of running a cron job every night to restart the process.

Thanks,
J

[SomeJ]

Might anyone have any more ideas about the add_string_pool function? I have scrubbed my perl scripts and i dont see where there could be any memory leaks in them. No recursion happens, so they should not get stuck in an infinate loop or go crazy alocating memory. Mostly they just pull some info from a database and then sent it back to asterisk or they take info from asterisk and inject it into a database.

I have googled as far as i can and have not found anything helpfull yet. Every day our call count goes up and the memory useage goes up. In a matter of 24 hours asterisk is using almost 700MB of ram and almost all of that is tied up in the utils.c file.

I saw the function is changed in 1.6. Is 1.6 in a stable enough release now to try that on a production server?

Thanks,
J