Help finding CPU comsumption

Asterisk Asterisk Support
#1

Hi I’m new to the support forum and before to open a new thread, i try to continue this with a problem which seems related,I hope it is correct.
I use Asterisk 13.17.0 to manage calls and audio routing between 50-60 SIP users, the calls are placed and routed by
an application conneted wit AMI interface using Originate Message and variable setting; the application do only
one connection to asterisk and remains connected for all his life.
Each SIP user send register every 30 sec (set in sip.conf).
For 6 days everything is ok, then the CPU consumption pass from 20% to 45%, and the messages file show the follow message :

[Sep 12 00:35:41] WARNING[14126][C-00000015] taskprocessor.c: The ‘subm:manager_topic-00000006’ task processor queue reached 3000 scheduled tasks.
[Sep 12 00:35:50] WARNING[27816][C-00000024] taskprocessor.c: The ‘subm:manager_topic-00000006’ task processor queue reached 3000 scheduled tasks

again.

After 6 days asterisk becomes less responsive, i’m monitoring the beahviour.
Any suggestions would be strongly appreciated Thanks.

The show taskprocessor output after 7 day of activity is:

Connected to Asterisk 13.17.0 currently running on mercury (pid = 3859)
mercuryCLI>
mercuryCLI>
mercury*CLI> core show taskprocessors

Processor Processed In Queue Max Depth Low water High water
ast_msg_queue 0 0 0 450 500
CCSS_core 0 0 0 450 500
Sorcery 0 0 0 450 500
Sorcery-control 1 0 1 450 500
sorcery/bucket-00000000 0 0 0 450 500
sorcery/file-00000001 0 0 0 450 500
stasis-core 384557 0 2 450 500
stasis-core-control 769302 0 8 450 500
subm:ast_bridge_topic_all-cached-00000096 33 0 5 450 500
subm:ast_channel_topic_all-0000009a 388094 0 25 450 500
subm:ast_channel_topic_all-0000009d 388088 0 24 450 500
subm:ast_channel_topic_all-cached-00000097 389771 0 35 450 500
subm:ast_channel_topic_all-cached-00000098 389770 0 56 450 500
subm:ast_channel_topic_all-cached-00000099 389769 0 56 450 500
subm:ast_device_state_topic-00000002 365568 0 14 450 500
subm:ast_device_state_topic-00000004 365567 0 11 450 500
subm:ast_device_state_topic-0000009c 365548 0 4 450 500
subm:ast_parking-00000009 1 0 1 450 500
subm:ast_presence_state_topic_all-00000005 1 0 1 450 500
subm:ast_security-0000009b 728572 0 2 450 500
subm:ast_system-00000008 28119 0 31 450 500
subm:ast_system-0000000a 28118 0 6 450 500
subm:cdr_engine-00000003 389806 0 35 4500 5000
subm:endpoint_topic_all-cached-00000007 1096783 0 26 450 500
subm:manager_topic-00000006 1718271287 1 33986 2700 3000
subp:SIP/3101-0000000c 635 0 26 450 500
subp:SIP/3102-0000000d 2 0 1 450 500
subp:SIP/3103-0000000e 2 0 1 450 500
subp:SIP/3104-0000000f 43759 0 18 450 500
subp:SIP/3105-00000010 2 0 1 450 500
subp:SIP/3106-00000011 2 0 1 450 500
subp:SIP/3107-00000012 2 0 1 450 500
subp:SIP/3108-00000013 2 0 1 450 500
subp:SIP/3109-00000014 2 0 1 450 500
subp:SIP/3110-00000015 43148 0 8 450 500
subp:SIP/3111-00000016 43142 0 2 450 500
subp:SIP/3112-00000017 43136 0 3 450 500
subp:SIP/3113-00000018 43130 0 3 450 500
subp:SIP/3114-00000019 43126 0 6 450 500
subp:SIP/3115-0000001a 43120 0 3 450 500
subp:SIP/3116-0000001b 43116 0 2 450 500
subp:SIP/3117-0000001c 43110 0 2 450 500
subp:SIP/3118-0000001d 43106 0 3 450 500
subp:SIP/3119-0000001e 39288 0 2 450 500
subp:SIP/3120-0000001f 2 0 1 450 500
subp:SIP/3121-00000020 2 0 1 450 500
subp:SIP/3122-00000021 74 0 2 450 500
subp:SIP/3123-00000022 2 0 1 450 500
subp:SIP/3124-00000023 2 0 1 450 500
subp:SIP/3125-00000024 2 0 1 450 500
subp:SIP/3126-00000025 2 0 1 450 500
subp:SIP/3127-00000026 2 0 1 450 500
subp:SIP/3128-00000027 2 0 1 450 500
subp:SIP/3129-00000028 2 0 1 450 500
subp:SIP/3130-00000029 2 0 1 450 500
subp:SIP/3131-0000002a 2 0 1 450 500
subp:SIP/3132-0000002b 2 0 1 450 500
subp:SIP/3133-0000002c 2 0 1 450 500
subp:SIP/3134-0000002d 38908 0 30 450 500
subp:SIP/3135-0000002e 39266 0 23 450 500
subp:SIP/3136-0000002f 44267 0 33 450 500
subp:SIP/3137-00000030 39452 0 34 450 500
subp:SIP/3138-00000031 2 0 1 450 500
subp:SIP/3139-00000032 2 0 2 450 500
subp:SIP/3140-00000033 39218 0 3 450 500
subp:SIP/3141-00000034 2 0 2 450 500
subp:SIP/3142-00000035 2 0 2 450 500
subp:SIP/3143-00000036 2 0 1 450 500
subp:SIP/3144-00000037 2 0 2 450 500
subp:SIP/3145-00000038 2 0 2 450 500
subp:SIP/3146-00000039 2 0 2 450 500
subp:SIP/3147-0000003a 2 0 2 450 500
subp:SIP/3148-0000003b 2 0 2 450 500
subp:SIP/3149-0000003c 2 0 2 450 500
subp:SIP/3150-0000003d 2 0 2 450 500
subp:SIP/3151-0000003e 2 0 2 450 500
subp:SIP/3152-0000003f 2 0 1 450 500
subp:SIP/3153-00000040 2 0 2 450 500
subp:SIP/3154-00000041 2 0 2 450 500
subp:SIP/3155-00000042 2 0 2 450 500
subp:SIP/3156-00000043 2 0 2 450 500
subp:SIP/3157-00000044 2 0 2 450 500
subp:SIP/3158-00000045 2 0 2 450 500
subp:SIP/3159-00000046 2 0 2 450 500
subp:SIP/3160-00000047 2 0 2 450 500
subp:SIP/3161-00000048 2 0 2 450 500
subp:SIP/3162-00000049 2 0 2 450 500
subp:SIP/3163-0000004a 2 0 2 450 500
subp:SIP/3164-0000004b 2 0 2 450 500
subp:SIP/3165-0000004c 2 0 2 450 500
subp:SIP/3166-0000004d 2 0 2 450 500
subp:SIP/3167-0000004e 2 0 2 450 500
subp:SIP/3168-0000004f 2 0 2 450 500
subp:SIP/3169-00000050 2 0 2 450 500
subp:SIP/3170-00000051 2 0 2 450 500
subp:SIP/3171-00000052 2 0 2 450 500
subp:SIP/3172-00000053 2 0 2 450 500
subp:SIP/3173-00000054 2 0 2 450 500
subp:SIP/3174-00000055 2 0 2 450 500
subp:SIP/3175-00000056 2 0 2 450 500
subp:SIP/3176-00000057 2 0 2 450 500
subp:SIP/3177-00000058 2 0 2 450 500
subp:SIP/3178-00000059 2 0 2 450 500
subp:SIP/3179-0000005a 2 0 2 450 500
subp:SIP/3180-0000005b 2 0 2 450 500
subp:SIP/3181-0000005c 2 0 2 450 500
subp:SIP/3182-0000005d 2 0 2 450 500
subp:SIP/3183-0000005e 2 0 2 450 500
subp:SIP/3184-0000005f 2 0 2 450 500
subp:SIP/3185-00000060 2 0 2 450 500
subp:SIP/3186-00000061 2 0 2 450 500
subp:SIP/3187-00000062 2 0 2 450 500
subp:SIP/3188-00000063 2 0 2 450 500
subp:SIP/3189-00000064 2 0 2 450 500
subp:SIP/3190-00000065 2 0 2 450 500
subp:SIP/3191-00000066 2 0 2 450 500
subp:SIP/3192-00000067 2 0 2 450 500
subp:SIP/3193-00000068 2 0 2 450 500
subp:SIP/3194-00000069 2 0 2 450 500
subp:SIP/3195-0000006a 2 0 2 450 500
subp:SIP/3196-0000006b 2 0 2 450 500
subp:SIP/3197-0000006c 2 0 2 450 500
subp:SIP/3198-0000006d 2 0 2 450 500
subp:SIP/3199-0000006e 2 0 2 450 500
subp:SIP/3200-0000006f 2 0 2 450 500
subp:SIP/4100-00000094 2 0 2 450 500
subp:SIP/4200-00000095 370 0 2 450 500
subp:SIP/5000-00000070 2 0 2 450 500
subp:SIP/5001-00000071 58531 0 7 450 500
subp:SIP/5002-00000072 2 0 2 450 500
subp:SIP/5003-00000073 2 0 2 450 500
subp:SIP/5004-00000074 2 0 2 450 500
subp:SIP/5005-00000075 2 0 2 450 500
subp:SIP/5006-00000076 2 0 2 450 500
subp:SIP/5007-00000077 2 0 2 450 500
subp:SIP/5008-00000078 2 0 2 450 500
subp:SIP/5009-00000079 2 0 2 450 500
subp:SIP/5010-0000007a 2 0 2 450 500
subp:SIP/6000-0000007c 2 0 2 450 500
subp:SIP/6001-0000007d 2 0 2 450 500
subp:SIP/6002-0000007e 2 0 2 450 500
subp:SIP/6003-0000007f 2 0 2 450 500
subp:SIP/6004-00000080 2 0 2 450 500
subp:SIP/6005-00000081 2 0 2 450 500
subp:SIP/6006-00000082 2 0 2 450 500
subp:SIP/6007-00000083 2 0 2 450 500
subp:SIP/6008-00000084 2 0 2 450 500
subp:SIP/6009-00000085 2 0 2 450 500
subp:SIP/6010-00000086 2 0 2 450 500
subp:SIP/6011-00000087 2 0 2 450 500
subp:SIP/6012-00000088 2 0 2 450 500
subp:SIP/6013-00000089 2 0 2 450 500
subp:SIP/6014-0000008a 2 0 2 450 500
subp:SIP/6015-0000008b 2 0 2 450 500
subp:SIP/6016-0000008c 2 0 2 450 500
subp:SIP/6017-0000008d 2 0 2 450 500
subp:SIP/6018-0000008e 2 0 2 450 500
subp:SIP/6019-0000008f 2 0 2 450 500
subp:SIP/6020-00000090 2 0 2 450 500
subp:SIP/7000-0000007b 2 0 2 450 500
subp:SIP/7001-00000091 2 0 2 450 500
subp:SIP/7002-00000092 2 0 2 450 500
subp:SIP/7003-00000093 2 0 2 450 500
subp:SIP/svr-trunk0-0000000b 2 0 2 450 500

164 taskprocessors

#2

Hi no one has an idea ?

#3

Hello,

I have the same issue. I am using Asterisk version 13.8.3.
How do I increase the high water threshold of the manager (default 3000 for high water)?

Thank you,

Daniel Friedman
Trixton LTD.

#4

Hallo Daniel,
I haven’t solved the problem, i’ve changed asterisk version (to 13.17.0) .
initially everything seemed ok, no CPU growth, but after a week asterisk log start to log messages like :

Jan 11 17:31:18] WARNING[3162][C-0000044d] channel.c: Exceptionally long voice queue length queuing to Local/9202@operators-000001cb;2
[Jan 11 17:31:19] ERROR[7662][C-00000022] astobj2.c: Excessive refcount 100000 reached on ao2 object 0x7f81c4002d08
[Jan 11 17:31:19] ERROR[7662][C-00000022] astobj2.c: FRACK!, Failed assertion Excessive refcount 100000 reached on ao2 object 0x7f81c4002d08 (0)
[Jan 11 17:31:20] ERROR[8212][C-00000058] astobj2.c: Excessive refcount 100000 reached on ao2 object 0x7f81f0016188
[Jan 11 17:31:20] ERROR[8212][C-00000058] astobj2.c: FRACK!, Failed assertion Excessive refcount 100000 reached on ao2 object 0x7f81f0016188 (0)
[Jan 11 17:31:22] ERROR[7662][C-00000022] astobj2.c: Excessive refcount 100000 reached on ao2 object 0x7f81c4002d08
[Jan 11 17:31:22] ERROR[7662][C-00000022] astobj2.c: FRACK!, Failed assertion Excessive refcount 100000 reached on ao2 object 0x7f81c4002d08 (0)

and after few minutes memory start to grow and asterisk crashed ().
I dont now if this can help you, but if you are thinking to change asterisk version, dont use the 13.17