The device for the warning exists in sip.conf (not sippeers), and is not plugged in. I commented it out of sip.conf before I ran the last reload.
asterisk-whconfig01*CLI> sip reload
Reloading SIP
== Parsing '/etc/asterisk/sip.conf': Found
== Using SIP CoS mark 4
[Sep 22 14:57:29] WARNING[20945]: chan_sip.c:3776 __sip_xmit: sip_xmit of 0x7f1af804e240 (len 623) to 10.13.0.79:51900 returned -2: Interrupted system call
[Sep 22 14:57:43] WARNING[20945]: chan_sip.c:3776 __sip_xmit: sip_xmit of 0x7f1af804e240 (len 623) to 10.13.0.79:51900 returned -2: Success
[Sep 22 14:57:57] WARNING[20945]: chan_sip.c:3776 __sip_xmit: sip_xmit of 0x7f1af804b960 (len 623) to 10.13.0.79:51900 returned -2: Success
[Sep 22 14:58:11] WARNING[20945]: chan_sip.c:3776 __sip_xmit: sip_xmit of 0x7f1af801c380 (len 623) to 10.13.0.79:51900 returned -2: Success
asterisk-whconfig01*CLI> sip reload
Reloading SIP
== Parsing '/etc/asterisk/sip.conf': Found
== Using SIP CoS mark 4
[Sep 22 14:58:18] WARNING[20945]: chan_sip.c:3776 __sip_xmit: sip_xmit of 0x7f1af8058fd0 (len 623) to 10.13.0.79:51900 returned -2: No such file or directory
[Sep 22 14:58:32] WARNING[20945]: chan_sip.c:3776 __sip_xmit: sip_xmit of 0x7f1af80734e0 (len 623) to 10.13.0.79:51900 returned -2: Success
[Sep 22 14:58:46] WARNING[20945]: chan_sip.c:3776 __sip_xmit: sip_xmit of 0x7f1af804b6d0 (len 623) to 10.13.0.79:51900 returned -2: Success
asterisk-whconfig01*CLI> sip reload
gjoseph
September 22, 2016, 7:45pm
82
Interesting. You have devices in both the database AND sip.conf?
Yes. Administration wanted me to test newer Cisco phones, and they require tcp as well as udp. They also have completely different provisioning files than we use. Rather than add to the sippeers which will replicate to all clusters, I opted to just add to the sip.conf.
I didn’t try changing rtcachefriends.
Well…the backtrace looks different.
Backtrace:https://drive.google.com/open?id=0BxUsrDyPCTFATDBJQXZnb2MwenM
[Sep 22 20:56:48] WARNING[30424][C-00000001]: taskprocessor.c:889 taskprocessor_push: The 'subp:SIP/gateway-twc01-0000003a' task processor queue reached 500 scheduled tasks.
asterisk-twc01*CLI> core show taskprocessors
Processor Processed In Queue Max Depth Low water High water
app_voicemail 0 0 0 450 500
ast_msg_queue 0 0 0 450 500
CCSS_core 0 0 0 450 500
Sorcery 0 0 0 450 500
Sorcery-control 1 0 1 450 500
sorcery/bucket-00000000 0 0 0 450 500
sorcery/file-00000001 0 0 0 450 500
stasis-core 272 128 3 450 500
stasis-core-control 733 0 5 450 500
subm:ast_bridge_topic_all-cached-0000000b 1 0 1 450 500
subm:ast_channel_topic_all-00000010 573 0 6 450 500
subm:ast_channel_topic_all-cached-0000000c 776 0 7 450 500
subm:ast_channel_topic_all-cached-0000000d 775 0 7 450 500
subm:ast_device_state_topic-00000002 207 0 2 450 500
subm:ast_device_state_topic-00000004 206 0 2 450 500
subm:ast_device_state_topic-0000000f 105 0 2 450 500
subm:ast_parking-00000009 1 0 1 450 500
subm:ast_presence_state_topic_all-00000005 1 0 1 450 500
subm:ast_security-0000000e 210 0 1 450 500
subm:ast_system-00000008 32 0 30 450 500
subm:ast_system-0000000a 31 0 23 450 500
subm:cdr_engine-00000003 779 0 4 4500 5000
subm:endpoint_topic_all-cached-00000007 1500 0 8 450 500
subm:manager_topic-00000006 1332 0 23 2700 3000
subp:61001@from-internal-sip-0000002d 5 1 1 450 500
subp:61001@from-internal-sip-00000076 0 2 0 450 500
subp:61001@from-internal-sip-0000007c 0 2 0 450 500
subp:61001@from-internal-sip-000000dd 0 1 0 450 500
subp:61008@from-internal-sip-00000012 0 2 0 450 500
subp:61008@from-internal-sip-00000014 0 2 0 450 500
subp:61008@from-internal-sip-00000016 0 2 0 450 500
subp:61008@from-internal-sip-00000022 0 2 0 450 500
subp:61008@from-internal-sip-00000024 0 2 0 450 500
subp:61008@from-internal-sip-00000026 0 2 0 450 500
subp:61008@from-internal-sip-000000a6 0 2 0 450 500
subp:61008@from-internal-sip-000000b1 0 1 0 450 500
subp:61009@from-internal-sip-000000b6 0 1 0 450 500
subp:61013@from-internal-sip-00000050 0 2 0 450 500
subp:61013@from-internal-sip-00000052 1 0 1 450 500
subp:61015@from-internal-sip-0000003c 0 2 0 450 500
subp:61015@from-internal-sip-0000003e 0 2 0 450 500
subp:61015@from-internal-sip-000000db 0 1 0 450 500
subp:61016@from-internal-sip-0000001a 0 2 0 450 500
subp:61016@from-internal-sip-0000001c 0 2 0 450 500
subp:61016@from-internal-sip-0000001f 0 2 0 450 500
subp:61016@from-internal-sip-0000009e 0 1 0 450 500
subp:61017@from-internal-sip-000000ab 0 1 0 450 500
subp:61018@from-internal-sip-000000c4 0 1 0 450 500
subp:61023@from-internal-sip-00000029 0 2 0 450 500
subp:61023@from-internal-sip-0000002b 0 2 0 450 500
subp:61023@from-internal-sip-0000010b 0 1 0 450 500
subp:61027@from-internal-sip-000000ad 0 2 0 450 500
subp:61027@from-internal-sip-000000cc 0 1 0 450 500
subp:61028@from-internal-sip-00000054 0 2 0 450 500
subp:61028@from-internal-sip-00000056 0 2 0 450 500
subp:61028@from-internal-sip-0000005f 1 0 1 450 500
subp:61029@from-internal-sip-000000ba 0 1 0 450 500
subp:61030@from-internal-sip-00000037 0 2 0 450 500
subp:61030@from-internal-sip-00000039 0 2 0 450 500
subp:61030@from-internal-sip-000000a2 0 1 0 450 500
subp:61031@from-internal-sip-000000cf 0 1 0 450 500
subp:61033@from-internal-sip-000000fc 0 1 0 450 500
subp:61034@from-internal-sip-000000a4 0 1 0 450 500
subp:61035@from-internal-sip-00000044 0 2 0 450 500
subp:61035@from-internal-sip-00000046 0 2 0 450 500
subp:61035@from-internal-sip-000000a0 0 1 0 450 500
subp:61036@from-internal-sip-00000040 0 2 0 450 500
subp:61036@from-internal-sip-00000042 1 0 1 450 500
subp:61037@from-internal-sip-0000007a 0 2 0 450 500
subp:61037@from-internal-sip-00000084 0 2 0 450 500
subp:61037@from-internal-sip-000000d9 0 1 0 450 500
subp:61038@from-internal-sip-000000d7 0 1 0 450 500
subp:61039@from-internal-sip-000000f4 0 2 0 450 500
subp:61039@from-internal-sip-00000105 0 1 0 450 500
subp:61042@from-internal-sip-0000002f 0 2 0 450 500
subp:61042@from-internal-sip-00000031 0 2 0 450 500
subp:61042@from-internal-sip-0000008e 0 2 0 450 500
subp:61042@from-internal-sip-00000090 0 2 0 450 500
subp:61042@from-internal-sip-000000f0 0 1 0 450 500
subp:61052@from-internal-sip-000000ee 0 1 0 450 500
subp:61053@from-internal-sip-000000b8 0 1 0 450 500
subp:61055@from-internal-sip-000000f6 0 1 0 450 500
subp:61058@from-internal-sip-0000005b 0 2 0 450 500
subp:61058@from-internal-sip-0000005d 0 2 0 450 500
subp:61058@from-internal-sip-00000068 0 2 0 450 500
subp:61058@from-internal-sip-0000006a 0 2 0 450 500
subp:61058@from-internal-sip-00000080 0 2 0 450 500
subp:61058@from-internal-sip-00000086 0 2 0 450 500
subp:61058@from-internal-sip-00000096 0 2 0 450 500
subp:61058@from-internal-sip-00000098 0 1 0 450 500
subp:61060@from-internal-sip-00000048 0 2 0 450 500
subp:61060@from-internal-sip-0000004a 9 2 1 450 500
subp:61060@from-internal-sip-00000064 0 2 0 450 500
subp:61060@from-internal-sip-00000066 0 2 0 450 500
subp:61060@from-internal-sip-00000092 0 2 0 450 500
subp:61060@from-internal-sip-00000094 0 2 0 450 500
subp:61060@from-internal-sip-000000d1 0 2 0 450 500
subp:61060@from-internal-sip-000000e5 0 1 0 450 500
subp:61064@from-internal-sip-000000f8 0 1 0 450 500
subp:71001@from-internal-sip-0000009a 0 4 0 450 500
subp:71001@from-internal-sip-0000009c 0 3 0 450 500
subp:71001@from-internal-sip-000000c2 0 2 0 450 500
subp:71001@from-internal-sip-000000fe 0 1 0 450 500
subp:71002@from-internal-sip-0000004c 0 2 0 450 500
subp:71002@from-internal-sip-0000004e 0 2 0 450 500
subp:71002@from-internal-sip-0000006f 0 2 0 450 500
subp:71002@from-internal-sip-00000071 0 2 0 450 500
subp:71002@from-internal-sip-00000078 0 2 0 450 500
subp:71002@from-internal-sip-0000007e 0 2 0 450 500
subp:71002@from-internal-sip-000000bc 0 2 0 450 500
subp:71002@from-internal-sip-000000c6 0 1 0 450 500
subp:71003@from-internal-sip-00000033 0 2 0 450 500
subp:71003@from-internal-sip-00000035 1 3 1 450 500
subp:71003@from-internal-sip-000000d5 0 3 0 450 500
subp:71003@from-internal-sip-000000e7 0 2 0 450 500
subp:71003@from-internal-sip-000000e9 0 1 0 450 500
subp:71004@from-internal-sip-00000082 0 2 0 450 500
subp:71004@from-internal-sip-0000008b 0 2 0 450 500
subp:71004@from-internal-sip-000000af 0 3 0 450 500
subp:71004@from-internal-sip-000000e2 0 2 0 450 500
subp:71004@from-internal-sip-000000f2 0 1 0 450 500
subp:SIP/61000-00000032 2 0 2 450 500
subp:SIP/61000-00000034 2 2 2 450 500
subp:SIP/61001-00000075 2 0 2 450 500
subp:SIP/61001-0000007b 2 0 2 450 500
subp:SIP/61001-000000dc 0 4 0 450 500
subp:SIP/61002-0000002c 2 2 2 450 500
subp:SIP/61003-000000de 0 4 0 450 500
subp:SIP/61004-000000c7 0 4 0 450 500
subp:SIP/61005-000000cd 0 4 0 450 500
subp:SIP/61006-00000018 4 0 2 450 500
subp:SIP/61007-00000011 2 0 2 450 500
subp:SIP/61007-00000013 4 0 2 450 500
subp:SIP/61007-00000015 2 0 2 450 500
subp:SIP/61007-000000b0 0 2 0 450 500
subp:SIP/61008-00000021 2 0 2 450 500
subp:SIP/61008-00000023 4 0 2 450 500
subp:SIP/61008-00000025 2 0 2 450 500
subp:SIP/61008-000000a5 0 2 0 450 500
subp:SIP/61009-000000b5 0 4 0 450 500
subp:SIP/61011-0000004b 2 0 2 450 500
subp:SIP/61011-0000004d 2 0 2 450 500
subp:SIP/61011-0000006e 2 0 2 450 500
subp:SIP/61011-00000070 2 0 2 450 500
subp:SIP/61011-00000077 2 0 2 450 500
subp:SIP/61011-0000007d 2 0 2 450 500
subp:SIP/61011-000000c5 0 4 0 450 500
subp:SIP/61012-000000bb 0 4 0 450 500
subp:SIP/61013-0000004f 2 0 2 450 500
subp:SIP/61013-00000051 2 2 2 450 500
subp:SIP/61014-000000e3 0 4 0 450 500
subp:SIP/61015-0000003b 2 0 2 450 500
subp:SIP/61015-0000003d 2 0 2 450 500
subp:SIP/61015-000000da 0 4 0 450 500
subp:SIP/61016-00000019 2 0 2 450 500
subp:SIP/61016-0000001b 4 0 2 450 500
subp:SIP/61016-0000001d 2 0 2 450 500
subp:SIP/61016-0000009d 0 2 0 450 500
subp:SIP/61017-000000aa 0 4 0 450 500
subp:SIP/61018-000000c3 0 4 0 450 500
subp:SIP/61019-000000ea 0 4 0 450 500
subp:SIP/61020-0000008c 2 2 2 450 500
subp:SIP/61021-000000c8 0 5 0 450 500
subp:SIP/61021-000000c9 0 5 0 450 500
subp:SIP/61021-000000ca 0 5 0 450 500
subp:SIP/61021-000000ff 0 4 0 450 500
subp:SIP/61022-00000020 4 0 1 450 500
subp:SIP/61023-00000028 2 0 2 450 500
subp:SIP/61023-0000002a 2 0 2 450 500
subp:SIP/61023-000000a7 0 5 0 450 500
subp:SIP/61023-000000a8 0 5 0 450 500
subp:SIP/61023-000000a9 0 5 0 450 500
subp:SIP/61023-000000b3 0 5 0 450 500
subp:SIP/61023-000000b4 0 5 0 450 500
subp:SIP/61023-000000bd 0 5 0 450 500
subp:SIP/61023-000000be 0 5 0 450 500
subp:SIP/61023-000000df 0 5 0 450 500
subp:SIP/61023-000000e0 0 5 0 450 500
subp:SIP/61023-000000f9 0 5 0 450 500
subp:SIP/61023-000000fa 0 5 0 450 500
subp:SIP/61023-00000100 0 5 0 450 500
subp:SIP/61023-00000101 0 5 0 450 500
subp:SIP/61023-00000102 0 5 0 450 500
subp:SIP/61023-00000103 0 5 0 450 500
subp:SIP/61023-00000106 0 5 0 450 500
subp:SIP/61023-00000107 0 5 0 450 500
subp:SIP/61023-00000108 0 5 0 450 500
subp:SIP/61023-00000109 0 5 0 450 500
subp:SIP/61023-0000010a 0 4 0 450 500
subp:SIP/61024-0000009b 0 4 0 450 500
subp:SIP/61025-000000bf 0 5 0 450 500
subp:SIP/61025-000000c0 0 5 0 450 500
subp:SIP/61025-000000c1 0 4 0 450 500
subp:SIP/61026-00000099 0 4 0 450 500
subp:SIP/61027-000000ac 0 4 0 450 500
subp:SIP/61028-00000053 2 0 2 450 500
subp:SIP/61028-00000055 2 0 2 450 500
subp:SIP/61028-0000005e 2 0 2 450 500
subp:SIP/61029-000000b9 0 4 0 450 500
subp:SIP/61030-00000036 2 0 2 450 500
subp:SIP/61030-00000038 2 0 2 450 500
subp:SIP/61030-000000a1 0 4 0 450 500
subp:SIP/61031-000000ce 0 4 0 450 500
subp:SIP/61032-000000cb 0 4 0 450 500
subp:SIP/61033-000000fb 0 4 0 450 500
subp:SIP/61034-000000a3 0 4 0 450 500
subp:SIP/61035-00000043 2 0 2 450 500
subp:SIP/61035-00000045 2 0 2 450 500
subp:SIP/61035-0000009f 0 4 0 450 500
subp:SIP/61036-0000003f 2 0 2 450 500
subp:SIP/61036-00000041 2 2 2 450 500
subp:SIP/61037-00000079 2 0 2 450 500
subp:SIP/61037-00000083 2 0 2 450 500
subp:SIP/61037-000000d8 0 4 0 450 500
subp:SIP/61038-000000d6 0 2 0 450 500
subp:SIP/61039-00000104 0 4 0 450 500
subp:SIP/61040-000000b2 0 2 0 450 500
subp:SIP/61041-000000f3 0 4 0 450 500
subp:SIP/61042-0000002e 2 0 2 450 500
subp:SIP/61042-00000030 2 0 2 450 500
subp:SIP/61042-0000008d 2 0 2 450 500
subp:SIP/61042-0000008f 2 0 2 450 500
subp:SIP/61042-000000ef 0 2 0 450 500
subp:SIP/61043-000000ec 0 2 0 450 500
subp:SIP/61044-0000010c 0 4 0 450 500
subp:SIP/61046-0000010d 0 4 0 450 500
subp:SIP/61047-000000e6 0 4 0 450 500
subp:SIP/61048-000000e8 0 4 0 450 500
subp:SIP/61049-000000d4 0 4 0 450 500
subp:SIP/61050-000000ae 0 2 0 450 500
subp:SIP/61051-000000f1 0 2 0 450 500
subp:SIP/61052-000000ed 0 2 0 450 500
subp:SIP/61053-000000b7 0 2 0 450 500
subp:SIP/61054-000000d3 0 2 0 450 500
subp:SIP/61055-000000f5 0 2 0 450 500
subp:SIP/61056-000000d2 0 2 0 450 500
subp:SIP/61057-00000081 2 0 2 450 500
subp:SIP/61057-0000008a 2 0 2 450 500
subp:SIP/61057-000000e1 0 2 0 450 500
subp:SIP/61058-0000005a 2 0 2 450 500
subp:SIP/61058-0000005c 2 0 2 450 500
subp:SIP/61058-00000067 2 0 2 450 500
subp:SIP/61058-00000069 2 0 2 450 500
subp:SIP/61058-0000007f 2 0 2 450 500
subp:SIP/61058-00000085 2 0 2 450 500
subp:SIP/61058-00000095 2 0 2 450 500
subp:SIP/61058-00000097 0 2 0 450 500
subp:SIP/61061-00000063 2 0 2 450 500
subp:SIP/61061-00000065 2 0 2 450 500
subp:SIP/61061-000000d0 0 2 0 450 500
subp:SIP/61062-00000047 2 0 2 450 500
subp:SIP/61062-00000049 2 0 2 450 500
subp:SIP/61063-00000091 2 0 2 450 500
subp:SIP/61063-00000093 2 0 2 450 500
subp:SIP/61063-000000e4 0 2 0 450 500
subp:SIP/61064-000000f7 0 2 0 450 500
subp:SIP/62101-000000eb 0 2 0 450 500
subp:SIP/62966-000000fd 0 2 0 450 500
subp:SIP/gateway-twc01-0000003a 209 567 5 450 500
259 taskprocessors
gjoseph
September 23, 2016, 1:43am
85
I don’t know how to tell you this but… the backtrace is from an asterisk built without the patch.
You can tell by looking at these lines:
…in build_peer (name=0x7f683c1d0170 “61016”, v =0x0, alt=0x0, realtime=1, devstate_only=0) at chan_sip.c:31574
If the patch was applied, you’d see…
…in build_peer (name=0x7f683c1d0170 “61016”, v_head =0x0, alt=0x0, realtime=1, devstate_only=0) at chan_sip.c:31595
You scared me there for a minute.
Sorry. I downloaded it from git:http://gerrit.asterisk.org/asterisk asterisk-13
Did I miss something?
gjoseph
September 23, 2016, 2:07am
87
That got the base asterisk 13 branch. It doesn’t have the patch applied yet because it’s still in review.https://gerrit.asterisk.org/#/c/3962 (our code review system) and apply it over the 13 branch.
Alrighty-then. I didn’t realize that. I guess I know what I’ll be doing tomorrow. Thanks again.
gjoseph
September 23, 2016, 2:22am
89
I could have been more explicit. Sorry about that.
I should have known better. I just don’t do this very often.
OK. I patched the test server. Ran some test calls through it, and so far, EVERYTHING is working as expected and nothing is stuck in the queue. I’ll try to run the patch against the live system tonight. Thanks.
gjoseph
September 23, 2016, 12:27pm
91
Well, that’s good news to start a Friday!
Perhaps it’s just a fluke, but the first time I made an outbound call from test, I got the following messages and the call disconnected. I repeated the call several times, and they worked fine. I also ran a sip reload, and eventually a core restart now. It has only errored the one time.
-- Executing [s@subInternalDIDDialer:74] Dial("SIP/12967-00000017", "SIP/number-removed@gateway-whconfig01") in new stack
== Using SIP RTP CoS mark 5
-- Called SIP/number-removed@gateway-whconfig01
{Call Disconnected}
[Sep 23 09:05:23] WARNING[27304][C-00000015]: chan_sip.c:16591 __set_address_from_contact: Invalid contact uri (missing sip: or sips:), attempting to use anyway
[Sep 23 09:05:23] WARNING[27304][C-00000015]: chan_sip.c:16604 __set_address_from_contact: Invalid URI: parse_uri failed to acquire hostport
-- SIP/gateway-whconfig01-00000018 answered SIP/12967-00000017
-- Channel SIP/gateway-whconfig01-00000018 joined 'simple_bridge' basic-bridge <7424e196-11e8-4f5d-a208-005fad0a8909>
-- Channel SIP/12967-00000017 joined 'simple_bridge' basic-bridge <7424e196-11e8-4f5d-a208-005fad0a8909>
-- Channel SIP/gateway-whconfig01-00000018 left 'native_rtp' basic-bridge <7424e196-11e8-4f5d-a208-005fad0a8909>
-- Channel SIP/12967-00000017 left 'native_rtp' basic-bridge <7424e196-11e8-4f5d-a208-005fad0a8909>
== Spawn extension (subInternalDIDDialer, s, 74) exited non-zero on 'SIP/12967-00000017'
-- Executing [h@subInternalDIDDialer:1] GotoIf("SIP/12967-00000017", "1?hangitup") in new stack
-- Goto (subInternalDIDDialer,h,3)
-- Executing [h@subInternalDIDDialer:3] Hangup("SIP/12967-00000017", "") in new stack
== Spawn extension (subInternalDIDDialer, h, 3) exited non-zero on 'SIP/12967-00000017'
gjoseph
September 23, 2016, 1:17pm
93
It looks like there could have been a stale contact in the database. I wouldn’t worry about it unless it happens again.
Prepare for some excitement…looks promising so far. Nothing queued after 2 calls. On the previous versions, I would have seen the error by now. I’ll check it again throughout the weekend.
I told them that if this patch worked, I would just leave it in place and run with it until the next update came out with the patch applied.
You may not be as excited as I am, but please understand how much I appreciate the time and effort you spent fixing this.
asterisk-twc01*CLI> core show taskprocessors
Processor Processed In Queue Max Depth Low water High water
app_voicemail 0 0 0 450 500
ast_msg_queue 0 0 0 450 500
CCSS_core 0 0 0 450 500
Sorcery 0 0 0 450 500
Sorcery-control 1 0 1 450 500
sorcery/bucket-00000000 0 0 0 450 500
sorcery/file-00000001 0 0 0 450 500
stasis-core 977 0 4 450 500
stasis-core-control 1969 0 4 450 500
subm:ast_bridge_topic_all-cached-0000000b 1 0 1 450 500
subm:ast_channel_topic_all-00000010 783 0 5 450 500
subm:ast_channel_topic_all-cached-0000000c 1060 0 15 450 500
subm:ast_channel_topic_all-cached-0000000d 1059 0 15 450 500
subm:ast_device_state_topic-00000002 191 0 2 450 500
subm:ast_device_state_topic-00000004 190 0 2 450 500
subm:ast_device_state_topic-0000000f 89 0 2 450 500
subm:ast_parking-00000009 1 0 1 450 500
subm:ast_presence_state_topic_all-00000005 1 0 1 450 500
subm:ast_security-0000000e 211 0 1 450 500
subm:ast_system-00000008 32 0 30 450 500
subm:ast_system-0000000a 31 0 1 450 500
subm:cdr_engine-00000003 1063 0 4 4500 5000
subm:endpoint_topic_all-cached-00000007 1410 0 6 450 500
subm:manager_topic-00000006 1496 0 7 2700 3000
subp:61001@from-internal-sip-0000002e 2 0 1 450 500
subp:61001@from-internal-sip-00000048 1 0 1 450 500
subp:61008@from-internal-sip-0000004c 2 0 1 450 500
subp:61008@from-internal-sip-00000052 1 0 1 450 500
subp:61009@from-internal-sip-00000045 1 0 1 450 500
subp:61013@from-internal-sip-00000027 1 0 1 450 500
subp:61015@from-internal-sip-00000014 1 0 1 450 500
subp:61016@from-internal-sip-0000006b 1 0 1 450 500
subp:61017@from-internal-sip-00000036 1 0 1 450 500
subp:61018@from-internal-sip-00000038 1 0 1 450 500
subp:61023@from-internal-sip-00000032 1 0 1 450 500
subp:61027@from-internal-sip-00000030 2 0 1 450 500
subp:61027@from-internal-sip-0000004a 1 0 1 450 500
subp:61028@from-internal-sip-00000058 1 0 1 450 500
subp:61029@from-internal-sip-00000025 1 0 1 450 500
subp:61030@from-internal-sip-0000003f 1 0 1 450 500
subp:61031@from-internal-sip-00000034 1 0 1 450 500
subp:61033@from-internal-sip-00000021 1 0 1 450 500
subp:61034@from-internal-sip-0000001d 1 0 1 450 500
subp:61035@from-internal-sip-0000001f 1 0 1 450 500
subp:61036@from-internal-sip-00000029 1 0 1 450 500
subp:61037@from-internal-sip-00000018 1 0 1 450 500
subp:61038@from-internal-sip-0000007b 1 0 1 450 500
subp:61039@from-internal-sip-00000016 2 0 1 450 500
subp:61039@from-internal-sip-00000063 1 0 1 450 500
subp:61042@from-internal-sip-0000006d 1 0 1 450 500
subp:61052@from-internal-sip-0000005d 1 0 1 450 500
subp:61053@from-internal-sip-00000072 1 0 1 450 500
subp:61055@from-internal-sip-00000056 1 0 1 450 500
subp:61058@from-internal-sip-00000076 1 0 1 450 500
subp:61060@from-internal-sip-0000004e 3 0 1 450 500
subp:61060@from-internal-sip-00000050 2 0 1 450 500
subp:61060@from-internal-sip-00000065 1 0 1 450 500
subp:61064@from-internal-sip-0000005f 1 0 1 450 500
subp:71001@from-internal-sip-0000001b 4 0 1 450 500
subp:71001@from-internal-sip-00000023 3 0 1 450 500
subp:71001@from-internal-sip-0000002c 2 0 1 450 500
subp:71001@from-internal-sip-00000067 1 0 1 450 500
subp:71002@from-internal-sip-00000012 2 0 1 450 500
subp:71002@from-internal-sip-00000043 1 0 1 450 500
subp:71003@from-internal-sip-0000003b 4 0 1 450 500
subp:71003@from-internal-sip-00000069 3 0 1 450 500
subp:71003@from-internal-sip-00000082 2 0 1 450 500
subp:71003@from-internal-sip-00000087 1 0 1 450 500
subp:71004@from-internal-sip-00000054 3 0 1 450 500
subp:71004@from-internal-sip-00000074 2 0 1 450 500
subp:71004@from-internal-sip-00000078 1 0 1 450 500
subp:SIP/61000-0000003a 4 0 2 450 500
subp:SIP/61001-00000047 4 0 2 450 500
subp:SIP/61002-0000002d 4 0 2 450 500
subp:SIP/61003-00000041 4 0 2 450 500
subp:SIP/61004-00000061 2 0 2 450 500
subp:SIP/61005-00000019 4 0 2 450 500
subp:SIP/61006-0000007e 2 0 2 450 500
subp:SIP/61007-0000004b 2 0 2 450 500
subp:SIP/61008-00000051 2 0 2 450 500
subp:SIP/61009-00000044 4 0 2 450 500
subp:SIP/61011-00000042 4 0 2 450 500
subp:SIP/61012-00000011 4 0 2 450 500
subp:SIP/61013-00000026 4 0 2 450 500
subp:SIP/61014-00000039 4 0 2 450 500
subp:SIP/61015-00000013 4 0 2 450 500
subp:SIP/61016-0000006a 2 0 2 450 500
subp:SIP/61017-00000035 4 0 2 450 500
subp:SIP/61018-00000037 4 0 2 450 500
subp:SIP/61019-0000003c 4 0 2 450 500
subp:SIP/61020-00000046 4 0 2 450 500
subp:SIP/61021-0000002a 4 0 2 450 500
subp:SIP/61022-00000088 2 0 2 450 500
subp:SIP/61023-00000031 4 0 2 450 500
subp:SIP/61024-00000022 4 0 2 450 500
subp:SIP/61025-0000002b 4 0 2 450 500
subp:SIP/61026-0000001a 4 0 2 450 500
subp:SIP/61027-00000049 4 0 2 450 500
subp:SIP/61028-00000057 2 0 2 450 500
subp:SIP/61029-00000024 4 0 2 450 500
subp:SIP/61030-0000003e 4 0 2 450 500
subp:SIP/61031-00000033 4 0 2 450 500
subp:SIP/61032-0000002f 4 0 2 450 500
subp:SIP/61033-00000020 4 0 2 450 500
subp:SIP/61034-0000001c 4 0 2 450 500
subp:SIP/61035-0000001e 4 0 2 450 500
subp:SIP/61036-00000028 4 0 1 450 500
subp:SIP/61037-00000017 4 0 2 450 500
subp:SIP/61038-0000007a 2 0 2 450 500
subp:SIP/61039-00000015 4 0 2 450 500
subp:SIP/61040-00000083 2 0 2 450 500
subp:SIP/61041-00000062 2 0 2 450 500
subp:SIP/61042-0000006c 2 0 2 450 500
subp:SIP/61043-0000007c 2 0 2 450 500
subp:SIP/61044-0000003d 4 0 2 450 500
subp:SIP/61045-00000079 4 0 2 450 500
subp:SIP/61046-00000040 4 0 2 450 500
subp:SIP/61047-00000086 2 0 2 450 500
subp:SIP/61048-00000081 2 0 2 450 500
subp:SIP/61049-00000068 2 0 2 450 500
subp:SIP/61050-00000073 2 0 2 450 500
subp:SIP/61051-00000053 2 0 2 450 500
subp:SIP/61052-0000005c 2 0 2 450 500
subp:SIP/61053-00000071 2 0 2 450 500
subp:SIP/61054-0000007d 2 0 2 450 500
subp:SIP/61055-00000055 2 0 2 450 500
subp:SIP/61056-00000085 2 0 2 450 500
subp:SIP/61057-00000077 2 0 2 450 500
subp:SIP/61058-00000075 2 0 2 450 500
subp:SIP/61061-00000064 2 0 2 450 500
subp:SIP/61062-0000004d 2 0 2 450 500
subp:SIP/61063-0000004f 2 0 2 450 500
subp:SIP/61064-0000005e 2 0 2 450 500
subp:SIP/62101-00000060 2 0 2 450 500
subp:SIP/62966-00000066 2 0 2 450 500
subp:SIP/gateway-twc01-00000084 1062 0 7 450 500
136 taskprocessors
1 Like
gjoseph
September 24, 2016, 12:39am
95
Are you kidding? I’m STOKED that the issue seems to be resolved. chan_sip is the module we all hate because it’s an old 35 THOUSAND line source file that no one knows completely. Even our CTO was involved in this one so we all appreciate the thanks!
The change was committed this afternoon.
1 Like
Sweet! As long as all goes well next week, this will be a huge load off my mind.
Update:
We’re 150 calls in to the day and all of the 139 taskprocessor queues are 0. The memory usage is still at 0.4% since Friday. No errors.
Fingers crossed, but it’s still looking very good.
jcolp
September 26, 2016, 1:07pm
98
Awesome to hear! A lot of us are at AstriCon this week so replies may be delayed, but we’ll keep checking here just in case!
I figured, but thought I’d give an update here and there. No response is necessary. I hope everyone has a good time, and I’ll probably see everyone at Astricon next year.
Over 1300 calls, the memory is at 0.5% for the asterisk process, and there are 0 in the taskprocessor queues.
Enjoy Astricon!
asterisk-twc01*CLI> core show taskprocessors
Processor Processed In Queue Max Depth Low water High water
app_voicemail 0 0 0 450 500
ast_msg_queue 0 0 0 450 500
CCSS_core 0 0 0 450 500
Sorcery 0 0 0 450 500
Sorcery-control 1 0 1 450 500
sorcery/bucket-00000000 0 0 0 450 500
sorcery/file-00000001 0 0 0 450 500
stasis-core 497229 0 9 450 500
stasis-core-control 1000613 0 40 450 500
subm:ast_bridge_topic_all-cached-0000000b 21497 0 12 450 500
subm:ast_channel_topic_all-00000010 315551 0 65 450 500
subm:ast_channel_topic_all-cached-0000000c 430663 0 87 450 500
subm:ast_channel_topic_all-cached-0000000d 430662 0 60 450 500
subm:ast_device_state_topic-00000002 55104 0 8 450 500
subm:ast_device_state_topic-00000004 55103 0 13 450 500
subm:ast_device_state_topic-0000000f 55002 0 8 450 500
subm:ast_parking-00000009 126 0 1 450 500
subm:ast_presence_state_topic_all-00000005 1 0 1 450 500
subm:ast_security-0000000e 302038 0 13 450 500
subm:ast_system-00000008 32 0 30 450 500
subm:ast_system-0000000a 31 0 1 450 500
subm:cdr_engine-00000003 452287 0 134 4500 5000
subm:endpoint_topic_all-cached-00000007 518943 0 60 450 500
subm:manager_topic-00000006 911712 0 59 2700 3000
subp:61001@from-internal-sip-0000002e 13 0 1 450 500
subp:61001@from-internal-sip-00000048 12 0 1 450 500
subp:61008@from-internal-sip-0000004c 14 0 1 450 500
subp:61008@from-internal-sip-00000052 13 0 1 450 500
subp:61009@from-internal-sip-00000045 1 0 1 450 500
subp:61013@from-internal-sip-00000027 5 0 1 450 500
subp:61015@from-internal-sip-00000014 24 0 1 450 500
subp:61016@from-internal-sip-0000006b 27 0 1 450 500
subp:61017@from-internal-sip-00000036 13 0 1 450 500
subp:61018@from-internal-sip-00000038 31 0 1 450 500
subp:61023@from-internal-sip-00000032 1 0 1 450 500
subp:61027@from-internal-sip-00000030 56 0 1 450 500
subp:61027@from-internal-sip-0000004a 55 0 1 450 500
subp:61028@from-internal-sip-00000058 31 0 1 450 500
subp:61029@from-internal-sip-00000025 18 0 1 450 500
subp:61030@from-internal-sip-0000003f 7 0 1 450 500
subp:61031@from-internal-sip-00000034 1 0 1 450 500
subp:61033@from-internal-sip-00000021 1 0 1 450 500
subp:61034@from-internal-sip-0000001d 1 0 1 450 500
subp:61035@from-internal-sip-0000001f 3 0 1 450 500
subp:61036@from-internal-sip-00000029 1 0 1 450 500
subp:61037@from-internal-sip-00000018 2 0 1 450 500
subp:61038@from-internal-sip-0000007b 1 0 1 450 500
subp:61039@from-internal-sip-00000016 2 0 1 450 500
subp:61039@from-internal-sip-00000063 1 0 1 450 500
subp:61042@from-internal-sip-0000006d 1 0 1 450 500
subp:61052@from-internal-sip-0000005d 1 0 1 450 500
subp:61053@from-internal-sip-00000072 1 0 1 450 500
subp:61055@from-internal-sip-00000056 5 0 1 450 500
subp:61058@from-internal-sip-00000076 1 0 1 450 500
subp:61060@from-internal-sip-0000004e 3 0 1 450 500
subp:61060@from-internal-sip-00000050 2 0 1 450 500
subp:61060@from-internal-sip-00000065 1 0 1 450 500
subp:61064@from-internal-sip-0000005f 1 0 1 450 500
subp:71000@from-internal-sip-0000008a 1 0 1 450 500
subp:71001@from-internal-sip-0000001b 10 0 1 450 500
subp:71001@from-internal-sip-00000023 9 0 1 450 500
subp:71001@from-internal-sip-0000002c 8 0 1 450 500
subp:71001@from-internal-sip-00000067 7 0 1 450 500
subp:71002@from-internal-sip-00000012 16 0 1 450 500
subp:71002@from-internal-sip-00000043 15 0 1 450 500
subp:71003@from-internal-sip-0000003b 5 0 1 450 500
subp:71003@from-internal-sip-00000069 4 0 1 450 500
subp:71003@from-internal-sip-00000082 3 0 1 450 500
subp:71003@from-internal-sip-00000087 2 0 1 450 500
subp:71004@from-internal-sip-00000054 19 0 1 450 500
subp:71004@from-internal-sip-00000074 18 0 1 450 500
subp:71004@from-internal-sip-00000078 17 0 1 450 500
subp:SIP/12967-00000089 2 0 2 450 500
subp:SIP/61000-0000003a 12189 0 29 450 500
subp:SIP/61001-00000047 5608 0 19 450 500
subp:SIP/61002-0000002d 4647 0 20 450 500
subp:SIP/61003-00000041 1216 0 7 450 500
subp:SIP/61004-00000061 1066 0 2 450 500
subp:SIP/61005-00000019 1488 0 13 450 500
subp:SIP/61006-0000007e 1066 0 2 450 500
subp:SIP/61007-0000004b 5436 0 18 450 500
subp:SIP/61008-00000051 4592 0 23 450 500
subp:SIP/61009-00000044 1913 0 16 450 500
subp:SIP/61011-00000042 7350 0 23 450 500
subp:SIP/61012-00000011 10198 0 16 450 500
subp:SIP/61013-00000026 7897 0 20 450 500
subp:SIP/61014-00000039 1070 0 2 450 500
subp:SIP/61015-00000013 2991 0 20 450 500
subp:SIP/61016-0000006a 2933 0 15 450 500
subp:SIP/61017-00000035 3345 0 18 450 500
subp:SIP/61018-00000037 3869 0 11 450 500
subp:SIP/61019-0000003c 1161 0 3 450 500
subp:SIP/61020-00000046 1880 0 13 450 500
subp:SIP/61021-0000002a 2111 0 16 450 500
subp:SIP/61022-00000088 1066 0 2 450 500
subp:SIP/61023-00000031 2510 0 48 450 500
subp:SIP/61024-00000022 6746 0 16 450 500
subp:SIP/61025-0000002b 5272 0 14 450 500
subp:SIP/61026-0000001a 11296 0 25 450 500
subp:SIP/61027-00000049 17183 0 29 450 500
subp:SIP/61028-00000057 8661 0 18 450 500
subp:SIP/61029-00000024 4859 0 16 450 500
subp:SIP/61030-0000003e 7961 0 20 450 500
subp:SIP/61031-00000033 3188 0 20 450 500
subp:SIP/61032-0000002f 1068 0 2 450 500
subp:SIP/61033-00000020 1068 0 2 450 500
subp:SIP/61034-0000001c 1237 0 9 450 500
subp:SIP/61035-0000001e 1981 0 17 450 500
subp:SIP/61036-00000028 1068 0 2 450 500
subp:SIP/61037-00000017 1102 0 4 450 500
subp:SIP/61038-0000007a 178 0 2 450 500
subp:SIP/61039-00000015 2022 0 17 450 500
subp:SIP/61040-00000083 178 0 2 450 500
subp:SIP/61041-00000062 1507 0 16 450 500
subp:SIP/61042-0000006c 180 0 2 450 500
subp:SIP/61043-0000007c 180 0 2 450 500
subp:SIP/61044-0000003d 1068 0 2 450 500
subp:SIP/61045-00000079 1068 0 2 450 500
subp:SIP/61046-00000040 1068 0 2 450 500
subp:SIP/61047-00000086 1066 0 2 450 500
subp:SIP/61048-00000081 1066 0 2 450 500
subp:SIP/61049-00000068 3908 0 29 450 500
subp:SIP/61050-00000073 8287 0 22 450 500
subp:SIP/61051-00000053 265 0 4 450 500
subp:SIP/61052-0000005c 180 0 2 450 500
subp:SIP/61053-00000071 1865 0 20 450 500
subp:SIP/61054-0000007d 180 0 2 450 500
subp:SIP/61055-00000055 1429 0 18 450 500
subp:SIP/61056-00000085 950 0 9 450 500
subp:SIP/61057-00000077 1246 0 25 450 500
subp:SIP/61058-00000075 605 0 6 450 500
subp:SIP/61061-00000064 212 0 4 450 500
subp:SIP/61062-0000004d 247 0 2 450 500
subp:SIP/61063-0000004f 212 0 4 450 500
subp:SIP/61064-0000005e 180 0 2 450 500
subp:SIP/62101-00000060 717 0 29 450 500
subp:SIP/62966-00000066 470 0 8 450 500
subp:SIP/asterisk-whconfig-00000147 17 0 4 450 500
subp:SIP/asterisk-whconfig01-0000008b 732 0 18 450 500
subp:SIP/gateway-twc01-00000084 295213 0 60 450 500
140 taskprocessors
1 Like
This is what it looked like after 2 inbound calls.
For everyone involved.