Asterisk process topping out

Asterisk Asterisk Support
1

Ok, looking for a few recommendations here, as I have run out of ideas. First some specs:

Asterisk 1.4.11
Dual Intel Quad Core 3Ghz
2 GB FBDIMM
(2) 160GB Sata in Software RAID 1
TE410P Zaptel Card with 3 PRI’s

This customer is our largest and most important, and as the Lord and Murphy would have it, also seems to have the largest problem. For reasons not yet devined, the asterisk process will shoot through the roof at random times. Top reports 110% to (sometimes) 140% on the asterisk process itself, while globally the system itself sits at 10 to 15% usage. This slows asterisk down to almost a halt. Calls take 5 to 10 seconds just to transfer or begin to dial.
The log shows:

[Nov 19 15:37:01] ERROR[4518] chan_sip.c: We could NOT get the channel lock for SIP/3128-0b806208!
[Nov 19 15:37:01] ERROR[4518] chan_sip.c: SIP transaction failed: 73d4e2341ca4eee04d95cdae6509b956@“mydomain.com”
[Nov 19 15:37:01] ERROR[32139] app_dial.c: Could not stop autoservice on calling channel
[Nov 19 15:37:02] WARNING[4518] chan_sip.c: Maximum retries exceeded on transmission 649fa84a-9b081084-905c73af@192.16
8.0.35 for seqno 1 (Critical Response)
[Nov 19 15:37:02] WARNING[4518] chan_sip.c: Maximum retries exceeded on transmission 649fa84a-9b081084-905c73af@192.16
8.0.35 for seqno 1 (Critical Response)
[Nov 19 15:37:02] WARNING[4518] chan_sip.c: Maximum retries exceeded on transmission fce76aef-3baf796d-517407d4@192.16
8.0.92 for seqno 4 (Critical Response)
[Nov 19 15:37:02] WARNING[4518] chan_sip.c: Maximum retries exceeded on transmission 649fa84a-9b081084-905c73af@192.16
8.0.35 for seqno 1 (Critical Response)
[Nov 19 15:37:03] WARNING[4518] chan_sip.c: Maximum retries exceeded on transmission 649fa84a-9b081084-905c73af@192.16
8.0.35 for seqno 1 (Critical Response)
[Nov 19 15:37:03] WARNING[4518] chan_sip.c: Maximum retries exceeded on transmission fce76aef-3baf796d-517407d4@192.16
8.0.92 for seqno 4 (Critical Response)
[Nov 19 15:37:03] WARNING[4518] chan_sip.c: Maximum retries exceeded on transmission b54459b6-d97824a4-6a1398fd@192.16
8.0.30 for seqno 1 (Critical Response)
[Nov 19 15:37:03] WARNING[4518] chan_sip.c: Maximum retries exceeded on transmission b54459b6-d97824a4-6a1398fd@192.16
8.0.30 for seqno 1 (Critical Response)
[Nov 19 15:37:03] ERROR[4518] chan_sip.c: We could NOT get the channel lock for SIP/3219-0b7693b0!
[Nov 19 15:37:03] ERROR[4518] chan_sip.c: SIP transaction failed: 608b5ba212b9199377ed9bc6013d820c@“mydomain.com”
[Nov 19 15:37:04] ERROR[4518] chan_sip.c: We could NOT get the channel lock for SIP/3219-0b7693b0!
[Nov 19 15:37:04] ERROR[4518] chan_sip.c: SIP transaction failed: 608b5ba212b9199377ed9bc6013d820c@“mydomain.com”
[Nov 19 15:37:04] ERROR[4518] chan_sip.c: We could NOT get the channel lock for SIP/3219-0b7693b0!
[Nov 19 15:37:04] ERROR[4518] chan_sip.c: SIP transaction failed: 608b5ba212b9199377ed9bc6013d820c@“mydomain.com”
[Nov 19 15:37:04] ERROR[4518] chan_sip.c: We could NOT get the channel lock for SIP/3482-b4a1c540!
[Nov 19 15:37:04] ERROR[4518] chan_sip.c: SIP transaction failed: 0e4388d20c4ba93f1274b0140b019250@“mydomain.com”
[Nov 19 15:37:07] WARNING[4518] chan_sip.c: Maximum retries exceeded on transmission b54459b6-d97824a4-6a1398fd@192.16
8.0.30 for seqno 1 (Critical Response)
[Nov 19 15:37:07] WARNING[4518] chan_sip.c: Maximum retries exceeded on transmission 59d49e9b-92e9d839-790d8db0@192.16
8.0.92 for seqno 1 (Critical Response)
[Nov 19 15:37:07] WARNING[4518] chan_sip.c: Maximum retries exceeded on transmission b54459b6-d97824a4-6a1398fd@192.16
8.0.30 for seqno 1 (Critical Response)
[Nov 19 15:37:07] WARNING[4518] chan_sip.c: Maximum retries exceeded on transmission 59d49e9b-92e9d839-790d8db0@192.16
8.0.92 for seqno 1 (Critical Response)
[Nov 19 15:37:07] WARNING[4518] chan_sip.c: Remote host can’t match request BYE to call ‘28bbcbb8380ac06030db964d28d00
cac@“Comtronic.com”’. Giving up.
[Nov 19 15:37:07] WARNING[4518] chan_sip.c: Remote host can’t match request BYE to call ‘28bbcbb8380ac06030db964d28d00
cac@“Comtronic.com”’. Giving up.
[Nov 19 15:37:08] WARNING[4518] chan_sip.c: Maximum retries exceeded on transmission 59d49e9b-92e9d839-790d8db0@192.16
8.0.92 for seqno 1 (Critical Response)
[Nov 19 15:37:08] WARNING[4518] chan_sip.c: Maximum retries exceeded on transmission 59d49e9b-92e9d839-790d8db0@192.16
8.0.92 for seqno 1 (Critical Response)
[Nov 19 15:37:08] WARNING[4518] chan_sip.c: Maximum retries exceeded on transmission 45c3023d37aaf2815a9709d167a676d7@
“Comtronic.com” for seqno 1 (Critical Response)
[Nov 19 15:37:08] WARNING[4518] chan_sip.c: Maximum retries exceeded on transmission ccecf850-e448c3e6-97feee2d@192.16
8.1.17 for seqno 1 (Critical Response)
[Nov 19 15:37:10] WARNING[4518] chan_sip.c: Maximum retries exceeded on transmission ccecf850-e448c3e6-97feee2d@192.16
8.1.17 for seqno 1 (Critical Response)

HELP ! My question really is two fold :

  1. Why in zeus’s butthole is the asterisk process trying to kill a cpu ?
  2. Why is it only taking on 1 and not balancing the load over all 8 cores ?
    Is asterisk a multi-threaded applicaion ?

ANY help or input or wild guesses would be extremely appreciated.

Thanks in advance

2

I don’t have answers for the CPU spiking but the errors that you are getting mean that packets are being dumped. It is any ones guess as to why. Try a different, NIC, Router and maybe ITSP. Compare the results.