PJSIP stops responding to incoming SIP requests

Hello,

We have an issue with Asterisk on a new server with the following software versions:
Asterisk v21.4.2
OS: Debian 12 (Bookworm)

The configuration of Asterisk on this system is the same as our other systems running Asterisk.
The only difference between this system and our other systems running Asterisk is that the others run on Ubuntu.


The issue:

After Asterisk has been running for a few days (around 2-3 days) without any calls PJSIP stops responding to SIP requests.

Our endpoints will try to re-register after the retry interval and will fail to register again.
The status of the endpoints do not change in Asterisk even though they could not register after the retry interval.

We have had this issue happen 2 times on this server, and will downgrade to another version of Asterisk (20.9.2) in the hopes this will fix the issue.
If this issue still occurs, or the issue seems to be fixed I will send an update here.


What we checked:

We have already checked the Asterisk logging for any errors and only found that at some point Asterisk (PJSIP) just stops responding to SIP requests. (Without any logging informing why this could have happened)
We also checked our firewall and have not found any configuration issues there.


Thank you in advance for your help.

It’s not clearly stated, do the requests actually show up in Asterisk PJSIP logging?

Yes, the requests do show up in the PJSIP logging.

Here is some of the logging where you can see PJSIP receive and send requests, and than stop sending requests.

/var/log/syslog.1:2024-08-21T23:59:45.354101+00:00 [hostname] asterisk[1811132]: VERBOSE[3420680]: res_pjsip_logger.c:354 in logging_on_rx_msg: <--- Received SIP request (578 bytes) from UDP:***.240.***.14:5060 --->#012REGISTER sip:***.241.***.224;transport=udp SIP/2.0#015#012Via: SIP/2.0/UDP ***.240.***.14:5060;branch=z9hG4bKe7336399b1414128;rport#015#012Contact: <sip:1651@***.240.***.14:5060>;expires=120;+sip.instance="<urn:uuid:3f26a6e1-20ff-4308-960b-24f08c1ea8d3>"#015#012Max-Forwards: 70#015#012To: <sip:1651@***.241.***.224>#015#012From: "Dropoff%20Gate%20In" <sip:1651@***.241.***.224>;tag=ded1a2d8e2634f1a#015#012Call-ID: 6321ffe0a8634e23#015#012CSeq: 34481 REGISTER#015#012User-Agent: commend SIP Series 4.6.2 Build 27#015#012Allow: INVITE,ACK,BYE,CANCEL,OPTIONS,NOTIFY,SUBSCRIBE,INFO,MESSAGE,UPDATE,REFER#015#012Expires: 120#015#012Content-Length: 0#015#012#015#012
/var/log/syslog.1:2024-08-21T23:59:46.001211+00:00 [hostname] asterisk[1811132]: VERBOSE[3420680]: res_pjsip_logger.c:354 in logging_on_rx_msg: <--- Received SIP request (579 bytes) from UDP:***.240.***.54:5060 --->#012REGISTER sip:***.241.***.224;transport=udp SIP/2.0#015#012Via: SIP/2.0/UDP ***.240.***.54:5060;branch=z9hG4bKe64289973ac6a05f;rport#015#012Contact: <sip:1654@***.240.***.54:5060>;expires=120;+sip.instance="<urn:uuid:3606512b-1a3d-497c-a098-36cace0c73b4>"#015#012Max-Forwards: 70#015#012To: <sip:1654@***.241.***.224>#015#012From: "Dropoff%20Gate%20Out" <sip:1654@***.241.***.224>;tag=c9c1c3e8b7e1cfac#015#012Call-ID: 7980751936eaad26#015#012CSeq: 14752 REGISTER#015#012User-Agent: commend SIP Series 4.6.2 Build 27#015#012Allow: INVITE,ACK,BYE,CANCEL,OPTIONS,NOTIFY,SUBSCRIBE,INFO,MESSAGE,UPDATE,REFER#015#012Expires: 120#015#012Content-Length: 0#015#012#015#012
/var/log/syslog.1:2024-08-21T23:59:46.603707+00:00 [hostname] asterisk[1811132]: VERBOSE[3420680]: res_pjsip_logger.c:354 in logging_on_rx_msg: <--- Received SIP request (585 bytes) from UDP:***.240.***.44:5060 --->#012REGISTER sip:***.241.***.224;transport=udp SIP/2.0#015#012Via: SIP/2.0/UDP ***.240.***.44:5060;branch=z9hG4bK2ff546b5f21f7660;rport#015#012Contact: <sip:1653@***.240.***.44:5060>;expires=120;+sip.instance="<urn:uuid:9d9ea898-1a59-44a2-91c4-030ab6682f77>"#015#012Max-Forwards: 70#015#012To: <sip:1653@***.241.***.224>#015#012From: "Dropoff%20Inspect%20In%2002" <sip:1653@***.241.***.224>;tag=96e5e9a6c0011576#015#012Call-ID: db4afb7cb20ec360#015#012CSeq: 5500 REGISTER#015#012User-Agent: commend SIP Series 4.6.2 Build 27#015#012Allow: INVITE,ACK,BYE,CANCEL,OPTIONS,NOTIFY,SUBSCRIBE,INFO,MESSAGE,UPDATE,REFER#015#012Expires: 120#015#012Content-Length: 0#015#012#015#012
/var/log/syslog.1:2024-08-21T23:59:46.692249+00:00 [hostname] asterisk[1811132]: VERBOSE[3420680]: res_pjsip_logger.c:354 in logging_on_rx_msg: <--- Received SIP request (577 bytes) from UDP:***.240.***.64:5060 --->#012REGISTER sip:***.241.***.224;transport=udp SIP/2.0#015#012Via: SIP/2.0/UDP ***.240.***.64:5060;branch=z9hG4bKb6cf063ebe097049;rport#015#012Contact: <sip:1655@***.240.***.64:5060>;expires=120;+sip.instance="<urn:uuid:eb36c599-007b-46a6-9412-1f0f16800056>"#015#012Max-Forwards: 70#015#012To: <sip:1655@***.241.***.224>#015#012From: "Pickup%20Gate%20In" <sip:1655@***.241.***.224>;tag=f13f9543a70911db#015#012Call-ID: dfd7259f6c8e7f9a#015#012CSeq: 18737 REGISTER#015#012User-Agent: commend SIP Series 4.6.2 Build 27#015#012Allow: INVITE,ACK,BYE,CANCEL,OPTIONS,NOTIFY,SUBSCRIBE,INFO,MESSAGE,UPDATE,REFER#015#012Expires: 120#015#012Content-Length: 0#015#012#015#012
/var/log/syslog.1:2024-08-21T23:59:46.872087+00:00 [hostname] asterisk[1811132]: VERBOSE[3420680]: res_pjsip_logger.c:354 in logging_on_rx_msg: <--- Received SIP request (578 bytes) from UDP:***.240.***.54:5060 --->#012REGISTER sip:***.241.***.224;transport=udp SIP/2.0#015#012Via: SIP/2.0/UDP ***.240.***.54:5060;branch=z9hG4bKfee6acc6ba82fe5f;rport#015#012Contact: <sip:1654@***.240.***.54:5060>;expires=120;+sip.instance="<urn:uuid:3606512b-1a3d-497c-a098-36cace0c73b4>"#015#012Max-Forwards: 70#015#012To: <sip:1654@***.241.***.224>#015#012From: "Dropoff%20Gate%20Out" <sip:1654@***.241.***.224>;tag=9ff56555e10661ee#015#012Call-ID: abf85d0936d15afd#015#012CSeq: 4047 REGISTER#015#012User-Agent: commend SIP Series 4.6.2 Build 27#015#012Allow: INVITE,ACK,BYE,CANCEL,OPTIONS,NOTIFY,SUBSCRIBE,INFO,MESSAGE,UPDATE,REFER#015#012Expires: 120#015#012Content-Length: 0#015#012#015#012
/var/log/syslog.1:2024-08-21T23:59:47.354218+00:00 [hostname] asterisk[1811132]: VERBOSE[3420680]: res_pjsip_logger.c:354 in logging_on_rx_msg: <--- Received SIP request (578 bytes) from UDP:***.240.***.14:5060 --->#012REGISTER sip:***.241.***.224;transport=udp SIP/2.0#015#012Via: SIP/2.0/UDP ***.240.***.14:5060;branch=z9hG4bKe7336399b1414128;rport#015#012Contact: <sip:1651@***.240.***.14:5060>;expires=120;+sip.instance="<urn:uuid:3f26a6e1-20ff-4308-960b-24f08c1ea8d3>"#015#012Max-Forwards: 70#015#012To: <sip:1651@***.241.***.224>#015#012From: "Dropoff%20Gate%20In" <sip:1651@***.241.***.224>;tag=ded1a2d8e2634f1a#015#012Call-ID: 6321ffe0a8634e23#015#012CSeq: 34481 REGISTER#015#012User-Agent: commend SIP Series 4.6.2 Build 27#015#012Allow: INVITE,ACK,BYE,CANCEL,OPTIONS,NOTIFY,SUBSCRIBE,INFO,MESSAGE,UPDATE,REFER#015#012Expires: 120#015#012Content-Length: 0#015#012#015#012
/var/log/syslog.1:2024-08-21T23:59:48.709618+00:00 [hostname] asterisk[1811132]: VERBOSE[3420680]: res_pjsip_logger.c:354 in logging_on_rx_msg: <--- Received SIP request (578 bytes) from UDP:***.240.***.74:5060 --->#012REGISTER sip:***.241.***.224;transport=udp SIP/2.0#015#012Via: SIP/2.0/UDP ***.240.***.74:5060;branch=z9hG4bK9dada29618dfe96d;rport#015#012Contact: <sip:1656@***.240.***.74:5060>;expires=120;+sip.instance="<urn:uuid:9578e0f4-d00a-4ca9-a3a1-148d6a72d5ae>"#015#012Max-Forwards: 70#015#012To: <sip:1656@***.241.***.224>#015#012From: "Pickup%20Gate%20Out" <sip:1656@***.241.***.224>;tag=e761d2d605b06402#015#012Call-ID: f6fd9c7a4bd0c771#015#012CSeq: 27880 REGISTER#015#012User-Agent: commend SIP Series 4.6.2 Build 27#015#012Allow: INVITE,ACK,BYE,CANCEL,OPTIONS,NOTIFY,SUBSCRIBE,INFO,MESSAGE,UPDATE,REFER#015#012Expires: 120#015#012Content-Length: 0#015#012#015#012
/var/log/syslog.1:2024-08-21T23:59:50.001346+00:00 [hostname] asterisk[1811132]: VERBOSE[3420680]: res_pjsip_logger.c:354 in logging_on_rx_msg: <--- Received SIP request (579 bytes) from UDP:***.240.***.54:5060 --->#012REGISTER sip:***.241.***.224;transport=udp SIP/2.0#015#012Via: SIP/2.0/UDP ***.240.***.54:5060;branch=z9hG4bKe64289973ac6a05f;rport#015#012Contact: <sip:1654@***.240.***.54:5060>;expires=120;+sip.instance="<urn:uuid:3606512b-1a3d-497c-a098-36cace0c73b4>"#015#012Max-Forwards: 70#015#012To: <sip:1654@***.241.***.224>#015#012From: "Dropoff%20Gate%20Out" <sip:1654@***.241.***.224>;tag=c9c1c3e8b7e1cfac#015#012Call-ID: 7980751936eaad26#015#012CSeq: 14752 REGISTER#015#012User-Agent: commend SIP Series 4.6.2 Build 27#015#012Allow: INVITE,ACK,BYE,CANCEL,OPTIONS,NOTIFY,SUBSCRIBE,INFO,MESSAGE,UPDATE,REFER#015#012Expires: 120#015#012Content-Length: 0#015#012#015#012
/var/log/syslog.1:2024-08-21T23:59:50.604307+00:00 [hostname] asterisk[1811132]: VERBOSE[3420680]: res_pjsip_logger.c:354 in logging_on_rx_msg: <--- Received SIP request (585 bytes) from UDP:***.240.***.44:5060 --->#012REGISTER sip:***.241.***.224;transport=udp SIP/2.0#015#012Via: SIP/2.0/UDP ***.240.***.44:5060;branch=z9hG4bK2ff546b5f21f7660;rport#015#012Contact: <sip:1653@***.240.***.44:5060>;expires=120;+sip.instance="<urn:uuid:9d9ea898-1a59-44a2-91c4-030ab6682f77>"#015#012Max-Forwards: 70#015#012To: <sip:1653@***.241.***.224>#015#012From: "Dropoff%20Inspect%20In%2002" <sip:1653@***.241.***.224>;tag=96e5e9a6c0011576#015#012Call-ID: db4afb7cb20ec360#015#012CSeq: 5500 REGISTER#015#012User-Agent: commend SIP Series 4.6.2 Build 27#015#012Allow: INVITE,ACK,BYE,CANCEL,OPTIONS,NOTIFY,SUBSCRIBE,INFO,MESSAGE,UPDATE,REFER#015#012Expires: 120#015#012Content-Length: 0#015#012#015#012
/var/log/syslog.1:2024-08-21T23:59:50.872880+00:00 [hostname] asterisk[1811132]: VERBOSE[3420680]: res_pjsip_logger.c:354 in logging_on_rx_msg: <--- Received SIP request (578 bytes) from UDP:***.240.***.54:5060 --->#012REGISTER sip:***.241.***.224;transport=udp SIP/2.0#015#012Via: SIP/2.0/UDP ***.240.***.54:5060;branch=z9hG4bKfee6acc6ba82fe5f;rport#015#012Contact: <sip:1654@***.240.***.54:5060>;expires=120;+sip.instance="<urn:uuid:3606512b-1a3d-497c-a098-36cace0c73b4>"#015#012Max-Forwards: 70#015#012To: <sip:1654@***.241.***.224>#015#012From: "Dropoff%20Gate%20Out" <sip:1654@***.241.***.224>;tag=9ff56555e10661ee#015#012Call-ID: abf85d0936d15afd#015#012CSeq: 4047 REGISTER#015#012User-Agent: commend SIP Series 4.6.2 Build 27#015#012Allow: INVITE,ACK,BYE,CANCEL,OPTIONS,NOTIFY,SUBSCRIBE,INFO,MESSAGE,UPDATE,REFER#015#012Expires: 120#015#012Content-Length: 0#015#012#015#012
/var/log/syslog.1:2024-08-21T23:59:51.354789+00:00 [hostname] asterisk[1811132]: VERBOSE[3420680]: res_pjsip_logger.c:354 in logging_on_rx_msg: <--- Received SIP request (578 bytes) from UDP:***.240.***.14:5060 --->#012REGISTER sip:***.241.***.224;transport=udp SIP/2.0#015#012Via: SIP/2.0/UDP ***.240.***.14:5060;branch=z9hG4bKe7336399b1414128;rport#015#012Contact: <sip:1651@***.240.***.14:5060>;expires=120;+sip.instance="<urn:uuid:3f26a6e1-20ff-4308-960b-24f08c1ea8d3>"#015#012Max-Forwards: 70#015#012To: <sip:1651@***.241.***.224>#015#012From: "Dropoff%20Gate%20In" <sip:1651@***.241.***.224>;tag=ded1a2d8e2634f1a#015#012Call-ID: 6321ffe0a8634e23#015#012CSeq: 34481 REGISTER#015#012User-Agent: commend SIP Series 4.6.2 Build 27#015#012Allow: INVITE,ACK,BYE,CANCEL,OPTIONS,NOTIFY,SUBSCRIBE,INFO,MESSAGE,UPDATE,REFER#015#012Expires: 120#015#012Content-Length: 0#015#012#015#012
/var/log/syslog.1:2024-08-21T23:59:52.711585+00:00 [hostname] asterisk[1811132]: VERBOSE[3420680]: res_pjsip_logger.c:354 in logging_on_rx_msg: <--- Received SIP request (578 bytes) from UDP:***.240.***.74:5060 --->#012REGISTER sip:***.241.***.224;transport=udp SIP/2.0#015#012Via: SIP/2.0/UDP ***.240.***.74:5060;branch=z9hG4bK9dada29618dfe96d;rport#015#012Contact: <sip:1656@***.240.***.74:5060>;expires=120;+sip.instance="<urn:uuid:9578e0f4-d00a-4ca9-a3a1-148d6a72d5ae>"#015#012Max-Forwards: 70#015#012To: <sip:1656@***.241.***.224>#015#012From: "Pickup%20Gate%20Out" <sip:1656@***.241.***.224>;tag=e761d2d605b06402#015#012Call-ID: f6fd9c7a4bd0c771#015#012CSeq: 27880 REGISTER#015#012User-Agent: commend SIP Series 4.6.2 Build 27#015#012Allow: INVITE,ACK,BYE,CANCEL,OPTIONS,NOTIFY,SUBSCRIBE,INFO,MESSAGE,UPDATE,REFER#015#012Expires: 120#015#012Content-Length: 0#015#012#015#012
/var/log/syslog.1:2024-08-21T23:59:54.001861+00:00 [hostname] asterisk[1811132]: VERBOSE[3420680]: res_pjsip_logger.c:354 in logging_on_rx_msg: <--- Received SIP request (579 bytes) from UDP:***.240.***.54:5060 --->#012REGISTER sip:***.241.***.224;transport=udp SIP/2.0#015#012Via: SIP/2.0/UDP ***.240.***.54:5060;branch=z9hG4bKe64289973ac6a05f;rport#015#012Contact: <sip:1654@***.240.***.54:5060>;expires=120;+sip.instance="<urn:uuid:3606512b-1a3d-497c-a098-36cace0c73b4>"#015#012Max-Forwards: 70#015#012To: <sip:1654@***.241.***.224>#015#012From: "Dropoff%20Gate%20Out" <sip:1654@***.241.***.224>;tag=c9c1c3e8b7e1cfac#015#012Call-ID: 7980751936eaad26#015#012CSeq: 14752 REGISTER#015#012User-Agent: commend SIP Series 4.6.2 Build 27#015#012Allow: INVITE,ACK,BYE,CANCEL,OPTIONS,NOTIFY,SUBSCRIBE,INFO,MESSAGE,UPDATE,REFER#015#012Expires: 120#015#012Content-Length: 0#015#012#015#012
/var/log/syslog.1:2024-08-21T23:59:54.873526+00:00 [hostname] asterisk[1811132]: VERBOSE[3420680]: res_pjsip_logger.c:354 in logging_on_rx_msg: <--- Received SIP request (578 bytes) from UDP:***.240.***.54:5060 --->#012REGISTER sip:***.241.***.224;transport=udp SIP/2.0#015#012Via: SIP/2.0/UDP ***.240.***.54:5060;branch=z9hG4bKfee6acc6ba82fe5f;rport#015#012Contact: <sip:1654@***.240.***.54:5060>;expires=120;+sip.instance="<urn:uuid:3606512b-1a3d-497c-a098-36cace0c73b4>"#015#012Max-Forwards: 70#015#012To: <sip:1654@***.241.***.224>#015#012From: "Dropoff%20Gate%20Out" <sip:1654@***.241.***.224>;tag=9ff56555e10661ee#015#012Call-ID: abf85d0936d15afd#015#012CSeq: 4047 REGISTER#015#012User-Agent: commend SIP Series 4.6.2 Build 27#015#012Allow: INVITE,ACK,BYE,CANCEL,OPTIONS,NOTIFY,SUBSCRIBE,INFO,MESSAGE,UPDATE,REFER#015#012Expires: 120#015#012Content-Length: 0#015#012#015#012
/var/log/syslog.1:2024-08-21T23:59:55.354978+00:00 [hostname] asterisk[1811132]: VERBOSE[3420680]: res_pjsip_logger.c:354 in logging_on_rx_msg: <--- Received SIP request (578 bytes) from UDP:***.240.***.14:5060 --->#012REGISTER sip:***.241.***.224;transport=udp SIP/2.0#015#012Via: SIP/2.0/UDP ***.240.***.14:5060;branch=z9hG4bKe7336399b1414128;rport#015#012Contact: <sip:1651@***.240.***.14:5060>;expires=120;+sip.instance="<urn:uuid:3f26a6e1-20ff-4308-960b-24f08c1ea8d3>"#015#012Max-Forwards: 70#015#012To: <sip:1651@***.241.***.224>#015#012From: "Dropoff%20Gate%20In" <sip:1651@***.241.***.224>;tag=ded1a2d8e2634f1a#015#012Call-ID: 6321ffe0a8634e23#015#012CSeq: 34481 REGISTER#015#012User-Agent: commend SIP Series 4.6.2 Build 27#015#012Allow: INVITE,ACK,BYE,CANCEL,OPTIONS,NOTIFY,SUBSCRIBE,INFO,MESSAGE,UPDATE,REFER#015#012Expires: 120#015#012Content-Length: 0#015#012#015#012
/var/log/syslog.1:2024-08-21T23:59:56.709408+00:00 [hostname] asterisk[1811132]: VERBOSE[3420680]: res_pjsip_logger.c:354 in logging_on_rx_msg: <--- Received SIP request (578 bytes) from UDP:***.240.***.74:5060 --->#012REGISTER sip:***.241.***.224;transport=udp SIP/2.0#015#012Via: SIP/2.0/UDP ***.240.***.74:5060;branch=z9hG4bK9dada29618dfe96d;rport#015#012Contact: <sip:1656@***.240.***.74:5060>;expires=120;+sip.instance="<urn:uuid:9578e0f4-d00a-4ca9-a3a1-148d6a72d5ae>"#015#012Max-Forwards: 70#015#012To: <sip:1656@***.241.***.224>#015#012From: "Pickup%20Gate%20Out" <sip:1656@***.241.***.224>;tag=e761d2d605b06402#015#012Call-ID: f6fd9c7a4bd0c771#015#012CSeq: 27880 REGISTER#015#012User-Agent: commend SIP Series 4.6.2 Build 27#015#012Allow: INVITE,ACK,BYE,CANCEL,OPTIONS,NOTIFY,SUBSCRIBE,INFO,MESSAGE,UPDATE,REFER#015#012Expires: 120#015#012Content-Length: 0#015#012#015#012
/var/log/syslog.1:2024-08-21T23:59:58.002591+00:00 [hostname] asterisk[1811132]: VERBOSE[3420680]: res_pjsip_logger.c:354 in logging_on_rx_msg: <--- Received SIP request (579 bytes) from UDP:***.240.***.54:5060 --->#012REGISTER sip:***.241.***.224;transport=udp SIP/2.0#015#012Via: SIP/2.0/UDP ***.240.***.54:5060;branch=z9hG4bKe64289973ac6a05f;rport#015#012Contact: <sip:1654@***.240.***.54:5060>;expires=120;+sip.instance="<urn:uuid:3606512b-1a3d-497c-a098-36cace0c73b4>"#015#012Max-Forwards: 70#015#012To: <sip:1654@***.241.***.224>#015#012From: "Dropoff%20Gate%20Out" <sip:1654@***.241.***.224>;tag=c9c1c3e8b7e1cfac#015#012Call-ID: 7980751936eaad26#015#012CSeq: 14752 REGISTER#015#012User-Agent: commend SIP Series 4.6.2 Build 27#015#012Allow: INVITE,ACK,BYE,CANCEL,OPTIONS,NOTIFY,SUBSCRIBE,INFO,MESSAGE,UPDATE,REFER#015#012Expires: 120#015#012Content-Length: 0#015#012#015#012
/var/log/syslog.1:2024-08-21T23:59:58.874736+00:00 [hostname] asterisk[1811132]: VERBOSE[3420680]: res_pjsip_logger.c:354 in logging_on_rx_msg: <--- Received SIP request (578 bytes) from UDP:***.240.***.54:5060 --->#012REGISTER sip:***.241.***.224;transport=udp SIP/2.0#015#012Via: SIP/2.0/UDP ***.240.***.54:5060;branch=z9hG4bKfee6acc6ba82fe5f;rport#015#012Contact: <sip:1654@***.240.***.54:5060>;expires=120;+sip.instance="<urn:uuid:3606512b-1a3d-497c-a098-36cace0c73b4>"#015#012Max-Forwards: 70#015#012To: <sip:1654@***.241.***.224>#015#012From: "Dropoff%20Gate%20Out" <sip:1654@***.241.***.224>;tag=9ff56555e10661ee#015#012Call-ID: abf85d0936d15afd#015#012CSeq: 4047 REGISTER#015#012User-Agent: commend SIP Series 4.6.2 Build 27#015#012Allow: INVITE,ACK,BYE,CANCEL,OPTIONS,NOTIFY,SUBSCRIBE,INFO,MESSAGE,UPDATE,REFER#015#012Expires: 120#015#012Content-Length: 0#015#012#015#012
/var/log/syslog.1:2024-08-21T23:59:59.355669+00:00 [hostname] asterisk[1811132]: VERBOSE[3420680]: res_pjsip_logger.c:354 in logging_on_rx_msg: <--- Received SIP request (578 bytes) from UDP:***.240.***.14:5060 --->#012REGISTER sip:***.241.***.224;transport=udp SIP/2.0#015#012Via: SIP/2.0/UDP ***.240.***.14:5060;branch=z9hG4bKe7336399b1414128;rport#015#012Contact: <sip:1651@***.240.***.14:5060>;expires=120;+sip.instance="<urn:uuid:3f26a6e1-20ff-4308-960b-24f08c1ea8d3>"#015#012Max-Forwards: 70#015#012To: <sip:1651@***.241.***.224>#015#012From: "Dropoff%20Gate%20In" <sip:1651@***.241.***.224>;tag=ded1a2d8e2634f1a#015#012Call-ID: 6321ffe0a8634e23#015#012CSeq: 34481 REGISTER#015#012User-Agent: commend SIP Series 4.6.2 Build 27#015#012Allow: INVITE,ACK,BYE,CANCEL,OPTIONS,NOTIFY,SUBSCRIBE,INFO,MESSAGE,UPDATE,REFER#015#012Expires: 120#015#012Content-Length: 0#015#012#015#012
/var/log/syslog.2.gz:2024-08-20T00:00:04.187172+00:00 [hostname] asterisk[1811132]: VERBOSE[3420681]: res_pjsip_logger.c:322 in logging_on_tx_msg: <--- Transmitting SIP request (418 bytes) to UDP:***.240.***.64:5060 --->#012OPTIONS sip:1655@***.240.***.64:5060 SIP/2.0#015#012Via: SIP/2.0/UDP ***.241.***.224:5060;rport;branch=z9hG4bKPjaf3f489c-d742-4679-9f8a-371bd63a8858#015#012From: <sip:1655@***.241.***.224>;tag=c03fe29e-ad31-41eb-aae3-970b37967611#015#012To: <sip:1655@***.240.***.64>#015#012Contact: <sip:1655@***.241.***.224:5060>#015#012Call-ID: 69c3a428-59fb-4a5f-ace7-c28274579c1e#015#012CSeq: 12004 OPTIONS#015#012Max-Forwards: 70#015#012User-Agent: CoCoS PBX#015#012Content-Length:  0#015#012#015#012
/var/log/syslog.2.gz:2024-08-20T00:00:04.199912+00:00 [hostname] asterisk[1811132]: VERBOSE[3420680]: res_pjsip_logger.c:354 in logging_on_rx_msg: <--- Received SIP response (938 bytes) from UDP:***.240.***.64:5060 --->#012SIP/2.0 200 OK#015#012Via: SIP/2.0/UDP ***.241.***.224:5060;branch=z9hG4bKPjaf3f489c-d742-4679-9f8a-371bd63a8858;rport=5060;received=***.241.***.224#015#012From: <sip:1655@***.241.***.224>;tag=c03fe29e-ad31-41eb-aae3-970b37967611#015#012To: <sip:1655@***.240.***.64>;tag=09b066c5bd2a7233#015#012Call-ID: 69c3a428-59fb-4a5f-ace7-c28274579c1e#015#012CSeq: 12004 OPTIONS#015#012Server: commend SIP Series 4.6.2 Build 27#015#012Allow: INVITE,ACK,BYE,CANCEL,OPTIONS,NOTIFY,SUBSCRIBE,INFO,MESSAGE,UPDATE,REFER#015#012Supported: gruu,replaces,norefersub#015#012Contact: <sip:1655@***.240.***.64:5060>#015#012Content-Type: application/sdp#015#012Content-Length: 348#015#012#015#012v=0#015#012o=- 3053504882 899184920 IN IP4 ***.240.***.64#015#012s=-#015#012c=IN IP4 ***.240.***.64#015#012t=0 0#015#012m=audio 9 RTP/AVP 9 0 8 101#015#012a=rtpmap:9 G722/8000#015#012a=rtpmap:0 PCMU/8000#015#012a=rtpmap:8 PCMA/8000#015#012a=rtpmap:101 telephone-event/8000#015#012a=fmtp:101 0-15#015#012a=sendrecv#015#012a=rtcp-rsize#015#012a=ssrc:0 cname:sip:1655@***.241.***.224#015#012a=mid:0#015#012a=minptime:20#015#012a=ptime:20#015#012a=label:1#015#012
/var/log/syslog.2.gz:2024-08-20T00:00:04.547364+00:00 [hostname] asterisk[1811132]: VERBOSE[3420681]: res_pjsip_logger.c:322 in logging_on_tx_msg: <--- Transmitting SIP request (428 bytes) to UDP:***.241.***.250:5071 --->#012OPTIONS sip:***.241.***.250:5071 SIP/2.0#015#012Via: SIP/2.0/UDP ***.241.***.224:5060;rport;branch=z9hG4bKPj6eff7392-3755-48e4-9ffa-9ab77f7af133#015#012From: <sip:Sonexus_Trunk@***.241.***.224>;tag=feb6b573-1fb7-42cf-8553-bb1ce80b12c0#015#012To: <sip:***.241.***.250>#015#012Contact: <sip:Sonexus_Trunk@***.241.***.224:5060>#015#012Call-ID: 992744fe-799e-4072-9923-f6caf23f2681#015#012CSeq: 27739 OPTIONS#015#012Max-Forwards: 70#015#012User-Agent: CoCoS PBX#015#012Content-Length:  0#015#012#015#012
/var/log/syslog.2.gz:2024-08-20T00:00:04.573861+00:00 [hostname] asterisk[1811132]: VERBOSE[3420680]: res_pjsip_logger.c:354 in logging_on_rx_msg: <--- Received SIP response (430 bytes) from UDP:***.241.***.250:5071 --->#012SIP/2.0 500 Server Internal Error#015#012Via: SIP/2.0/UDP ***.241.***.224:5060;received=***.241.***.224;rport=5060;branch=z9hG4bKPj6eff7392-3755-48e4-9ffa-9ab77f7af133#015#012From: <sip:Sonexus_Trunk@***.241.***.224>;tag=feb6b573-1fb7-42cf-8553-bb1ce80b12c0#015#012To: <sip:***.241.***.250>;tag=1c297345239#015#012Call-ID: 992744fe-799e-4072-9923-f6caf23f2681#015#012CSeq: 27739 OPTIONS#015#012Reason: SIP ;cause=500 ;text="Classification Failure"#015#012Content-Length: 0#015#012#015#012
/var/log/syslog.2.gz:2024-08-20T00:00:07.185572+00:00 [hostname] asterisk[1811132]: VERBOSE[3420680]: res_pjsip_logger.c:354 in logging_on_rx_msg: <--- Received SIP request (870 bytes) from UDP:***.240.***.4:5060 --->#012REGISTER sip:***.241.***.224;transport=udp SIP/2.0#015#012Via: SIP/2.0/UDP ***.240.***.4:5060;branch=z9hG4bK6a9439f49eb640c9;rport#015#012Contact: <sip:1650-0xdc7468@***.240.***.4:5060>;expires=120;+sip.instance="<urn:uuid:65b976b3-22b9-9b6b-88d9-75c4d9d928d0>"#015#012Max-Forwards: 70#015#012Authorization: Digest username="CoCoS-1bzAk4ccnLQkPZ", realm="asterisk", nonce="1724111947/2b13467334b328bee0fe1aacce7eb77a", uri="sip:***.241.***.224;transport=udp", response="b59e1b5dd9ca1341b79e1cc06f3fc391", opaque="4848fca56adb53b0", cnonce="69744d67395a0158", qop=auth, nc=00000002, algorithm=MD5#015#012To: <sip:1650@***.241.***.224>#015#012From: "ID5" <sip:1650@***.241.***.224>;tag=6687afbfa3fc9642#015#012Call-ID: 634232018a2ee377#015#012CSeq: 49936 REGISTER#015#012User-Agent: Commend Symphony MX 03.08.01.14#015#012Allow: INVITE,ACK,BYE,CANCEL,OPTIONS,NOTIFY,SUBSCRIBE,INFO,MESSAGE,UPDATE,REFER#015#012Expires: 120#015#012Content-Length: 0#015#012#015#012
/var/log/syslog.2.gz:2024-08-20T00:00:07.185827+00:00 [hostname] asterisk[1811132]: VERBOSE[3420681]: res_pjsip_logger.c:322 in logging_on_tx_msg: <--- Transmitting SIP response (492 bytes) to UDP:***.240.***.4:5060 --->#012SIP/2.0 401 Unauthorized#015#012Via: SIP/2.0/UDP ***.240.***.4:5060;rport=5060;received=***.240.***.4;branch=z9hG4bK6a9439f49eb640c9#015#012Call-ID: 634232018a2ee377#015#012From: "ID5" <sip:1650@***.241.***.224>;tag=6687afbfa3fc9642#015#012To: <sip:1650@***.241.***.224>;tag=z9hG4bK6a9439f49eb640c9#015#012CSeq: 49936 REGISTER#015#012WWW-Authenticate: Digest realm="asterisk",nonce="1724112007/37d1c28358d62ee3f19aca459b9b2903",opaque="1fb37961290e631a",stale=true,algorithm=MD5,qop="auth"#015#012Server: CoCoS PBX#015#012Content-Length:  0#015#012#015#012
/var/log/syslog.2.gz:2024-08-20T00:00:07.195293+00:00 [hostname] asterisk[1811132]: VERBOSE[3420680]: res_pjsip_logger.c:354 in logging_on_rx_msg: <--- Received SIP request (870 bytes) from UDP:***.240.***.4:5060 --->#012REGISTER sip:***.241.***.224;transport=udp SIP/2.0#015#012Via: SIP/2.0/UDP ***.240.***.4:5060;branch=z9hG4bK1249283561b374fb;rport#015#012Contact: <sip:1650-0xdc7468@***.240.***.4:5060>;expires=120;+sip.instance="<urn:uuid:65b976b3-22b9-9b6b-88d9-75c4d9d928d0>"#015#012Max-Forwards: 70#015#012Authorization: Digest username="CoCoS-1bzAk4ccnLQkPZ", realm="asterisk", nonce="1724112007/37d1c28358d62ee3f19aca459b9b2903", uri="sip:***.241.***.224;transport=udp", response="da48e46a6e5390dc11409c32fc4f6d8b", opaque="1fb37961290e631a", cnonce="04bacaaed1c9ff9a", qop=auth, nc=00000001, algorithm=MD5#015#012To: <sip:1650@***.241.***.224>#015#012From: "ID5" <sip:1650@***.241.***.224>;tag=6687afbfa3fc9642#015#012Call-ID: 634232018a2ee377#015#012CSeq: 49937 REGISTER#015#012User-Agent: Commend Symphony MX 03.08.01.14#015#012Allow: INVITE,ACK,BYE,CANCEL,OPTIONS,NOTIFY,SUBSCRIBE,INFO,MESSAGE,UPDATE,REFER#015#012Expires: 120#015#012Content-Length: 0#015#012#015#012
/var/log/syslog.2.gz:2024-08-20T00:00:07.195878+00:00 [hostname] asterisk[1811132]: VERBOSE[3420681]: res_pjsip_logger.c:322 in logging_on_tx_msg: <--- Transmitting SIP response (436 bytes) to UDP:***.240.***.4:5060 --->#012SIP/2.0 200 OK#015#012Via: SIP/2.0/UDP ***.240.***.4:5060;rport=5060;received=***.240.***.4;branch=z9hG4bK1249283561b374fb#015#012Call-ID: 634232018a2ee377#015#012From: "ID5" <sip:1650@***.241.***.224>;tag=6687afbfa3fc9642#015#012To: <sip:1650@***.241.***.224>;tag=z9hG4bK1249283561b374fb#015#012CSeq: 49937 REGISTER#015#012Date: Tue, 20 Aug 2024 00:00:07 GMT#015#012Contact: <sip:1650-0xdc7468@***.240.***.4:5060>;expires=119#015#012Expires: 120#015#012Server: CoCoS PBX#015#012Content-Length:  0#015#012#015#012
/var/log/syslog.2.gz:2024-08-20T00:00:11.314020+00:00 [hostname] asterisk[1811132]: VERBOSE[3420680]: res_pjsip_logger.c:354 in logging_on_rx_msg: <--- Received SIP request (881 bytes) from UDP:***.240.***.14:5060 --->#012REGISTER sip:***.241.***.224;transport=udp SIP/2.0#015#012Via: SIP/2.0/UDP ***.240.***.14:5060;branch=z9hG4bK8717a4b84ddf6986;rport#015#012Contact: <sip:1651@***.240.***.14:5060>;expires=120;+sip.instance="<urn:uuid:3f26a6e1-20ff-4308-960b-24f08c1ea8d3>"#015#012Max-Forwards: 70#015#012Authorization: Digest username="CoCoS-iqkaJ1Iuc69RW0", realm="asterisk", nonce="1724111951/a4c357582bf0741c9132e814f7123451", uri="sip:***.241.***.224;transport=udp", response="8f58e2b40ab71e8163b21c52eb62fe9f", opaque="578d392166ff17f9", cnonce="00dad08ff5223033", qop=auth, nc=00000002, algorithm=MD5#015#012To: <sip:1651@***.241.***.224>#015#012From: "Dropoff%20Gate%20In" <sip:1651@***.241.***.224>;tag=9cc6c4699a6d0dbc#015#012Call-ID: 430e1132f5e7f114#015#012CSeq: 59346 REGISTER#015#012User-Agent: commend SIP Series 4.6.2 Build 27#015#012Allow: INVITE,ACK,BYE,CANCEL,OPTIONS,NOTIFY,SUBSCRIBE,INFO,MESSAGE,UPDATE,REFER#015#012Expires: 120#015#012Content-Length: 0#015#012#015#012
/var/log/syslog.2.gz:2024-08-20T00:00:11.314380+00:00 [hostname] asterisk[1811132]: VERBOSE[3420681]: res_pjsip_logger.c:322 in logging_on_tx_msg: <--- Transmitting SIP response (510 bytes) to UDP:***.240.***.14:5060 --->#012SIP/2.0 401 Unauthorized#015#012Via: SIP/2.0/UDP ***.240.***.14:5060;rport=5060;received=***.240.***.14;branch=z9hG4bK8717a4b84ddf6986#015#012Call-ID: 430e1132f5e7f114#015#012From: "Dropoff%20Gate%20In" <sip:1651@***.241.***.224>;tag=9cc6c4699a6d0dbc#015#012To: <sip:1651@***.241.***.224>;tag=z9hG4bK8717a4b84ddf6986#015#012CSeq: 59346 REGISTER#015#012WWW-Authenticate: Digest realm="asterisk",nonce="1724112011/446e6d9c233a298a471850e507fdcb98",opaque="07215713026904ac",stale=true,algorithm=MD5,qop="auth"#015#012Server: CoCoS PBX#015#012Content-Length:  0#015#012#015#012
/var/log/syslog.2.gz:2024-08-20T00:00:11.326382+00:00 [hostname] asterisk[1811132]: VERBOSE[3420680]: res_pjsip_logger.c:354 in logging_on_rx_msg: <--- Received SIP request (881 bytes) from UDP:***.240.***.14:5060 --->#012REGISTER sip:***.241.***.224;transport=udp SIP/2.0#015#012Via: SIP/2.0/UDP ***.240.***.14:5060;branch=z9hG4bK39de0618b8c7492c;rport#015#012Contact: <sip:1651@***.240.***.14:5060>;expires=120;+sip.instance="<urn:uuid:3f26a6e1-20ff-4308-960b-24f08c1ea8d3>"#015#012Max-Forwards: 70#015#012Authorization: Digest username="CoCoS-iqkaJ1Iuc69RW0", realm="asterisk", nonce="1724112011/446e6d9c233a298a471850e507fdcb98", uri="sip:***.241.***.224;transport=udp", response="6c907f2ed4634f551e44eda264791d64", opaque="07215713026904ac", cnonce="04cb021b08b0256f", qop=auth, nc=00000001, algorithm=MD5#015#012To: <sip:1651@***.241.***.224>#015#012From: "Dropoff%20Gate%20In" <sip:1651@***.241.***.224>;tag=9cc6c4699a6d0dbc#015#012Call-ID: 430e1132f5e7f114#015#012CSeq: 59347 REGISTER#015#012User-Agent: commend SIP Series 4.6.2 Build 27#015#012Allow: INVITE,ACK,BYE,CANCEL,OPTIONS,NOTIFY,SUBSCRIBE,INFO,MESSAGE,UPDATE,REFER#015#012Expires: 120#015#012Content-Length: 0#015#012#015#012
/var/log/syslog.2.gz:2024-08-20T00:00:11.327147+00:00 [hostname] asterisk[1811132]: VERBOSE[3420681]: res_pjsip_logger.c:322 in logging_on_tx_msg: <--- Transmitting SIP response (446 bytes) to UDP:***.240.***.14:5060 --->#012SIP/2.0 200 OK#015#012Via: SIP/2.0/UDP ***.240.***.14:5060;rport=5060;received=***.240.***.14;branch=z9hG4bK39de0618b8c7492c#015#012Call-ID: 430e1132f5e7f114#015#012From: "Dropoff%20Gate%20In" <sip:1651@***.241.***.224>;tag=9cc6c4699a6d0dbc#015#012To: <sip:1651@***.241.***.224>;tag=z9hG4bK39de0618b8c7492c#015#012CSeq: 59347 REGISTER#015#012Date: Tue, 20 Aug 2024 00:00:11 GMT#015#012Contact: <sip:1651@***.240.***.14:5060>;expires=119#015#012Expires: 120#015#012Server: CoCoS PBX#015#012Content-Length:  0#015#012#015#012
/var/log/syslog.2.gz:2024-08-20T00:00:14.620002+00:00 [hostname] asterisk[1811132]: VERBOSE[3420681]: res_pjsip_logger.c:322 in logging_on_tx_msg: <--- Transmitting SIP request (418 bytes) to UDP:***.240.***.34:5060 --->#012OPTIONS sip:1652@***.240.***.34:5060 SIP/2.0#015#012Via: SIP/2.0/UDP ***.241.***.224:5060;rport;branch=z9hG4bKPjfda79e32-7ede-4fc4-a069-257699474911#015#012From: <sip:1652@***.241.***.224>;tag=19d1131a-0667-4577-8515-5d8375e66e90#015#012To: <sip:1652@***.240.***.34>#015#012Contact: <sip:1652@***.241.***.224:5060>#015#012Call-ID: 453308c9-530c-4769-83f2-085779061e4a#015#012CSeq: 61647 OPTIONS#015#012Max-Forwards: 70#015#012User-Agent: CoCoS PBX#015#012Content-Length:  0#015#012#015#012
/var/log/syslog.2.gz:2024-08-20T00:00:14.631335+00:00 [hostname] asterisk[1811132]: VERBOSE[3420680]: res_pjsip_logger.c:354 in logging_on_rx_msg: <--- Received SIP response (937 bytes) from UDP:***.240.***.34:5060 --->#012SIP/2.0 200 OK#015#012Via: SIP/2.0/UDP ***.241.***.224:5060;branch=z9hG4bKPjfda79e32-7ede-4fc4-a069-257699474911;rport=5060;received=***.241.***.224#015#012From: <sip:1652@***.241.***.224>;tag=19d1131a-0667-4577-8515-5d8375e66e90#015#012To: <sip:1652@***.240.***.34>;tag=2935b0d00ebdaf55#015#012Call-ID: 453308c9-530c-4769-83f2-085779061e4a#015#012CSeq: 61647 OPTIONS#015#012Server: commend SIP Series 4.6.2 Build 27#015#012Allow: INVITE,ACK,BYE,CANCEL,OPTIONS,NOTIFY,SUBSCRIBE,INFO,MESSAGE,UPDATE,REFER#015#012Supported: gruu,replaces,norefersub#015#012Contact: <sip:1652@***.240.***.34:5060>#015#012Content-Type: application/sdp#015#012Content-Length: 347#015#012#015#012v=0#015#012o=- 832761561 468768243 IN IP4 ***.240.***.34#015#012s=-#015#012c=IN IP4 ***.240.***.34#015#012t=0 0#015#012m=audio 9 RTP/AVP 9 0 8 101#015#012a=rtpmap:9 G722/8000#015#012a=rtpmap:0 PCMU/8000#015#012a=rtpmap:8 PCMA/8000#015#012a=rtpmap:101 telephone-event/8000#015#012a=fmtp:101 0-15#015#012a=sendrecv#015#012a=rtcp-rsize#015#012a=ssrc:0 cname:sip:1652@***.241.***.224#015#012a=mid:0#015#012a=minptime:20#015#012a=ptime:20#015#012a=label:1#015#012

You need a core debug log then[1] and a running backtrace[2] to see if something is blocked. A general description of your usage would also be needed, such as stating if realtime is in use.

[1] Collecting Debug Information - Asterisk Documentation
[2] Getting a Backtrace - Asterisk Documentation

After creating the core debug log I found the following log messages that seem to indicate the issue. (Bellow the REGISTER message)

[Aug 22 10:29:10] Asterisk 21.4.2 built by root @ [hostname] on a x86_64 running Linux on 2024-08-22 08:51:09 UTC
[Aug 22 10:29:11] VERBOSE[2085115] res_pjsip_logger.c: <--- Received SIP request (578 bytes) from UDP:***.240.***.74:5060 --->
REGISTER sip:***.241.***.224;transport=udp SIP/2.0
Via: SIP/2.0/UDP ***.240.***.74:5060;branch=z9hG4bK39c65dd5ceca9906;rport
Contact: <sip:1656@***.240.***.74:5060>;expires=120;+sip.instance="<urn:uuid:9578e0f4-d00a-4ca9-a3a1-148d6a72d5ae>"
Max-Forwards: 70
To: <sip:1656@***.241.***.224>
From: "Pickup%20Gate%20Out" <sip:1656@***.241.***.224>;tag=aeba37ea9f4a5e6b
Call-ID: aa300a08b1e51a3d
CSeq: 42361 REGISTER
User-Agent: commend SIP Series 4.6.2 Build 27
Allow: INVITE,ACK,BYE,CANCEL,OPTIONS,NOTIFY,SUBSCRIBE,INFO,MESSAGE,UPDATE,REFER
Expires: 120
Content-Length: 0


[Aug 22 10:29:11] DEBUG[2085115] res_pjsip/pjsip_distributor.c: Could not find matching transaction for Request msg REGISTER/cseq=42361 (rdata0x7f473407a3a8)
[Aug 22 10:29:11] DEBUG[2085115] res_pjsip/pjsip_distributor.c: Calculated serializer pjsip/distributor-00000033 to use for Request msg REGISTER/cseq=42361 (rdata0x7f473407a3a8)

Still checking the backtrace

That’s not an issue. That’s normal. If you turn on debug and try to do analysis yourself without an understanding, you’re going to see what you think are scary/abnormal things when in reality they are expected.

Would you like me to send the collected logging?

I would suggest sanitizing it to your liking and providing a link here so people can take a look if they wish.

The logging I was able to collect can be found here: 2024-08-22-Asterisk_backtrace+core-debug-log.zip - Google Drive
If there is any information / logging missing, feel free to ask.

It would appear as though there is a deadlock between things. A debug log leading up to it would be nice to see what is going on before it occurs, as well as a general description of your usage and configuration. I asked if you are using realtime at all, but you didn’t answer.

Realtime as in Realtime cache (sorcery)? If so, than yes we are using realtime (forgot to mention that earlier :sweat_smile:).


General usage:

We generally use Asterisk for handling internal and external calls.

General configuration:

We always have ARI, HTTP, Sorcery, and PJSIP transports pre-configured, and than we configure the rest using our own web interface that pushes it’s configuration using ARI (+Sorcery caching).


As for a debug log leading up to the deadlock:

We did not enable the full debug logging at the time, and since we are unsure on how to reproduce the issue we will keep logging until the issue occurs again and than share the logging here.

Where are transports stored? What is their configuration?

The transport(s) are stored in /etc/asterisk/pjsip.conf and contain the following configuration:

;
; Tansport for SIP traffic over UDP
;
[transport-udp]
type = transport
protocol = udp
bind = 0.0.0.0:5060

;
; Tansport for SIP traffic over TLS
;
[transport-tls]
type = transport
protocol = tls
bind = 0.0.0.0:5061
cert_file = /etc/asterisk/keys/asterisk.crt
priv_key_file = /etc/asterisk/keys/asterisk.key
ca_list_file = /etc/asterisk/keys/ca.crt
method = sslv23
verify_client = no
verify_server = yes
require_client_cert = no
external_media_address = ***.***.***.***
external_signaling_address = ***.***.***.***
local_net = ***.***.***.***/255.255.248.0

The NAT configurations for the TLS transport where not supposed to be there so these will be removed from now on.
Also this TLS transport is not loaded in since I forgot to create the certificates…

Deadlocks don’t happen to people doing simple calls. If they did, they would be spotted and fixed early. What is being asked for here is rather more detail that identifies what you are doing that is unusual.

The only unusual thing for this project I can think of is that we have configured a trunk that does not yet allow traffic from the IP address of our new server (this must still be configured).

Other than that our endpoints are not yet in use, so (other than a few test calls) no calls are currently being made.

After some time of running without issues we just got the issue again.

We enabled the full debug logging on this system, so I was able to find the logging leading up to the issue:
log.txt (20.9 KB).

The logs that caught my attention are the following:

[Sep  2 19:53:02] DEBUG[1731353] threadpool.c: Worker thread idle timeout reached. Dying.
[Sep  2 19:53:02] DEBUG[1731347] threadpool.c: Destroying worker thread 5
[Sep  2 19:53:02] DEBUG[4084764] threadpool.c: Worker thread idle timeout reached. Dying.

Also this system was running Asterisk 20.9.2, and not Asterisk v21.4.2 (the version on which we first got this issue)

More debug before needs to be provided. The REGISTER was destined for the “pjsip/distributor-00000032” serializer, but the debug log you’ve provided doesn’t go back far enough to show the last thing that was queued to that serializer or what happened to it.

Sorry for the late reaction, we were a bit busy here.

But here is more logging, this logging is from Sep 1 05:40:57 to Sep 3 14:15:20,
the issue occurred around Sep 2 19:53.

You can file an issue[1] with the provided backtrace and logs, and a link to this forum thread. There no timeframe on when it would get looked into, or if it would.

[1] Issues · asterisk/asterisk · GitHub

I have just filed the issue.

Thank you for your time, help, and fast response.