Re-Ocurring Asterisk Crash with Coredump

Recently we installed Asterisk on one of our servers and have had problems with it crashing daily. A little background: we have around 300 phones connected to it and they are all cisco phones so we installed chan-sccp-b. Asterisk has been crashing up to 3 times a day. Sometimes it crashes and we get a core dump and other times it just hangs and all the devices start to drop displaying “Crossover device registration!” in /var/log/asterisk/full. Now, I may be in the wrong place for reporting bugs. If so can someone point me to the right place? We have tried re-installing asterisk multiple times using both Asterisk 1.8.11 and 1.8.18. We have also re-installed SCCP-Chan-b using multiple versions. Here is the latest core dump:

#0 0x00e9f402 in __kernel_vsyscall ()
No symbol table info available.
#1 0x00b29e00 in raise () from /lib/libc.so.6
No symbol table info available.
#2 0x00b2b711 in abort () from /lib/libc.so.6
No symbol table info available.
#3 0x00b623bb in __libc_message () from /lib/libc.so.6
No symbol table info available.
#4 0x00b6b731 in _int_malloc () from /lib/libc.so.6
No symbol table info available.
#5 0x00b6ccda in calloc () from /lib/libc.so.6
No symbol table info available.
#6 0x08198194 in _ast_calloc (num=1, len=976, file=0x81fdb34 “utils.c”, lineno=1827, func=0x81fdf48 “__ast_calloc_with_stringfields”)
at /usr/src/asterisk-1.8.18.0/include/asterisk/utils.h:480
p = 0xa
PRETTY_FUNCTION = “_ast_calloc”
#7 0x0819ad55 in ast_calloc_with_stringfields (num_structs=1, struct_size=52, field_mgr_offset=40, field_mgr_pool_offset=16, pool_size=267,
file=0x81e7954 “logger.c”, lineno=1244, func=0x81e84d6 “ast_log”) at utils.c:1827
mgr = 0xb2f3cf98
pool = 0xb2f3cbc8
pool_head = 0x81988dc
pool_size_needed = 283
size_to_alloc = 976
allocation = 0x0
x = 136215843
PRETTY_FUNCTION = “ast_calloc_with_stringfields"
#8 0x0811ed96 in ast_log (level=5, file=0x81ed414 “pbx.c”, line=4255, function=0x81ef06b “pbx_extension_helper”, fmt=0x81e7d23 “%s”) at logger.c:1244
logmsg = 0x0
buf = 0x9865d58
tm = {tm_sec = -1292644576, tm_min = -1292636264, tm_hour = -1292644880, tm_mday = -1292644952, tm_mon = 135818557, tm_year = 161565908,
tm_wday = 256, tm_yday = -1292644880, tm_isdst = -1292644576, tm_gmtoff = -1292636184,
tm_zone = 0xb2f3f037 "\262\364
", <incomplete sequence \305>, tm_usec = -1}
now = {tv_sec = 1354299682, tv_usec = 208408}
res = 139
ap = 0xb2f3cde4 “\324L\241\t’\254”, <incomplete sequence \306>
datestring = “\\314\363\262\324L\241\tH\315\363\262$\025\266\000\\314\363\262\360\315\363\262\070\317\363\262\324L\241\t\000\000\000\000\374\314\363\262\377\000\000\000\001\200\255\373\324L\241\t\324L\241\t\324L\241\t\324L\241\t_M\241\t\323M\241\t\324L\241\t\323M\241\t”, ‘\000’ <repeats 20 times>, “\001\200\255\373\000\000\000\000\261\315\363\262\000\000\000\262\000\000\000\000\260\315\363\262de\266\000\260\315\363\262\261\315\363\262”, ‘\000’ <repeats 12 times>"\377, \377\377\377\000\315\363\262\360\315\363\262\377\377\377\377\330\315\363\262\364
\305\000\360\315\363\262\000\315\363\262\254\315\363\262̹\265\000\000\315\363\262@Y\305\000\000\000\000\000\360\315\363\262\000\000\000\000\001\200\255\373\360\315\363\262\360\315\363\262\360\315\363\262\360\315\363\262 \316\363\262\377\377\377\377\360\315\363\262\377\377\377\377”, ‘\000’ <repeats 11 times>
PRETTY_FUNCTION = “ast_log”
#9 0x0811fa54 in ast_verbose_ap (file=0x81ed414 “pbx.c”, line=4255, func=0x81ef06b “pbx_extension_helper”,
fmt=0xb2f3cdf0 “\177 – Executing [%s@%s:%d] %s(”%s", “%s”) %s\n", ap=0xb2f3cf20 “\024L\002\263\304K\002\263\001”) at logger.c:1532
buf = 0x9a14cc8
res = 139
#10 0x0811fa8c in ast_verbose (file=0x81ed414 “pbx.c”, line=4255, func=0x81ef06b “pbx_extension_helper”,
fmt=0x81ef0d0 " – Executing [%s@%s:%d] %s("%s", “%s”) %s\n") at logger.c:1540
ap = 0xb2f3cf20 “\024L\002\263\304K\002\263\001”
#11 0x08142507 in pbx_extension_helper (c=0xb3024858, con=0x0, context=0xb3024bc4 “macro-dialout-trunk-predial-hook”, exten=0xb3024c14 “s”, priority=1,
label=0x0, callerid=0xb3021478 “7406707941”, action=E_SPAWN, found=0xb2f4141c, combined_find_spawn=1) at pbx.c:4250
tmp = “\033[1;36mMacroExit\033[0m\000\266\021\bp\276R\tp\276R\t\254#\035\b\326\006\000\000\362\034\035\b\000\000\000\000\303f\266\000hA\b\b\200\231\034\b\355\002\000\000\356~\265\000\324\365\363\262\000\000\000\000\221\370”, <incomplete sequence \363\262>
tmp2 = “\033[1;35mSCCP/7941-000008d1\033[0m\000c\t0018e;2\033[0m\000\000\000\000\000\370\357\363\262hA\b\b\324\b\035\b\326\006\000\000\254#\035\b\362\034\035\b\320@c\tb\f”, <incomplete sequence \364\262>
tmp3 = "\033[1;35m\033[0m\000(CALLERPRES()=prohib_passed_screen)\033[0m\000\000m\000)\033[0m\000\000default\033[0m\000\061
@from-ccss-)\033[0m\326\363\262m", '\000' <repeats 11 times>, "p\326\363\262de\266\000\000\000\000\000\000\000\000\000\364_\305\000\274\326\363\262D\320\363\262\a\024\266\000\274\326\363\262\\\327\363\262\234\327\363\262\000\000\000\000\234\327\363\262\364_\305\000\017\000\000\000\017\000\000\000t\320\363\262\303f\266\000\274\326\363\262\061\000\000\000\000\000\000\000\356~\265\000\066l\t\000\000\000\000\216.z\t\364
\305\000\244\351\036\b\00
3\262\244\351\036\b\000\000\000\000\241Ó³\000\314\326\363\262\244\351\036\b", ‘\000’ <repeats 12 times>, “p\326\363\262\000\000\000\000\000\000\000\000”…
e = 0xb650c320
app = 0x9600d28
res = 10246719
q = {incstack = {0x0 <repeats 128 times>}, stacklen = 0, status = 5, swo = 0x0, data = 0x0,
foundcontext = 0xb3024bc4 “macro-dialout-trunk-predial-hook”}
passdata = “\000?Set(CALLERPRES()=prohib_passed_screen)\000г\000\062\070\060\070\000\000\000\000\000Ac\tefault\000/7821\000\000\000\000om-ccss-)\000vm\004\000\000\000\000\000\000\000 \367\363\262\241Ó³\000\374\366\363\262\220\366\363\262\000\000\000\000\037\006\000\000\000\000\000\000\037\006\000\000\000\000\000\000\000\000\000\000\377\377\377\377\372\342\356\000\371\342\356\000\000\000\000\000&”, ‘\000’ <repeats 15 times>, “\n\000\000\000\323\365\363\262”, ‘\000’ <repeats 40 times>, " “, ‘\000’ <repeats 11 times>, “X\361\363\262\rS\bd\240\276R\t\000\000\000\000\223\233\n\b\214\361\363\262\260\365\034\b\000\000\000\000\370\372ó²\n\b\240\276R\t\214\361\363\262”, ‘\000’ <repeats 16 times>, “\b”, ‘\000’ <repeats 63 times>…
matching_action = 0
PRETTY_FUNCTION = “pbx_extension_helper”
#12 0x0814425b in ast_spawn_extension (c=0xb3024858, context=0xb3024bc4 “macro-dialout-trunk-predial-hook”, exten=0xb3024c14 “s”, priority=1,
callerid=0xb3021478 “7406707941”, found=0xb2f4141c, combined_find_spawn=1) at pbx.c:4904
No locals.
#13 0x009c4405 in macro_exec (chan=0xb3024858, data=0xb2f43ec8 “dialout-trunk-predial-hook,”, exclusive=0) at app_macro.c:413
c = 0xb653a6e0
e = 0xb650c320
foundx = 1
s = 0xb6497ecc "2"
tmp = 0xb2f41310 "dialout-trunk-predial-hook"
cur = 0x0
rest = 0x0
macro = 0xb2f41310 "dialout-trunk-predial-hook"
fullmacro = “macro-dialout-trunk-predial-hook\000\000\000\000\000\000\000\000\002\000\000\000@\233\034\b!\233\034\b\240I\277\267\000\000\000\000\000\000\000\000\371\t\022\bplc\t\002\000\000\000X\034”, <incomplete sequence \364\262>
varname = “ARG1\000I\277\267\240I\277\267\000\000\000\000\221\254\266\000\020\000@\266\000\000\000\000\330\033\364\262p@\b\b\200\231\034\bN\003\000\000\006\233\034\b!\233\034\b\240I\277\267\024L\002\263\330\033\364\262F\375\275\000\240I\277\267\021\000\000\000\370\033”, <incomplete sequence \364\262>
runningapp = "MacroExit\000\000\000\000\000\000\000\001\000\000\000@Y\305\000\000\000\000\000’\254\306\000\000\000\000\000@Y\305\000\000\000\000\000\220\027\000\000\364
\305\000\024L\002\263\304K\002\263\210\033\364\262\026\375\275\000\240I\277\267\021\000\000\000\250\033”, <incomplete sequence \364\262>
runningdata = "\000\000\000\000\020\000@\266\275H\270\000\364
\305\000\376t\302\000\253\032\364\262`\027\364\262\375S\270\000\364
\305\000|\030\364\262u\263\270\000\261\032\364\262n\030\364\262\002\000\000\000\003", ‘\000’ <repeats 23 times>"\277, \r\000\000\000\000\000\000\000\020\000\000\020\000\000\000\000\000\000\000\036\371\270P\000\000\000\000\347J\261N\000\000\000\000\002\000\000\000\000\000\000\000\203\f/\003\000\000\000\000\271\205\302\000\344\027\364\262\307϶\000\004\030\364\262\340O\305\000\001\000\000\000\000\000\000\000\b\000\000\000\006u\302\000\000\000\000\000\000\000\000\000\002\000\000\000\000\000\000\000\033X\270\000\377\377\377\377\000\000\000\000\310LA\266p\030\364\262\242I\270\000\271\205\302", ‘\000’ <repeats 13 times>"\231, \231\231\031\364
\305\000\002\000\000\000\001\000\000\000L\030\364\262\237\343\262\000\263\032\364\262\060\033\364\262\n", ‘\000’ <repeats 11 times>, "\001\000\000\000H\033\364\262\271\205\302\000\364\032\364\262\000\000\000\000\n\000\000\000\275H\270\000\364
\305\000\260\376F\266"…
oldargs = {0x0, 0xb64a26d0 “3”, 0x0 <repeats 79 times>}
argc = 2
x = -1
res = 0
oldexten = “s”, ‘\000’ <repeats 254 times>
oldpriority = 17
gosub_level = 0
pc = “17\000\000\354\032\364\262a\361\036\b\002\000\000\000\000\000\000\000\024\032\364\262\217г\000\000\000\000\000(\000\000\000\E\267\000\240\032\364\262\030\001e\t\000\000\000\000\064\032\364\262\217г\000P\033\364\262\001”, ‘\000’ <repeats 14 times>
depthc = “2\000\036\bp\032\364\262\310\032”, <incomplete sequence \364\262>
oldcontext = “macro-dialout-trunk”, ‘\000’ <repeats 60 times>
inhangupc = 0x0
offset = 11953859
depth = 1
maxdepth = 7
setmacrocontext = 0
autoloopflag = 512
inhangup = 0
tmp_subst = 0xb64a6800
save_macro_exten = 0xb2d4f7d8 "93443779"
save_macro_context = 0xb6492498 “from-internal-xfer”

    save_macro_priority = 0xb64b0838 "5"
    save_macro_offset = 0x0
    macro_store = 0x97badb0
    __PRETTY_FUNCTION__ = "_macro_exec"

#14 0x009c565e in macro_exec (chan=0xb3024858, data=0xb2f43ec8 “dialout-trunk-predial-hook,”) at app_macro.c:586
No locals.
#15 0x08138ecf in pbx_exec (c=0xb3024858, app=0x960ea80, data=0xb2f43ec8 “dialout-trunk-predial-hook,”) at pbx.c:1446
res = 0
u = 0xb646feb0
saved_c_appl = 0x960eab0 “Macro"
saved_c_data = 0xb2f48d38 “dialout-trunk,3,3443779,“
PRETTY_FUNCTION = “pbx_exec”
#16 0x081425c5 in pbx_extension_helper (c=0xb3024858, con=0x0, context=0xb3024bc4 “macro-dialout-trunk-predial-hook”, exten=0xb3024c14 “s”, priority=17,
label=0x0, callerid=0xb3021478 “7406707941”, action=E_SPAWN, found=0xb2f4628c, combined_find_spawn=1) at pbx.c:4266
e = 0xb6a37640
app = 0x960ea80
res = 10246719
q = {incstack = {0x0 <repeats 128 times>}, stacklen = 0, status = 5, swo = 0x0, data = 0x0,
foundcontext = 0xb3024bc4 “macro-dialout-trunk-predial-hook”}
passdata = “dialout-trunk-predial-hook,\000onfirm))\000efault))\000\000/7941_@from-ccss-)\000ernal-xfer,)\000-)\000l-queue-toggle,)”, ‘\000’ <repeats 14 times>”\303, f\266”, ‘\000’ <repeats 13 times>”\356, ~\265\000/\245\212\t\000\000\000\000\260\367\222\t\364_\305\000\244\351\036\b\000\000\000\000\210E\364\262\241Ó³\000\254E\364\262\244\351\036\b", ‘\000’ <repeats 28 times>, “`E\364\262\000\000\000\000\000\000\000\000\364D\364\262\217г”, ‘\000’ <repeats 49 times>, “@F\364\262”, ‘\000’ <repeats 36 times>"\377, \377\377\377\243\351\036\b\242\351\036\b\000\000\000\000\035", ‘\000’ <repeats 23 times>"\364"…
matching_action = 0
PRETTY_FUNCTION = “pbx_extension_helper”
#17 0x0814425b in ast_spawn_extension (c=0xb3024858, context=0xb3024bc4 “macro-dialout-trunk-predial-hook”, exten=0xb3024c14 “s”, priority=17,
callerid=0xb3021478 “7406707941”, found=0xb2f4628c, combined_find_spawn=1) at pbx.c:4904
No locals.
#18 0x009c4405 in macro_exec (chan=0xb3024858, data=0xb2f48d38 “dialout-trunk,3,3443779,”, exclusive=0) at app_macro.c:413
c = 0xb6cb7828
e = 0xb6a37640
foundx = 1
s = 0x98a398c "0"
tmp = 0xb2f46180 "dialout-trunk"
cur = 0x0
rest = 0x0
macro = 0xb2f46180 "dialout-trunk"
fullmacro = “macro-dialout-trunk\000!\233\034\b\240I\277\267\250j\364\262\020\000\000\000\000\000\000\000\002\000\000\000@\233\034\b!\233\034\b\240I\277\267\000\000\000\000\000\000\000\000\371\t\022\bplc\t\002\000\000\000\310j”, <incomplete sequence \364\262>
varname = “ARG3\000I\277\267\240I\277\267\000\000\000\000\221\254\266\000\020\000@\266\000\000\000\000Hj\364\262p@\b\b\200\231\034\bN\003\000\000\006\233\034\b!\233\034\b\240I\277\267\024L\002\263Hj\364\262F\375\275\000\240I\277\267\005\000\000\000hj”, <incomplete sequence \364\262>
runningapp = “Macro\000\000\000\001”, ‘\000’ <repeats 11 times>, "@Y\305\000\000\000\000\000’\254\306\000\000\000\000\000@Y\305\000\000\000\000\000\220\027\000\000\364
\305\000\024L\002\263\304K\002\263\370i\364\262\026\375\275\000\240I\277\267\005\000\000\000\030j", <incomplete sequence \364\262>
runningdata = “dialout-trunk-predial-hook,\000et(DIAL_TRUNK_OPTIONS=${DIAL_TRUNK_OPTIONS}M(confirm))\000RUNK_OPTIONS=M(setmusic^${MOHCLASS})${DIAL_TRUNK_OPTIONS})\000\266\000tf\364\262\340O\305\000\001\000\000\000\000\000\000\000\b\000\000\000\006u\302\000\000\000\000\000\000\000\000\000\002\000\000\000\000\000\000\000\033X\270\000\377\377\377\377\000\000\000\000 6F\266\340f\364\262\242I\270\000\271\205\302”, ‘\000’ <repeats 13 times>"\220"…
oldargs = {0x0 <repeats 81 times>}
argc = 4
x = -1
res = 0
oldexten = “93443779”, ‘\000’ <repeats 247 times>
oldpriority = 5
gosub_level = 0
pc = "5\000\263\000\i\364\262a\361\036\b\002\000\000\000\000\000\000\000\204h\364\262\217г\000\000\000\000\000\000\000\000\000\377\377\377\377\020i\364\262@/\037\b\000\000\000\000\244h\364\262\217г\000\300i\364\262\001\000\000\000&\000\000\000\000\000\000\000\000\000\000"
depthc = “1\000\036\b\340h\364\262\070i”, <incomplete sequence \364\262>
oldcontext = “from-internal-xfer”, ‘\000’ <repeats 61 times>
inhangupc = 0x0
offset = 11953859

    offset = 11953859

—Type to continue, or q to quit—
depth = 0
maxdepth = 7
setmacrocontext = 1
autoloopflag = 512
inhangup = 0
tmp_subst = 0xb64dc190
save_macro_exten = 0x0
save_macro_context = 0x0
save_macro_priority = 0x0
save_macro_offset = 0x0
macro_store = 0x97badb0
PRETTY_FUNCTION = “macro_exec"
#19 0x009c565e in macro_exec (chan=0xb3024858, data=0xb2f48d38 “dialout-trunk,3,3443779,”) at app_macro.c:586
No locals.
#20 0x08138ecf in pbx_exec (c=0xb3024858, app=0x960ea80, data=0xb2f48d38 “dialout-trunk,3,3443779,”) at pbx.c:1446
res = 0
u = 0xb649bd68
saved_c_appl = 0x0
saved_c_data = 0x0
PRETTY_FUNCTION = “pbx_exec”
#21 0x081425c5 in pbx_extension_helper (c=0xb3024858, con=0x0, context=0xb3024bc4 “macro-dialout-trunk-predial-hook”, exten=0xb3024c14 “s”, priority=5,
label=0x0, callerid=0x978ef28 “\260\003h\t”, action=E_SPAWN, found=0xb2f4b250, combined_find_spawn=1) at pbx.c:4266
e = 0xb6418f10
app = 0x960ea80
res = 1
q = {incstack = {0xb6a15940 “from-internal-xfer”, 0xb6aff438 “from-internal-additional”, 0xb2d74508 “app-callwaiting-cwoff”,
0x9a09e48 “app-callwaiting-cwon”, 0x99fb488 “app-fax”, 0xb6c3f080 “ext-queues”, 0xb2d59878 “app-queue-toggle”, 0xb2d42f28 “app-dictate-record”,
0x986b8b8 “app-dictate-send”, 0xb6c321e0 “app-recordings”, 0x961be30 “app-speeddial”, 0xb6c2e7a8 “app-calltrace”, 0xb2d3d0f0 “app-echo-test”,
0x961b2f8 “app-speakextennum”, 0xb6abbf40 “app-speakingclock”, 0xb6ac6f30 “app-pbdirectory”, 0x9a129e0 “app-dnd-off”, 0x9a02e90 “app-dnd-on”,
0xb6adf118 “app-dnd-toggle”, 0xb2d37188 “ext-intercom-users”, 0xb7b3b6d0 “app-cf-busy-off”, 0xb7b3a570 “app-cf-busy-off-any”,
0xb6790740 “app-cf-busy-on”, 0xb6a9d888 “app-cf-off”, 0xb2d35390 “app-cf-off-any”, 0xb6c6ccd0 “app-cf-on”, 0x9856078 “app-cf-unavailable-off”,
0xb7b37590 “app-cf-unavailable-on”, 0xb678f140 “app-cf-toggle”, 0xb7beda40 “ext-group”, 0x9856988 “app-dialvm”, 0x9856f08 “app-vmmain”,
0xb678b4d0 “timeconditions-toggles”, 0x98501a0 “app-blacklist”, 0xb678aad8 “app-campon-cancel”, 0xb678a4e8 “app-campon-request”,
0xb6789f80 “app-campon-toggle”, 0xb6cbf1f8 “app-fmf-toggle”, 0x96a2660 “ext-findmefollow”, 0x9699710 “fmgrps”, 0xb6cbbdf0 “app-userlogonoff”,
0xb6cbc178 “ext-local-confirm”, 0xb64e7538 “findmefollow-ringallv2”, 0x96d9fc0 “app-pickup”, 0xb652ac38 “app-zapbarge”,
0xb652b588 “app-chanspy”, 0xb652b9e0 “ext-test”, 0xb6cbc6a8 “ext-local”, 0xb6c978a8 “outbound-allroutes”, 0x0 <repeats 79 times>},
stacklen = 49, status = 5, swo = 0x0, data = 0x0, foundcontext = 0xb6cc4468 “outrt-2”}
passdata = "dialout-trunk,3,3443779,\000,7941)\000)\000\060\061\062\061\061\063\060-132122-1354299674.4094\000
\305\000\317\320\036\b\000\000\000\000\250\223\364\262\241Ó³\000Ì\364\262\317\320\036\b\000\000\000\000\340\216\364\262\340\216\364\262\356\216\364\262\377\377\377\377\340\216\364\262\377\377\377\377\200\223\364\262\000\000\000\000\000\000\000\000\024\223\364\262\217г\000\000\000\000\000\000\000\000\000\rx\266\000\000\000\000\262\000\000\000\000\006\226\364\262\064\223\364\262\217г\000\020\216\364\262\000\000\000\000\374\216\364\262$\025\266\000`\224\364\262\204\205\302\000\060\217\364\262\347\225\364\262\000\000\000\000\260\216\364\262\037\000\000\000\001\200\255\373\200\224\364\262\000\000\000\000\377\377\377\377\316\320\036\b\315\320\036\b\000\000\000\000\v”, ‘\000’ <repeats 11 times>, “T\216\364\262.p\264\000\340\216\364\262”, ‘\000’ <repeats 40 times>, " \000\000\000\065", ‘\000’ <repeats 14 times>, “s\r”, ‘\000’ <repeats 11 times>…
matching_action = 0
PRETTY_FUNCTION = “pbx_extension_helper”
#22 0x0814425b in ast_spawn_extension (c=0xb3024858, context=0xb3024bc4 “macro-dialout-trunk-predial-hook”, exten=0xb3024c14 “s”, priority=5,
callerid=0x978ef28 “\260\003h\t”, found=0xb2f4b250, combined_find_spawn=1) at pbx.c:4904
No locals.
#23 0x08144c5a in __ast_pbx_run (c=0xb3024858, args=0x0) at pbx.c:5007
digit = 0
invalid = 0
timeout = 0
dst_exten = “\000|~\266\200|~\266È°\364\262\060\266\021\bP|~\266P|~\266\350\260\364\262\200|~\266\000\000\000\000\254\261\364\262\b\261\364\262uD\b\bP|~\266\016\001\000\000J\232\034\bu\232\034\bP|~\266\000\000\000\000\370\260\364\262\246\374\275\000\214\261\364\262\001\000\000\000\030\261\364\262P|~\266\000\000\000\000\001\000\000\000\030\261\364\262rC\b\b\200|~\266\377\377\377\377ȱ\364\262\370\336\022\b\200|~\266\377\377\377\377\223\263\036\b\220\264\036\b\214\261\364\262\214\261\364\262”, ‘\000’ <repeats 16 times>, "\004E\266\000\366\377\274\000\276e\266\000\000\060\365\267\000\020\000\000\001\000\000\000\002\000\243\266\177\000\000\0

label=0x0, callerid=0x978ef28 “\260\003h\t”, action=E_SPAWN, found=0xb2f4b250, combined_find_spawn=1) at pbx.c:4266
e = 0xb6418f10
app = 0x960ea80
res = 1
q = {incstack = {0xb6a15940 “from-internal-xfer”, 0xb6aff438 “from-internal-additional”, 0xb2d74508 “app-callwaiting-cwoff”,
0x9a09e48 “app-callwaiting-cwon”, 0x99fb488 “app-fax”, 0xb6c3f080 “ext-queues”, 0xb2d59878 “app-queue-toggle”, 0xb2d42f28 “app-dictate-record”,
0x986b8b8 “app-dictate-send”, 0xb6c321e0 “app-recordings”, 0x961be30 “app-speeddial”, 0xb6c2e7a8 “app-calltrace”, 0xb2d3d0f0 “app-echo-test”,
0x961b2f8 “app-speakextennum”, 0xb6abbf40 “app-speakingclock”, 0xb6ac6f30 “app-pbdirectory”, 0x9a129e0 “app-dnd-off”, 0x9a02e90 “app-dnd-on”,
0xb6adf118 “app-dnd-toggle”, 0xb2d37188 “ext-intercom-users”, 0xb7b3b6d0 “app-cf-busy-off”, 0xb7b3a570 “app-cf-busy-off-any”,
0xb6790740 “app-cf-busy-on”, 0xb6a9d888 “app-cf-off”, 0xb2d35390 “app-cf-off-any”, 0xb6c6ccd0 “app-cf-on”, 0x9856078 “app-cf-unavailable-off”,
0xb7b37590 “app-cf-unavailable-on”, 0xb678f140 “app-cf-toggle”, 0xb7beda40 “ext-group”, 0x9856988 “app-dialvm”, 0x9856f08 “app-vmmain”,
0xb678b4d0 “timeconditions-toggles”, 0x98501a0 “app-blacklist”, 0xb678aad8 “app-campon-cancel”, 0xb678a4e8 “app-campon-request”,
0xb6789f80 “app-campon-toggle”, 0xb6cbf1f8 “app-fmf-toggle”, 0x96a2660 “ext-findmefollow”, 0x9699710 “fmgrps”, 0xb6cbbdf0 “app-userlogonoff”,
0xb6cbc178 “ext-local-confirm”, 0xb64e7538 “findmefollow-ringallv2”, 0x96d9fc0 “app-pickup”, 0xb652ac38 “app-zapbarge”,
0xb652b588 “app-chanspy”, 0xb652b9e0 “ext-test”, 0xb6cbc6a8 “ext-local”, 0xb6c978a8 “outbound-allroutes”, 0x0 <repeats 79 times>},
stacklen = 49, status = 5, swo = 0x0, data = 0x0, foundcontext = 0xb6cc4468 “outrt-2”}
passdata = “dialout-trunk,3,3443779,\000,7941)\000)\000\060\061\062\061\061\063\060-132122-1354299674.4094\000_\305\000\317\320\036\b\000\000\000\000\250\223\364\262\241Ó³\000Ì\364\262\317\320\036\b\000\000\000\000\340\216\364\262\340\216\364\262\356\216\364\262\377\377\377\377\340\216\364\262\377\377\377\377\200\223\364\262\000\000\000\000\000\000\000\000\024\223\364\262\217г\000\000\000\000\000\000\000\000\000\rx\266\000\000\000\000\262\000\000\000\000\006\226\364\262\064\223\364\262\217г\000\020\216\364\262\000\000\000\000\374\216\364\262$\025\266\000`\224\364\262\204\205\302\000\060\217\364\262\347\225\364\262\000\000\000\000\260\216\364\262\037\000\000\000\001\200\255\373\200\224\364\262\000\000\000\000\377\377\377\377\316\320\036\b\315\320\036\b\000\000\000\000\v”, ‘\000’ <repeats 11 times>, “T\216\364\262.p\264\000\340\216\364\262”, ‘\000’ <repeats 40 times>, " \000\000\000\065", ‘\000’ <repeats 14 times>, “s\r”, ‘\000’ <repeats 11 times>…
matching_action = 0
PRETTY_FUNCTION = “pbx_extension_helper”
#22 0x0814425b in ast_spawn_extension (c=0xb3024858, context=0xb3024bc4 “macro-dialout-trunk-predial-hook”, exten=0xb3024c14 “s”, priority=5,
callerid=0x978ef28 “\260\003h\t”, found=0xb2f4b250, combined_find_spawn=1) at pbx.c:4904
No locals.
#23 0x08144c5a in __ast_pbx_run (c=0xb3024858, args=0x0) at pbx.c:5007
digit = 0
invalid = 0
timeout = 0
dst_exten = “\000|~\266\200|~\266È°\364\262\060\266\021\bP|~\266P|~\266\350\260\364\262\200|~\266\000\000\000\000\254\261\364\262\b\261\364\262uD\b\bP|~\266\016\001\000\000J\232\034\bu\232\034\bP|~\266\000\000\000\000\370\260\364\262\246\374\275\000\214\261\364\262\001\000\000\000\030\261\364\262P|~\266\000\000\000\000\001\000\000\000\030\261\364\262rC\b\b\200|~\266\377\377\377\377ȱ\364\262\370\336\022\b\200|~\266\377\377\377\377\223\263\036\b\220\264\036\b\214\261\364\262\214\261\364\262”, ‘\000’ <repeats 16 times>, “\004E\266\000\366\377\274\000\276e\266\000\000\060\365\267\000\020\000\000\001\000\000\000\002\000\243\266\177\000\000\001\000\000\000\000\000\000\000\000\300\277z\t\200|~\266\200\220k\t\343”, ‘\000’ <repeats 27 times>"\377, \377\377\377\000\000\000"
pos = 0
—Type to continue, or q to quit—
found = 1
res = 0
autoloopflag = 0
error = 0
PRETTY_FUNCTION = “__ast_pbx_run”
#24 0x08146915 in pbx_thread (data=0xb3024858) at pbx.c:5348
c = 0xb3024858
#25 0x081994bc in dummy_start (data=0xb7b69740) at utils.c:1012
__cancel_buf = {__cancel_jmp_buf = {{__cancel_jmp_buf = {13078516, 0, -1292584048, -1292586056, 1015868195, -2040410881}, __mask_was_saved = 0}},
__pad = {0xb2f4b470, 0x0, 0x0, 0x0}}
__cancel_routine = 0x8078b93 <ast_unregister_thread>
__cancel_arg = 0xb2f4bb90
not_first_call = 0
ret = 0xc135ce
a = {start_routine = 0x81468f6 <pbx_thread>, data = 0xb3024858,
name = 0xb7deee88 “pbx_thread”, ’ ’ <repeats 11 times>, “started at [ 5374] pbx.c ast_pbx_start()”}
#26 0x00c68832 in start_thread () from /lib/libpthread.so.0
No symbol table info available.
#27 0x00bd34de in clone () from /lib/libc.so.6
No symbol table info available.

SCCP-Chan-b must be compiled against the same version of Asterisk with essentially the same configuration options. On the other hand, crashes because of version mismatches tend to be at load time.

The crash you have is an abort call in the memory allocator. That means that memory has been corrupted. Unfortunately these can be difficult to track down, because the damage can occur a significant time before the crash.

After making sure that you have compiled everything in the same context, look for any messages about locking failures. Enabling the thread debugging compile option will give you better information in this respect, but does have a performance impact.

If you can reproduce the problem easily, you will advised to run Asterisk under valgrind. This will make it extremely slow, but is the preferred method of getting information for memory corruption faults.

Once you have gathered evidence, the correct place to report this is on issues.asterisk.org/jira. Unfortunately, you will need more information than you have obtained so far before it is likely to get progressed. Basically the backtrace may be totally unrelated to the root cause, except in as much as it uses the memory allocator.