Ran into an issue today where Asterisk had 1023 files open and couldn’t open any more, due to the limit being 1024.
Not sure if there are any bugs in play here or not - realizing that stuff like ulimit is configurable - but I’ve never run into any kind of fd limit before so this seems odd to me.
What would be the typical causes of a large number of file descriptors being held open by Asterisk of type “socket”, as seen below?
Additionally, is there a way in Asterisk to get further information about what these open sockets are for, like what module it’s for?
top - 00:13:21 up 3 days, 22:01, 17 users, load average: 0.32, 0.17, 0.07
Tasks: 174 total, 1 running, 173 sleeping, 0 stopped, 0 zombie
%Cpu(s): 3.1 us, 1.7 sy, 0.0 ni, 93.9 id, 1.0 wa, 0.0 hi, 0.3 si, 0.0 st
MiB Mem : 978.8 total, 110.7 free, 401.6 used, 466.5 buff/cache
MiB Swap: 1024.0 total, 418.2 free, 605.8 used. 416.4 avail Mem
PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
1901 asterisk 20 0 845540 56948 10336 S 3.3 5.7 142:09.64 asterisk
root@voip:~# ls -l /proc/1901/fd
total 0
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 0 -> /dev/null
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 1 -> /dev/null
l-wx------ 1 asterisk asterisk 64 Mar 8 00:13 10 -> /var/log/asterisk/db
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 100 -> 'socket:[4421680]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 1000 -> 'socket:[12250064]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 1001 -> 'socket:[12266389]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 1002 -> 'socket:[12266390]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 1003 -> 'socket:[12266397]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 1004 -> 'socket:[12293107]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 1005 -> 'socket:[10035101]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 1006 -> 'socket:[10035102]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 1007 -> 'socket:[10035109]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 1008 -> 'socket:[12293108]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 1009 -> 'socket:[12293116]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 101 -> 'socket:[4654261]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 1010 -> 'socket:[12340880]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 1011 -> 'socket:[10110580]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 1012 -> 'socket:[10110581]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 1013 -> 'socket:[10110588]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 1014 -> 'socket:[18155691]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 1015 -> 'socket:[10145946]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 1016 -> 'socket:[10145947]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 1017 -> 'socket:[10145954]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 1018 -> 'socket:[18155692]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 102 -> 'socket:[4654268]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 1020 -> 'anon_inode:[timerfd]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 1021 -> 'anon_inode:[eventfd]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 1022 -> 'anon_inode:[timerfd]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 1023 -> 'anon_inode:[eventfd]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 103 -> 'socket:[4812150]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 104 -> 'socket:[4666517]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 105 -> 'socket:[4666518]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 106 -> 'socket:[4072276]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 107 -> 'socket:[4072277]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 108 -> 'socket:[4072284]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 109 -> 'socket:[4666525]'
l-wx------ 1 asterisk asterisk 64 Mar 8 00:13 11 -> '/var/log/asterisk/full.1 (deleted)'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 110 -> 'socket:[4423621]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 111 -> 'socket:[4661551]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 112 -> 'socket:[4661552]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 113 -> 'socket:[4423622]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 114 -> 'socket:[4655391]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 115 -> 'socket:[4655392]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 116 -> 'socket:[4655399]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 117 -> 'socket:[4423629]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 118 -> 'socket:[4437680]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 119 -> 'socket:[4428942]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 12 -> 'socket:[3710092]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 120 -> 'socket:[4428943]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 121 -> 'socket:[4428950]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 122 -> 'socket:[4437681]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 123 -> 'socket:[4437697]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 124 -> 'socket:[4482932]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 125 -> 'socket:[4482933]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 126 -> 'socket:[4482940]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 127 -> 'socket:[4661559]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 128 -> 'socket:[4658150]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 129 -> 'socket:[4658157]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 13 -> 'anon_inode:[eventpoll]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 130 -> 'socket:[4768097]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 131 -> 'socket:[4768098]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 132 -> 'socket:[4768105]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 133 -> 'socket:[4789477]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 134 -> 'socket:[4789478]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 135 -> 'socket:[4789484]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 136 -> 'socket:[4812151]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 137 -> 'socket:[4812158]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 138 -> 'socket:[5204927]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 139 -> 'socket:[4631736]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 14 -> 'socket:[3710129]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 140 -> 'socket:[4631737]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 141 -> 'socket:[4631744]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 142 -> 'anon_inode:[timerfd]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 143 -> 'socket:[4636025]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 144 -> 'socket:[4636026]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 145 -> 'socket:[4636033]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 146 -> 'socket:[4845941]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 147 -> 'anon_inode:[timerfd]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 148 -> 'socket:[4656055]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 149 -> 'socket:[4656056]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 15 -> 'socket:[3710130]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 150 -> 'socket:[4656063]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 151 -> 'socket:[4864574]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 152 -> 'socket:[7020945]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 153 -> 'socket:[4662130]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 154 -> 'socket:[4662131]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 155 -> 'socket:[4662138]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 156 -> 'socket:[4665112]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 157 -> 'socket:[4831643]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 158 -> 'socket:[4831644]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 159 -> 'socket:[4664612]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 16 -> 'socket:[5329090]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 160 -> 'socket:[4637990]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 161 -> 'socket:[4637991]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 162 -> 'socket:[4637998]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 163 -> 'socket:[4434132]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 164 -> 'socket:[4664613]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 165 -> 'socket:[4664620]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 166 -> 'socket:[4646273]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 167 -> 'socket:[4646274]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 168 -> 'socket:[4646281]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 169 -> 'socket:[4665113]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 17 -> 'socket:[3710112]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 170 -> 'socket:[4831651]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 171 -> 'socket:[4665120]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 172 -> 'socket:[4864575]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 173 -> 'socket:[4434133]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 174 -> 'socket:[4864581]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 175 -> 'socket:[4434140]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 176 -> 'anon_inode:[eventfd]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 177 -> 'socket:[4883080]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 178 -> 'socket:[4883081]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 179 -> 'socket:[4883088]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 18 -> 'socket:[3710116]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 180 -> 'anon_inode:[timerfd]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 181 -> 'anon_inode:[eventfd]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 182 -> 'anon_inode:[timerfd]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 183 -> 'anon_inode:[eventfd]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 184 -> 'anon_inode:[timerfd]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 185 -> 'anon_inode:[eventfd]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 186 -> 'anon_inode:[eventfd]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 187 -> 'anon_inode:[eventfd]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 188 -> 'socket:[5146443]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 189 -> 'socket:[4434387]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 19 -> 'socket:[3710120]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 190 -> 'socket:[4434388]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 191 -> 'socket:[4434395]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 192 -> 'socket:[5146444]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 193 -> 'socket:[4922130]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 194 -> 'socket:[4916845]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 195 -> 'socket:[4916846]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 196 -> 'socket:[4916853]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 197 -> 'socket:[4922131]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 198 -> 'socket:[4922138]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 199 -> 'socket:[5146450]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 2 -> /dev/null
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 20 -> 'socket:[3710123]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 200 -> 'socket:[5204928]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 201 -> 'socket:[4703912]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 202 -> 'socket:[4703913]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 203 -> 'socket:[4703920]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 204 -> 'socket:[4830878]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 205 -> 'socket:[5204937]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 206 -> 'socket:[5205869]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 207 -> 'socket:[5205876]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 208 -> 'socket:[5663223]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 209 -> 'socket:[5613759]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 21 -> 'anon_inode:[timerfd]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 210 -> 'socket:[5234940]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 211 -> 'socket:[5206755]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 212 -> 'socket:[4884114]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 213 -> 'socket:[4884115]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 214 -> 'socket:[4845942]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 215 -> 'socket:[4845949]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 216 -> 'socket:[4825214]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 217 -> 'socket:[4825215]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 218 -> 'socket:[4825222]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 219 -> 'socket:[4847460]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 22 -> 'socket:[3710131]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 220 -> 'socket:[4884122]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 221 -> 'socket:[4847461]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 222 -> 'socket:[4847468]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 223 -> 'socket:[5206756]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 224 -> 'socket:[4818565]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 225 -> 'socket:[4818566]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 226 -> 'socket:[4818573]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 227 -> 'socket:[5206763]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 228 -> 'socket:[5234941]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 229 -> 'socket:[5234948]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 23 -> 'socket:[3710132]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 230 -> 'socket:[4875400]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 231 -> 'socket:[4875401]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 232 -> 'socket:[5534581]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 233 -> 'socket:[4875408]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 234 -> 'socket:[5534582]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 235 -> 'socket:[5534589]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 236 -> 'socket:[5370373]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 237 -> 'socket:[5535544]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 238 -> 'socket:[5535545]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 239 -> 'socket:[5535552]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 24 -> 'socket:[3710133]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 240 -> 'socket:[5613760]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 241 -> 'socket:[5613767]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 242 -> 'socket:[5663224]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 243 -> 'socket:[4830879]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 244 -> 'socket:[4830886]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 245 -> 'socket:[5615353]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 246 -> 'socket:[5615354]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 247 -> 'socket:[5615361]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 248 -> 'socket:[5617022]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 249 -> 'socket:[5617023]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 25 -> 'socket:[3710134]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 250 -> 'socket:[5370374]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 251 -> 'socket:[4875652]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 252 -> 'socket:[4832515]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 253 -> 'socket:[4832516]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 254 -> 'socket:[4832523]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 255 -> 'socket:[4875653]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 256 -> 'socket:[4875660]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 257 -> 'socket:[5370382]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 258 -> 'socket:[4826468]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 259 -> 'socket:[4826469]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 26 -> 'anon_inode:[eventpoll]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 260 -> 'socket:[4826476]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 261 -> 'socket:[5094844]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 262 -> 'socket:[5048110]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 263 -> 'socket:[5048111]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 264 -> 'socket:[5048118]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 265 -> 'socket:[5052627]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 266 -> 'socket:[5052628]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 267 -> 'socket:[5052635]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 268 -> 'socket:[5085118]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 269 -> 'socket:[5085119]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 27 -> 'socket:[3710182]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 270 -> 'socket:[5085126]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 271 -> 'socket:[5094845]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 272 -> 'socket:[5094852]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 273 -> 'socket:[5617030]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 274 -> 'socket:[5619348]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 275 -> 'socket:[5619349]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 276 -> 'socket:[5619356]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 277 -> 'socket:[5663231]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 278 -> 'socket:[5797187]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 279 -> 'socket:[5797188]'
lr-x------ 1 asterisk asterisk 64 Mar 8 00:13 28 -> /REDACTED.ulaw
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 280 -> 'socket:[4877815]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 281 -> 'socket:[4877816]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 282 -> 'socket:[4877825]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 283 -> 'socket:[5797195]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 284 -> 'socket:[6216985]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 285 -> 'socket:[6216986]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 286 -> 'socket:[4833076]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 287 -> 'socket:[4833077]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 288 -> 'socket:[4833084]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 289 -> 'socket:[6216993]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 29 -> 'socket:[6754333]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 290 -> 'socket:[6219114]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 291 -> 'socket:[6219115]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 292 -> 'socket:[6219122]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 293 -> 'socket:[7020946]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 294 -> 'socket:[6241713]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 295 -> 'socket:[6241714]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 296 -> 'socket:[6241721]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 297 -> 'socket:[5207566]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 298 -> 'socket:[5207567]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 299 -> 'socket:[5207574]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 3 -> /var/lib/asterisk/astdb.sqlite3
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 30 -> 'socket:[9906224]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 300 -> 'socket:[6416157]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 301 -> 'socket:[6416158]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 302 -> 'socket:[6416164]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 303 -> 'socket:[4878466]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 304 -> 'socket:[4878467]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 305 -> 'socket:[4878474]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 306 -> 'socket:[6419760]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 307 -> 'socket:[6419761]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 308 -> 'socket:[6419768]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 309 -> 'socket:[7020953]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 31 -> 'socket:[8944261]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 310 -> 'socket:[8938241]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 311 -> 'socket:[7023526]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 312 -> 'socket:[7023527]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 313 -> 'socket:[6809407]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 314 -> 'socket:[6809408]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 315 -> 'socket:[7023538]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 316 -> 'socket:[5633615]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 317 -> 'socket:[5633616]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 318 -> 'socket:[5633623]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 319 -> 'socket:[5636083]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 32 -> 'socket:[7834337]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 320 -> 'socket:[5634558]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 321 -> 'socket:[5634559]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 322 -> 'socket:[5634566]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 323 -> 'socket:[5636084]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 324 -> 'socket:[5636091]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 325 -> 'socket:[5636345]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 326 -> 'socket:[5636346]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 327 -> 'socket:[5636353]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 328 -> 'socket:[7035318]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 329 -> 'socket:[5636863]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 33 -> 'socket:[18158548]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 330 -> 'socket:[5636864]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 331 -> 'socket:[5636871]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 332 -> 'socket:[7035319]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 333 -> 'socket:[7204270]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 334 -> 'socket:[7042379]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 335 -> 'socket:[7042380]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 336 -> 'socket:[7042387]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 337 -> 'socket:[7030313]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 338 -> 'socket:[7030314]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 339 -> 'socket:[7030321]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 34 -> 'socket:[7139473]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 340 -> 'socket:[7035326]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 341 -> 'socket:[6809414]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 342 -> 'socket:[7046027]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 343 -> 'socket:[7036170]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 344 -> 'socket:[7207254]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 345 -> 'socket:[7036171]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 346 -> 'socket:[5635115]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 347 -> 'socket:[7036178]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 348 -> 'socket:[5635116]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 349 -> 'socket:[5635123]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 35 -> 'socket:[5968778]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 350 -> 'socket:[8800402]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 351 -> 'socket:[7038177]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 352 -> 'socket:[7485532]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 353 -> 'socket:[7038178]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 354 -> 'socket:[7038185]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 355 -> 'socket:[8263528]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 356 -> 'socket:[5637903]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 357 -> 'socket:[5637904]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 358 -> 'socket:[5637911]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 359 -> 'socket:[7046028]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 36 -> 'socket:[3710325]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 360 -> 'socket:[7017329]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 361 -> 'socket:[6899939]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 362 -> 'socket:[6899940]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 363 -> 'socket:[6899972]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 364 -> 'socket:[7017330]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 365 -> 'socket:[7017337]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 366 -> 'socket:[7046034]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 367 -> 'socket:[7485533]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 368 -> 'socket:[7207261]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 369 -> 'socket:[7198760]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 37 -> 'socket:[7207253]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 370 -> 'socket:[7022332]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 371 -> 'socket:[7022333]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 372 -> 'socket:[7022340]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 373 -> 'socket:[7204271]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 374 -> 'socket:[7485541]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 375 -> 'socket:[7832408]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 376 -> 'socket:[7044592]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 377 -> 'socket:[7204277]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 378 -> 'socket:[7832409]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 379 -> 'socket:[7704571]'
lr-x------ 1 asterisk asterisk 64 Mar 8 00:13 38 -> anon_inode:inotify
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 380 -> 'socket:[7832416]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 381 -> 'socket:[7221990]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 382 -> 'socket:[7184480]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 383 -> 'socket:[7889418]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 384 -> 'socket:[9905476]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 385 -> 'socket:[7834338]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 386 -> 'socket:[7216819]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 387 -> 'socket:[7216820]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 388 -> 'socket:[7216829]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 389 -> 'socket:[7221991]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 39 -> 'socket:[3710329]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 390 -> 'socket:[7221998]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 391 -> 'socket:[7044593]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 392 -> 'socket:[7044600]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 393 -> 'socket:[7043689]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 394 -> 'socket:[7043690]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 395 -> 'socket:[7043697]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 396 -> 'socket:[7314880]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 397 -> 'socket:[7218117]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 398 -> 'socket:[7218118]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 399 -> 'socket:[7462099]'
lr-x------ 1 asterisk asterisk 64 Mar 8 00:13 4 -> /dev/urandom
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 40 -> 'anon_inode:[eventfd]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 400 -> 'socket:[7827074]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 401 -> 'socket:[7827075]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 402 -> 'socket:[7184481]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 403 -> 'socket:[7190315]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 404 -> 'socket:[7190316]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 405 -> 'socket:[7190323]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 406 -> 'socket:[7526077]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 407 -> 'socket:[7526078]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 408 -> 'socket:[7526085]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 409 -> 'socket:[7823097]'
l-wx------ 1 asterisk asterisk 64 Mar 8 00:13 41 -> '/var/log/asterisk/queue_log.1 (deleted)'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 410 -> 'socket:[7634785]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 411 -> 'socket:[7634786]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 412 -> 'socket:[7634794]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 413 -> 'socket:[7649427]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 414 -> 'socket:[7314881]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 415 -> 'socket:[7649428]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 416 -> 'socket:[7462100]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 417 -> 'socket:[7649436]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 418 -> 'socket:[7652421]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 419 -> 'socket:[7652422]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 42 -> 'anon_inode:[eventpoll]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 420 -> 'socket:[7652429]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 421 -> 'socket:[7827082]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 422 -> 'socket:[7181516]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 423 -> 'socket:[7490186]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 424 -> 'socket:[7834344]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 425 -> 'socket:[7314888]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 426 -> 'socket:[7490187]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 427 -> 'socket:[7490194]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 428 -> 'socket:[7325590]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 429 -> 'socket:[7325591]'
lr-x------ 1 asterisk asterisk 64 Mar 8 00:13 43 -> 'pipe:[3710391]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 430 -> 'socket:[7325598]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 431 -> 'socket:[7862642]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 432 -> 'socket:[7851157]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 433 -> 'socket:[7462107]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 434 -> 'socket:[7659165]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 435 -> 'socket:[7659166]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 436 -> 'socket:[7659173]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 437 -> 'socket:[7851158]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 438 -> 'socket:[7218126]'
lrwx------ 1 asterisk asterisk 64 Mar 8 00:13 439 -> 'socket:[7851164]'
.....
snip cut, due to char limit (32000), but LOTS more of this same...