I have this problem too. On a LOCAL network; this problem does not happen. Only when I try to attach SIP devices over a VPN.
I tried many things, too many to remember. For certain, NAT=NO does not fix it. I am now seeking professional help from my network consultant to track and trace the network activity testing the difference in conditions locallay VS vpn.