IAX unreachable / reachable

Hey Guys got a hold of a real nice issue here. I am tyring to figure out why my IAX channel to my other server goes dead then comes back. Here is a snipt of my log.

[May 12 11:16:28] NOTICE[19494] chan_iax2.c: Peer 'AnnArbor' is now UNREACHABLE! Time: 75
[May 12 11:19:18] NOTICE[19497] chan_iax2.c: Peer 'AnnArbor' is now REACHABLE! Time: 73
[May 12 11:35:24] NOTICE[19496] chan_iax2.c: Peer 'AnnArbor' is now UNREACHABLE! Time: 72
[May 12 11:36:34] NOTICE[19499] chan_iax2.c: Peer 'AnnArbor' is now REACHABLE! Time: 81
[May 12 11:37:38] NOTICE[19497] chan_iax2.c: Peer 'AnnArbor' is now UNREACHABLE! Time: 81
[May 12 11:37:48] NOTICE[19493] chan_iax2.c: Peer 'AnnArbor' is now REACHABLE! Time: 82
[May 12 11:39:52] NOTICE[19498] chan_iax2.c: Peer 'AnnArbor' is now UNREACHABLE! Time: 73
[May 12 11:40:02] NOTICE[19491] chan_iax2.c: Peer 'AnnArbor' is now REACHABLE! Time: 82
[May 12 11:41:06] NOTICE[19498] chan_iax2.c: Peer 'AnnArbor' is now UNREACHABLE! Time: 82

Any help is appreciated. This one has been a tough one. Any more information that It will take to get this issue fixed I will post. I also will post information from a tcpdump that I will be doing.