The Contact header in an outgoing request is a SIP URI that Asterisk can be reached at for subsequent in-dialog requests. It should not be the endpoint that is being called.
The rewrite_contact option rewrites incoming Contact headers to the actual source IP address and port which helps with NAT.