You also need to provide details of the codecs that you would accept.
Which of chan_pjsip, or the, deprecated, chan_sip driver you are using may also affect the behaviour.
Asterisk will send not acceptable here if none of the codecs are in those you have configured to allow. It will also send it if you have insisted on a certain type of media security but the caller is unable to provide it.