Paused response from input

I have an IAXy hooked to my Asterisk PBX (running on a 3GHz P4) and setup a simple extensions.conf so that pressing * plays the SPAM sound file to test my setup.

However, there is a pause before it starts playing the sound file. Is there any way to remove the pauses?

I don’t get the pause if I map it to the # key.