Mute and unmute speaker volume from any one direction

Hi,
I am trying to create an IVR in which my requirement is, to mute the volume of speakers from any one direction either into the PBX or out from PBX in a conference call where only the customer could hear the the IVR but not the agent.