Midi sound plays when using soft synths

When I set up a soft synth (any of them) I hear both the general midi sound and the soft synth sound when recording or playing. After I record, when I play back I only hear the soft synth.

How do I turn off the midi sound altogether under all circumstances when using a soft synth. Tried playing with echo buttons but nothing seems to work.

Do you have a keyboard connected via usb as a controller? If so do you have the audio from the keyboard also connected?  if so then do what larry suggested. 

Do you have multiple soft synths running? if so, then you need to assign midi channels to be unique to controller.