Aftertouch mod active when sound is loaded

I like using aftertouch and add it to organs, pianos, synths, etc. to modify the sound when activated. What I don’t understand is why it sounds active when the sound is first loaded. I have to press hard to de-activate it so it’s there when I want to use it later in the song when pressing hard and activating an effect or whatev. The default should be the aftertouch mod is off when the sound is first loaded and activates when pressing hard. Am I missing something?