Override modulation track when playing other notes

I’m trying to play notes over a sequence with a modulation track on the attack. I would like to use a different attack settings for the notes that I play “live”.
Is it possible to make the modulation track act only on the sequenced notes?