Also check if soft clipping is activated. Or if the volume is set too loud and the plugin clips, you could get some artifacts.
If none of these solve the problem, try out the kit I attached, drag and drop samples onto pads and see if it sounds like you want. You'll have pitch, attack, attack slope, hold, decay, decay slope as control parameters.
Hold won't be a conventional "hold" parameter, it is a time during which the envelope is at full volume (envelope has no effect)
So attack at 0, hold set to max should give you a clean sample player.