Huh… Involuntary contraction of the cremaster muscle? I dunno. Funny how “shrinkage” is so much shorter (pun!?) and yet so much more descriptive of the phenomenon…
As far as I know the closest thing is the cremasteric reflex, although that doesn’t fully account for everything that happens when the water is really cold!