I haven’t noticed. Usually, they are part of the same set.
One bed linens set I have the decorative pillow case that matches the duvet is a different fabric from the pillow case that is the same as the sheets. I use both for sleeping, but usually I use the one that matches the sheets next to my head.
I also have flannel sheets, and one set of pillow cases match, and then I use regular woven cotton pillowcases also to set the bed. I haven’t considered that a mismatch beneath my head would matter.
Mostly, what I think about is if I’m falling asleep with make-up or a lotion on which fabric will clean better, or which fabric would I be more upset if I can’t get all of the make-up off.