Yes, your genetic make up affects those types of things. But so does the setting and nurturing from in-utero through adolescence. And, also your gut biome can also influence many things, and also your body’s adaptation to enviromental stimuli even in late age.
The DNA governs how one’s nerve endings fire and react to stimuli. Neural pathways developed in response to stimuli or lack of stimuli both before and after birth affect how the brain processes such things. One child may find a noisy home disturbing, another finds it comforting.
Research is finding the gut biome has a lot of reaction in how the body processes emotional responses. And there are many studies showing that people who live in a place with col winters feel comfortable at 40 degrees in a t shirt and shorts, ,while someone from Hawaii puts on a sweater at 55.
It is all complicated and interdependent and means there is no simple answer to point to one factor as a reason for something. It is part of the wonder of creation.