Nope. People are more attracted to others that share a number of interests or preferences. I mean, think about it. Would you want to live with someone who hated your music, looked down on the movies you like, thought your work was irresponsible, etc, etc? When we find mates, I believe we are attracted by overt similarities. Even then, those similarities often are not enough to support much of a relationship.
This is especially true, I believe, if sex is the similarity that attracts you. At first, I’m sure, you have a great time, but soon that gets tired and then you are left with a person who you can’t really stand. You accuse them of being shallow, only into the sex, and you take off.
There has to be more to the attraction than one thing, be it sex or taste in music. If you can’t improve on that one thing, your relationship won’t last. However, if you have enough similarities and interests, you can support a relationship with someone who you might hate if they didn’t have the elements you like.