I hear it applied more frivolously than “punk” and god knows there is 1000+ interpretations of what that means. Hipster to one, means something else to another. Maybe you dislike cookie-cutter, walking American Apparel ads (not that I don’t sprinkle some of their garments in my wardrobe). Without even knowing you (based on your choice of topics), I would say it could be the lack of true creativity combined with the insecurity-backed snobbery that is annoying.
Personally, though, I think the word is stupid and way to general to really represent anything, but that is my take on it. Perhaps I don’t know the true definition.