If you want to go “under the radar” then keep a clunker car and clothes to tool around in. When you go to an event with other wealthy folks, bring out the Lamborghini and the furs.
Seriously? It’s kind of hard to help you if we don’t know what these people are saying. I think it’s always best to be polite, diffident, and to not brag. Be respectful of others, no matter what their socio-economic status, and no matter how rude they might be towards you. A little self-deprecation won’t hurt. Nor will a sense of social responsibility. Do good.
If people are pointing out your wealth because you are arrogant, then stop being arrogant. And if they are merely being rude, maintain your politesse. You do not need to respond to rudeness with your own rudeness. It’s well to remain above the fray.
If they are jealous, you should still be kind, honest, and as open as you can be. Respect them. As soon as you stop doing that, you’ll be getting all kinds of shit, in spades!