I tried to Google this and it just gave me instructions on how to remove addons. Not what I want.

I have set the majority of my plugins (Excluding Java, but including Flash) to never activate but I don’t see any button to remove these plugins completely.