Yes. Because if we all do that, the incident of home burglary won’t go up at all.
Seriously—they’re safe, FDIC insures, we get to keep our money, and keeping your money under the mattress or whatever else that’s not in a bank and FDIC insured is silly. And dangerous. For you. Actually, for your money. You aren’t earning interest AND you run the risk of losing it all to theft.