I keep mine set to zero. I have a fast Internet connection.
And we should define the cache. It just stores pages you just used. If you delete it for privacy you are doing it wrong. You want to delete your history file. They are totally separate things.
Do a force reload on a page if it is giving you problems. Usually shift + reload… You shouldn’t ever need to deal with your cache.