What level of math did you leave off at? It is hard to recommend a book without knowing where you are. This James Stewart text is a classic Calculus book. Doesn’t matter what edition you get. They are used all across the country in college calc classes, and it did a good job teaching me the subject. Highly recommend.
If you are not there yet, stash the idea for future use. I’ve come to realize that math is so much more than just solving textbook problems. I had to get to partial differential equations to realize it, though. Math is basically a language humans have developed over millenia to explain how the world works. If you are intimidated by the subject (many people are), I suggest an indirect approach – consider looking back at how mathematics evolved, its history. Learning math through history would have been much more interesting to me. I just read Zero: The Biography of a Dangerous Idea, which kind of takes this approach. It gets a little technical towards the end, and would be a much better read if you understand basic calculus and basic physics, but you may still find it interesting. And here now I am assuming you haven’t studied calc yet…don’t be offended, I’m just not sure at all where you are.
If you understand why an equation is, you can derive it from nothing and don’t need to memorize it. This is what I like about math – there is always an explanation as to why. It is very logical. Unlike physics where everything simply is because it is.