The system of notes that we currently use to make (most) music is based on math. Here’s some more detail. Basically, music that (most of us) think is beautiful is based on the Fibonacci series (which is related to the Golden Ratio). This number makes a lot of beautiful things in nature, and certainly nature keeps coming back to that number in all kinds of places.
Of course, there is music that’s not based on this little mathematical slice of nature, but I believe it takes a certain acquired taste to be able to appreciate it. Most listeners would find it unharmonic, discordant, and, frankly, not beautiful.