Although it is certainly not unknown that some people are afraid of plants it is extremely unusual to have a fear of bathrooms and restrooms.
I note that being in a bathroom or a restroom with someone does not affect you so much or if you know the surroundings.
Virtually everyone has a phobia of one kind or another such as spiders cats, dogs, height, enclosed spaces etc.
Recovering from phobias can be extremely difficult and the best way to overcome them I have found is willpower. Another way you may be able to get help is by consulting a psychotherapist.
There is no stigma attached to seeing a psychotherapist and you don’t have any mental issues.
I know about phobias because I had one right through my childhood right up to my mid 20s.
In my case when I was about 6 I unknowingly put my knee into a bees nest in the hedge and was stung at least 5 times. From that time and until I was about 25 I was petrified of bees and hornets etc.
Finally I realised I must get over this phobia and and started reading as much as I could about the life of bees. After that I watched documentaries about bees. I learned that bees are the most wonderful creatures and they are miraculous.
Slowly I started getting closer and closer to bees when on flowers or airborne.
Now I am have absolutely no fear of these flying creatures and in fact bees have landed on my skin and I do not flinch.
I have also worked with apiarists in the care of bees and it bid not worry me in the least.
All this took about 2 years to overcome my fear but it was well worth it.
It shows that phobias can be overcome.
The very best of luck and I hope you do manage to overcome your phobias.