When you feel unhappy in your relationship more often of than you feel happy, and you or the other person is unable or unwilling to make any useful changes to repair the situation.
If there is abuse (could be physical, could be verbal or psychological).
If you or the other person is no long in love and one or both of you is not willing to continue on in a relationship that is simply platonic (for some couples this is perfectly comfortable for them).
If the other person treats you as a second class citizen, or treats you as if you are not very important. If one or both people treats the other in a careless or reckless manner.
If the other person has unrealistic expectations about you. I’m thinking more in terms of what he/she might expect from your behavior (what you wear, who you associate with, how much of the housework falls on your shoulders, harsh or old fashioned gender expectations on how one should act). I guess you could say a person like that is controlling.
If either of you has unresolved issues that can’t be fixed/changed, such as one person wanting children and the other person not wanting children.