People with internal clock differences need to accommodate it. Sometimes it’s just a change of perspective, that each of you can have your alone time, when you know the other is going to need to be asleep. You also need to find a time when each of you will be awake and plan on having together time. I had a partner who required little sleep, like you, but, he would get mad that I was asleep. I was sleeping an average schedule and number of hours. I think it was sometimes challenging for him, to be awake so much, and alone. Brain storm together about seeing an advantage in the difference. I personally feel, it’s important to have some alone, undisturbed time, to spend however you choose, uninterrupted. . .meditate, exercise, read, have a hobby,get work done, do housework, write that great novel, watch the taped shows you love and the other doesn’t, put your head phones on and rock out to the music you prefer, luxuriate in a bath, go do the grocery shopping when there isn’t a crowd etc.! I think having that time and being comfortable with it helps keep a balance and can enhance the time when you are together.
I know someone who got angry because his wife was consistently 15 min. late when they planned to meet. With his second wife, who did the same thing, he planned to have something to read and that he would have a chance to read for about 15 min.. He said it made a world of difference, accepting the difference, and making it a neutral or positive thing.