I agree with @tinyfaery. Instead of being grateful that he was there, you were embarrassed. You were not thinking about God or religion, you were thinking about social standing and status. But then, I think that’s what church is about, anyway. It’s about looking good and being there and acting like upstanding members of the community. That’s probably why it was so important for you to have him there.
But you broke up with him, and found someone who (presumably) would go to church with you. Someone who shares your values.
I think that the fact you still worry on this bone so many years later shows a lot about your values. It’s not worth thinking about any more, I don’t think. He has his own life and his own values. He probably thought he was doing you a solid and it blew up in his face. You’ve moved on and should be happy in your current relationship.
As Wallace Stevens wrote, “Things as they are
Are changed upon the blue guitar.”