You should stay and try to work it out. The first thing is to talk to him and tell him how you feel.
Have you done that yet? It's always best to be honest at all time. Tell him what you want and need.
Kill him with kindness and be as sweet as you can to him. You might just see a new side of him.
Theses are a few things I would try before I made up my mine to leave. You did take him for better or worst. I wish you the best and I hope you find out you are in love with him.

