He's not being unfair. I agree with him 100%. It's your choice to either find a better way to live your life or let him go. All this stuff is fine if your single, and you want to do it, but to try and hold a relationship is just not an option.