Read my
journal. I wrote about exactly that.
The short version is -- if you are in doubt, love it isn't.
As for your particular situation, you are right to voice your criticisms about his behavior, because to work on something he has to know it bothers you first.