Yep jealousy is the case.
TRUST ME, im a guy and I know - If i like a girl alot, im not gonna go look for other girls, unless something is wrong is the relationship.

I can tell you dont trust him either.

YOU need to tell him how you feel, he wont think your weird, your just being honest.
Honesty is a very large part of a healthy relationship.