Well maybe you just need more. Obvisously hanging out with him daily or bi-daily or whatever is making you feel somewhat distraught. Let him come to you, and don't always have time for him.