I agree, you both deserve to say goodbye in person. So what if you aren't good at goodbyes? So what if it hurts? If you love him, you can't just up and leave without saying goodbye and wishing each other the best.
After the 4 years maybe you'll find each other again, or maybe he'll simply remain a fond memory of your first love. That memory will always be bitter if you never got to tell him how you felt and never said goodbye properly.

__________________