so we have age differences (i would hate to think that this is the reason) I'm 24 and he's 20. I don't think I'm old to the point where I don't have sex drive

so, his conclusion is that he's going to have to reduce his sex drive or take care of himself.
And I agree, sometimes I can't help but feel that I have to. Unfortunately, not every woman has a man who's happy enough to just wake up next her.