Are you sure he's not just dating you for sex from a young lady? If you're sure, I suggest you tell him your feelings. Age is not a large factor unless it comes to something like a guy wanting his own children, in which case he won't go looking for a 50 year old lady to do.