Oh, this is easy to answer. Next time he brings it up, you turn to him and say, "Why all the sudden is my height an issue?"

__________________
If a shoe don't fit, it ain't your shoe!