Since you were not available when he was flirting with you maybe he thought you weren't interested. You need to do some serious flirting to let him know you're available...even leave your digits for him. Make it known you're interested and available. If the situation's right for him he will take action.