Maybe being more direct then, without being overly aggressive. "Would you mind if I asked you out to dinner sometime?" This is just an idea, some guys out there may have a better suggestion. But being shy myself I wouldn't be put off if someone asked me this.