Yes, that's really hard. I think you need just to ask him not "what's going on?" but "if you're not interested at me just say it to me honestly" smth like that.