I've been seeing this man/colleague for about 3 weeks, he recently separated (6 months ago) from his 3 years of marriage wife. Now he lives alone. I am moving out of my appartment in june and separating from my 5 year husband, I signed the new lease and all's good. I am in no way read for a steady confined relationship AT ALL.. well nor is he. But over the course of the past 3 weeks we have grown mutual emotional attachment and feelings which we do speak about.. He says I was a blessing in his life and he even drew tears.
At first we had crushes on each other and we asked each other out. Then I started passing some time over at his place sometimes during the week after work..

Well the point is, when im not with him i truly miss him. But I dont think he misses me because i called him last friday and asked him if he was free on saturday and he hesitated, he told me he had a hell of a week and he needed some psychological space and time to be on his own, he did want to be with me but from his mood on that friday he said he thought he wouldnt be in that mind frame.. he wanted me to call him the next day so he can confirm, well I just told him never mind that i understood and that we will see each other at work on monday.. ( i was a little hurt that he refused wanting to see me however i do understand him wanting some space, he hasnt been alone all week)

Judging from both our situations i do understand him wanting to be alone.
However does it mean that i am pushing things too fast? What am i doing wrong?
He cant call me because i dont have a private phone so im always the one calling him and sometimes i feel like im overimposing..

what should i do..

p.s. i called him 5 minutes ago and it was his answering machine, but i blocked my number so he doesnt know who called..
Oh well
I feel like he constantly has the ball in his hands..
I should get a cell phone but i have no money..