Talked to my husband a while back about trying for our first baby and he was real excited but then…

Talked to my husband a while back about trying for our first baby and he was real excited but then he changed his mind and said the timing wasn't right and he saw how upset I was. So we revisited the idea and he agreed to try again so of course I got real happy and said lets have a baby and he changed his mind again....I'm not sure how to take this. He keeps getting my hopes up and then they come crashing the second he changes his mind. I don't know what to do or even how to talk to him about this.