Why is it so hard for me to confront someone? my daughter's grandfather on her father's side…

Why is it so hard for me to confront someone? my daughter's grandfather on her father's side actually contacted me saying he wants to see his granddaughter and tell him when it can happen. I told him I don't think my car can make the trip too much anymore and that everyone is more then welcome to come here and visit. 12hours later I just got a thanks back. like really? I think they are acting like I'm keeping her from them but like I've said before no word from any of them since Sunday before christmas when they saw her. I want to tell him wtf is no one asking about her but I can't.