Please tell me if I'm in the wrong.

My cousin gave birth just over a week ago I'm happy for her don't get me wrong. But my nan has decided to go stay near her for a month to be around and help with her baby. She never did this for me and has only see my daughter for 2 hours in the last 3 months. I was asked today if I would go and see them for the day. I told them that it wouldn't be possible as its a 3 hour round trip and that I've been in and out of hospital lately but told them they are welcome to come to mine. After telling me I am selfish, they are now not wanting to have anything to do with me or my daughter because I wouldn't go see them.

If I hadn't been in and out of hospital I would happily go. But I didn't fancy ending up in a hospital I don't no while being in pain and have no one to look after my daughter.

What is people's opinions on this?