So I have a question. Well I recently came home to visit my family. Well normally my husband's side…

So I have a question. Well I recently came home to visit my family. Well normally my husband's side of the family doesn't call or check up on Julian but his dad and brother. Now that I am home his mom and his sister want him to spend the night at there house (they live in different houses) but I'm not really comfortable with that because he's young well 7 months but they never really check up on him either. Just wondering what I should do? Am I the bad guy for not wanting him to spend the night over there? I mean I'll go and visit.