Depending on how aggressive or sensitive your family is. Either tell them you want alone time with your baby so you can bond. Or you can tell them you don't want the dad's family over so they can't come either. The dad can say the same thing to his family.