He’s staying at home moms but staying at my place watching the kids at night for me so I can still…

He’s staying at home moms but staying at my place watching the kids at night for me so I can still work. But he says we just need a break! I’m so lost I don’t want this but I don’t want him to think he can come and go whenever he wants!