Why Am I Always the Bad Guy in My Husband's Family?

so my hubby doesn't know how to say no to my brother but expects me to do it and be the bad guy every time so now instead of him just saying another time come over he says asks your sister. after I made plans just to relax and cuddle he could've just been man of house and handled it stop making me the bad one all the time. my brother knows I'm not feeling well too. he just wants to come over to smoke because he doesn't have a job to support his own habit but my bf is too nice and still smokes with him. so I just smh and ask so when you don't have nothing to smoke do you think he will do the same for you???