^^ definitely ask them to place you somewhere else. If you get a bad vibe, it's probably for a reason. I will tell you up front though, lots of mental illnesses make people manipulative, especially those that suffer from eating disorders or those who use self harm/substance abuse as a coping mechanism. I know because I've been there. No matter who you work with, remember to stick to your guns and be firm about the program that they're supposed to follow.
Go to your team leader, then the house manager, then above them if need be, but if you are not comfortable in your working environment trust me consumers are able to sense that and can play off that weakness. Don't try to be the person that pretends it doesn't bother them when it's really always in the back of your mind. Take it from a DSP/CRMA that will never again work in a group home after being brutally attacked twice. The scars you'll be left with aren't worth it. Get out now!