Hey mamas I need advice!

Me and my boyfriend had a deep conversation this weekend because he ended up calling me emotionally abusive. We got into an argument where he took it out of line and told me he felt I was being abusive. I've been holding things in and venting my frustration but I have never been abusive and I apologized for venting out my frustration and promise I would talk more and stop yelling about things also letting him know I'm not abusive in any way since I have also told him I never wanted or tried to be abusive. We have been fighting more because of living with his family and they keep getting in our business. I have to kept my promise and I'm focusing on being a good gf and mother. I've stopped yelling since that's how my family was and his family was different. I choose to talk things out now especially when we argue. He chose to tell his cousin I was abusing him emotionally and never talked to me. Well his whole family now considers me abusive to him emotionally when I never have even asked him to help me or do anything for me we just began fighting more. I've never yelled when I was pregnant or when we were dating it just began with the stress of staying with his family and our lack of communication about our relationship keep in mind I'm not abusive. My dad did abused me when I was little physical and I've just always fought with my siblings through yelling. His family is terrible to me yet I have a daughter with him and now since they think I abuse him I really don't wanna be part of his family. My boyfriend broke my trust and has lied to me so I don't want to even believe him much anymore. If he talked to me first I would have been calm and I gave been. I loved him everyday and even forced my self to stay with his family because of our daughter his mom is cruel to me and loves gossiping behind my back. I'm not a bad person but I told him I would leave not threatening or mean but I wanted to leave apartment and take our daughter because his whole family has put me down and keeps acting fake towards me. He said he took the whole thing out of proportion and just realized I was never abusive. His cousins dislike me also since they are also constantly putting me down behind my back. I'm a wonderful mom and I do the best as his gf but I wanna cut out his family they our extremely toxic to me but to my daughter it's unfair but I can't be around people who love to put me down and break us apart. His mom has also overstepped my boundaries and thinks she is righteous in not apologizing to me I've apologized to her for telling her how I felt. To be honest I feel I have done nothing wrong and now I hate my bfs family strongly except his dad and baby sister who understand and his dad has accepted me and treats me well.