Is it ok for me to want to be at peace with both my families?

Am torn between listening to what my mum and sister want me to do and what my husband wants me to do. Honestly my husband is abusive both physically and emotionally, but I get where he is coming from. We have had infidelity issues on both our ends, we try to solve them, but my family want me to leave his house. Now since I said no to leaving, they hate me and are disappointed in me. I want both sides to be at peace, but am the one at cross roads. I just want to disappear, that way everyone wins.