I'm 24, married, and living in a rented house

I'm 24, married, and living in a rented house due to financial issues. My husband knew about this before marriage and was okay with it. However, after marriage, my father-in-law said it's a shame to admit I'm from a rented house and told me not to share it with relatives. During an argument, they said I have no voice because I'm from a rented house. My husband didn't defend me, and it's been 2 years, but I still can't forget it. It's affecting my mental health, and I've stopped visiting my husband's home.