Does family compatibility matter more than I thought?

Okay so this is something I keep circling around. My boyfriend's family does Sunday dinners every week and I'm used to like, seeing my family once a month. I thought we were fine until the first dinner where his mom asked about our timeline and I panicked. Feng Shui wise I get that a home needs balance, but family energy is a whole different layout. How do you tell if the family dynamic is just different or a real dealbreaker?