From my experience, the problem isn't the question itself but how and why it's being asked. I've seen it used as a way of measuring one's success because they believe everyone should want and have a family to be successful in life and if you don't want or have that, you are treated differently and sometimes even as an outright failure to them.