Do you wish to discuss your own family? Or the other person's family?
You can say simply "Do you have any brothers or sisters?" to start a conversation, if you want. Or "Where did you grow up? Are any members of your family still living there?"