I would also cringe if someone said "married with".

As for speaking with or to, "with" is more polite, indicating that it would be a conversation between two people.

If you say "to" it is more or less a one-way conversation, as in "I need to speak to you regarding your table manners." - a lecture to a child.

However, in Canada it is generally "speak to".

I am not a teacher.