In that case, you're not omitting "in which". You're omitting "which" and moving "in" to the end.
It's certainly possible to change "That's the city which Obama was born in" to "That's the city Obama was born in." That's a rather common omission of the relative pronoun. You can't completely omit "in which". You also can't omit "where", because it means "in which".