They mean the same thing. You were all with each other.
Many teachers and editors would advise you to say "Whom were you with?" However, "Who were you with?" is more common and, to most ears, more natural.
I recommend whom for formal writing and speaking, who for informal writing and speaking. But some teachers and editors prefer dumping whom altogether.