You're right; but for me, this meaning:
1. We were in a blue van and John came to that van and joined us there.
doesn't immediately leap out.
If you wanted to express #1, it seems to me, you would be more likely to say e.g.
2. We were in a blue van when J. joined us.