I didn't see you there. Were you there?
Is it grammatically wrong if I say "Did you be there?"
I think both of them can be used, at least in speaking, can't they?
The auxiliary DO is used with BE only in the negative and the emphatic forms of the imperative:
Don't be silly.
Do be careful.
Context is always important; labelling is rarely important.