'Had you' and 'Did you'

[Kii]

Had you gone here?
Did you go here?

Are they interchangeable or must I reserve 'had you' for conditional statements (e.g. Had you gone here, I would've...)?

 

[Tdol]

Neither really works- you could use come/came.

Had you come here before we met at the party last year?
Did you come here last night?