Your original is totally incorrect.So we can't use "Had done" or have I used it incorrectly, if we cannot use "Had done"here then my question is why because here we are moving 1 step back in past.
Well, it's a pity I didn't make that statement.Raymott's statement that your sentence was totally correct was either facetious or incorrect.