With most verbs, there would be a clear semantic difference between perfective and imperfective forms revolving around the inception/execution of the action (imperfective) versus its conclusion/finished state (perfective).
The subordinate clause of
By the time I wrote the letter, I was feeling really angry.
, for example, clearly differs in terms of temporal reference from that of
By the time I had written the letter, I was beginning to feel much better.
In the case, however, of verbs which themselves denote inception or conclusion (start, begin, finish, etc.), the difference tends to become unimportant: there is little real semantic gain in specifying, by means of 'had finished', that we refer to the completion of the act of finishing, making the formally more complex compound tense redundant (albeit still structurally possible) in this case.
There is similarly no substantial difference between
By the time I started work,..
and
By the time I had started work,...
Excalibur!
Are your there?
Do you have any addition?