A sentence that might have been written by a native speaker!
And your interpretation of the meaning is just about spot on:
If we expand the sentence:
"As clever as he was, he wasn't...."
The nuance of this is, that you have 'clever people', and within that group, he was more clever than most of them; and even as clever as that, he still wasn't able...
Student or Learner