For him and for the rest of us, the most serious gift - arguably the only serious one - is our knowledge, abilities, and passions.
This phrase interupts the sentence (hence the dashes to off set the words.
It is a side commment on the "serious gift."
It means that one could argue that it was the only serious gift.
Interested in Language