- It was they that were responsible for the contamination."
However, to my ears the pronoun "they" is an unnecessary circumlocution. Why not just say, It was the parts that were responsible... Or even, The parts were responsible...
Also, in your first example you do not need the comma: It was he who came late.
Student or Learner