The Chinese foreign minister made this remark when he met with his French counterpart in Beijing.
'It' and 'that' refer back to a noun previously mentioned. 'Counterpart' means 'someone' (or, possibly, 'something') doing the same job as someone previously mentioned.
'The Chinese foreign minister made this remark when he met (with) the French foreign minister in Beijing' is fine.
Student or Learner