1. Hardly in this case means only just. He had only just left.
2. The "swearing-in party" was the party for the appointment of Paterson. The phrase saying that the party "was still going" means that the party for his appointment was still happening. This is an exaduration, what is actaully meant is that Paterson was coming clean very very shortly after having been appointed.
Student or Learner