There's no reason to use "with some other lady". Just say he had an affair. Everyone knows what that means (though of course he could have had an affair with a woman or a man).
I can't quite put my finger on why, but in BrE we tend to use "to keep an/my eye on someone/something" but "to have my eye on someone/something".
Student or Learner