The meaning depends on whether that is the full sentence. Your dots, I think, tend to imply that it's not. "would have had" could mean something completely different if there's an 'if' clause following.
Assuming that the sentence is complete, it means that the speaker isn't absolutely sure that many had the privilege (he has no proof), but he considers it likely.
Student or Learner