Hello, Over the top.
(1) I believe that you should say:
He called to invite me to a party. Why did he call? TO INVITE me.
(2) You could, however, use the gerund this way:
Thank you so much for INVITING me to your party.
***** Thank you for asking that question *****
Student or Learner