In some sentences, you'll see also a 'to' infinitive after go as in:
I'll go to sleep.
I don't think there is a simple rule that would explain all these differences. You should learn these phrases separately. But I'm not a teacher and maybe I'm wrong.
Student or Learner