"Let's" serves as an 1st person plural imperative, as your friend says.
In an imperative sentence, the subject is implicit:
1. Go home at once!
– implicit subject "you": "(You) go home at once!"
So in this sentence,
2. Let's go home!
– the implicit subject is again "you":
3. (You) let us go home!