I've an unclear premonition that your sentence is quite right.
It would be a little bit strange as the following:
Memories + crowded in + in me.
I've heard the song named: "Lay All Your Love On Me" by ABBA.
Domo arigato, oyasumi.
The sentence is correct as is. "crowd in' is a phrasal verb meaning to move into a small space (in your example, the head or the brain or the mind) and we often use it with 'on' and it is often associated with memories or thoughts.