Your friends do not grow apart 'from' you. You can only say: my friends and I grew apart over the years or after seeing them on the ten year reunion, it dawned on me how much my friends and I had grown apart, we don't keep in touch at all anymore.
grow apart (from sb) to stop having a close relationship with sb over a period of time: As we got older we just grew apart.
Since moving to London, he’s grown apart from many of his friends.
She says she often took her father's sacrifice for granted, because it had been her parents' decision to have her study in the United States. She adds, as her younger brother entered adolescence, he began to grow apart from their father because of the distance.