In everyday language, I too haven't heard the plural, but it would appear that it is used medically:
But now with the discovery of the x-chromosomes sperms and y-chromosomes sperms in the semen, the medical scientists proclaimed that it is the male who is responsible for choosing or selecting the sex of the baby.
Sex of Baby Pediatric Oncall