I agree that "infant" describes the first stage after birth, but we would call that a "baby" as well. People go to the hospital to have a baby, not to have an "infant." "Infant" is almost a more clinical term.
And, from the perspective of the parent, the child is always their "baby."
Student or Learner