The one with "It's all downhill from here" is clearly meant to be a play on words but it doesn't really work. If the hard part of the journey is over, then from now on things will get easier/better for him. That's not the meaning of "It's all downhill from here". That means things will get worse/harder.
Student or Learner