A port has built structures in it to make it easier for ships to berth, unload and load cargo, debark and embark passengers etc.
A harbor refers to the geographical nature of a protected area (usually) with water deep enough to accommodate ships.
You can have a natural harbor. You can't have a natural port.
Student or Learner