When I learnt about letter writing, I was always told:
Dear Sir ---- Yours faithfully
Dear Mr/Mrs [name] ---- Yours sincerely
However, these days, I do see a lot of letters which end "Yours" or "With regards". Personally, I feel that "Yours sincerely/faithfully" sound much more formal in a business letter.
Student or Learner