Why do you doubt it's a habitual action in the past?
"Would" doesn't have to be a habitual action in the past though. Take a look at this:
(From Roughing It by Mark Twain)My brother had just been appointed Secretary of Nevada Territory--an office of such majesty that it concentrated in itself the duties and dignities of Treasurer, Comptroller, Secretary of State, and Acting Governor in the Governor's absence. . . . He was going to travel! . . . Pretty soon he would be hundreds and hundreds of miles away on the great plains and deserts, and among the mountains of the Far West, and would see buffaloes . . . And he would see the gold mines and the silver mines . . . And by-and-bye he would become very rich . . .
Student or Learner