People do say it the way you have it, but the standard English is
As long as he came back to me, I was a happy kid.
Indeed, without context the sentence seems more natural if you reverse the clauses:
I was a happy kid, so [as] long as he came back to me.
Student or Learner