You were allowed to do something means you had permission to do it. Could is a broader term and usually means the ability to do something.
You could climb the garden wall because you were young and strong, but you didn't because you weren't allowed to.
Once in a while I hear could used in the sense of was allowed to. For example:
My father was very permissive. I could use his car to go on dates whenever I wanted.
Interested in Language