Is it also correct to say "I had my prime"?

i.e. I had my prime in the fifties.