You could, but without more context I would assume that that meant that you had not prepared pizza for a while.Could I use it to mean I haven't had pizza in a while "I haven't done pizza in a while"?
If you have a question about the English language and would like to ask one of our many English teachers and language experts, please click the button below to let us know: