hi cleung. i'm pretty sure that you should use 'was' but i also think that 'is' is right.
so your sentence might be: We all have recently taken some time off from work, whether it is/was a longer vacation or just short break of a day or two.
if i were you, I'd use 'is'. But it also depends on the context.