I will be in the office all day.
There is a lot going on in the office.
They rearranged the cubicles in the office.
The only time I expect to see "at office" is when it is part of a phrase:
at office parties
good at office politics
sale at Office Depot
Interested in Language