Hello Najma, welcome to the forum!
I would put Teachers' Office, if several teachers are to be found there.
Punctuation can look very unattractive, on signs; but if you omit the apostrophe, in the context of "teachers", people will never stop mentioning it.
Best wishes,
MrP