I was talking about the files yesterday
Subject-verb agreement applies.
The files .... are
If the office is the subject, it would be 'is in disarray'
Yesterday I was talking about the office in which the files are now sitting. (Non - native speaker, this is how I would paraphrase it.)