I think you are right. Generally, we can omit 'that' or 'which' when they are the object. e.g. 'This is the building he worked in.' 'This is the place he worked in'. Another alternative would be 'This is the place where he worked.' 'This is the building where he worked.' Hope this helps.
Student or Learner